Login Register WSPC 2017 • Schedule • Participation • Location • WSC • WPC • Contact •Search •Recent





LMI Screen Test #4 — November Sudoku Test — 15th-18th November
   LMI Tests -> Monthly Sudoku and Puzzle Tests109 posts • Page 3 of 5 • 1 2 3 4 5
An LMI player
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-15 11:49 PM (#13464 - in reply to #13371) (#13464) Top


 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? A bit hard
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? A bit too many puzzles
 What is your opinion about rules, points and scoring for this test? Fair
 What is your opinion about the solving interface? Fairly Nice


An LMI player
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 2:32 AM (#13465 - in reply to #13371) (#13465) Top


 How balanced do you think the puzzle types of this test were? Fairly balanced
 What was your opinion of the distribution of easy/hard puzzles? A bit hard
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Way too many puzzles (too little time)
 What is your opinion about the solving interface? Very nice


chaotic_iak
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 5:53 AM (#13466 - in reply to #13371) (#13466) Top



Typed Logic Author

Posts: 241
1001002020
Location: Indonesia
 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? A bit hard
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Very fair
 What is your opinion about the solving interface? Fairly Nice


...I have an urge to rate the puzzle quality as below average due to the cooked puzzles. D:
cnarrikkattu
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 8:01 AM (#13467 - in reply to #13371) (#13467) Top




Posts: 25
20
Location: United States
 How balanced do you think the puzzle types of this test were? Fairly balanced
 What was your opinion of the distribution of easy/hard puzzles? Just right
 What did you think about the puzzle quality of the test? Fairly Nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Fair
 What is your opinion about the solving interface? Fairly Nice


prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 8:03 AM (#13468 - in reply to #13450) (#13468) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
BohemianCoast - 2013-11-15 5:37 PM

I'm not clear what determined which section puzzles went into.


Its given in the guide that the categories were done according to familiarity/accessibility more than difficulty.
prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 8:05 AM (#13469 - in reply to #13371) (#13469) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
About the evil JOCs, firstly, I'm really sorry We're looking at a way to fix the problem. We're thinking of going with canceling B2 and E5, and awarding [points scored over remainder / seconds spent over remainder * seconds spent on B2,E5]. We would like to know general thoughts on whether this is fair.
prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 8:57 AM (#13470 - in reply to #13456) (#13470) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
chaotic_iak - 2013-11-15 8:04 PM


I'll comment on E4 instead, where the rules in the applet is not complete (no "converse rule applies", no "only three cells in the same region are counted").



This was mainly because of the rules being too long. The rules have now been shortened to be accommodated on the applet. Thanks for the notification.
FoxFireX
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 9:16 AM (#13471 - in reply to #13470) (#13471) Top





Posts: 35
20
Location: United States
prasanna16391 - 2013-11-15 9:57 PM

chaotic_iak - 2013-11-15 8:04 PM


I'll comment on E4 instead, where the rules in the applet is not complete (no "converse rule applies", no "only three cells in the same region are counted").



This was mainly because of the rules being too long. The rules have now been shortened to be accommodated on the applet. Thanks for the notification.

Heh, I think that may have bitten me. When I was solving E4, I don't think the "No arrow means no sequence" part had been added. I looked over my solution, glanced at the rules summary, saw no contradiction, and submitted and moved on. Not sure I would have had time to find the correct solution even if I had the right rules, but oh well. Much happier with my performance regardless of the issues. I still wasn't going to finish, but it was great to get so much closer. Thanks for the cool puzzles!
chaotic_iak
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 9:22 AM (#13472 - in reply to #13469) (#13472) Top



Typed Logic Author

Posts: 241
1001002020
Location: Indonesia
prasanna16391 - 2013-11-16 11:05 AM

About the evil JOCs, firstly, I'm really sorry We're looking at a way to fix the problem. We're thinking of going with canceling B2 and E5, and awarding [points scored over remainder / seconds spent over remainder * seconds spent on B2,E5]. We would like to know general thoughts on whether this is fair.


I'm curious whether people actually continue solving after the time is up or not. If they do, you can try removing the seconds spent in B2 and E5 and count the unofficial time for the length of time spent on B2 and E5? (For example, in my case, I spent 300 seconds in B2 and like 50 seconds in E5, so I gain an extension of 350 seconds, counting the first 350 unofficial seconds as official.)

(Ok this suggestion is a bit biased since with an additional of 300 seconds or so I would have finished the test. :P )

Edited by chaotic_iak 2013-11-16 9:23 AM
prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 9:34 AM (#13473 - in reply to #13472) (#13473) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
chaotic_iak - 2013-11-16 9:22 AM

I'm curious whether people actually continue solving after the time is up or not. If they do, you can try removing the seconds spent in B2 and E5 and count the unofficial time for the length of time spent on B2 and E5? (For example, in my case, I spent 300 seconds in B2 and like 50 seconds in E5, so I gain an extension of 350 seconds, counting the first 350 unofficial seconds as official.)

(Ok this suggestion is a bit biased since with an additional of 300 seconds or so I would have finished the test. :P )


This would be ideal if everyone continued solving after time. But thats not the case, so its unfair to those who stopped.
chaotic_iak
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 10:51 AM (#13474 - in reply to #13473) (#13474) Top



Typed Logic Author

Posts: 241
1001002020
Location: Indonesia
I can't see a good way out then. My opinion would be to drop B2 and E5, then let the total score be multiplied by 3600 / (seconds spent in all other puzzles)...basically the same thing as you suggested. I feel something is unfair about this, but I cannot really point it out...yeah it's weird. xP
caudmont
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 6:15 PM (#13478 - in reply to #13469) (#13478) Top


SudoClones Author

Posts: 18

Location: France
prasanna16391 - 2013-11-16 8:05 AM

About the evil JOCs, firstly, I'm really sorry We're looking at a way to fix the problem. We're thinking of going with canceling B2 and E5, and awarding [points scored over remainder / seconds spent over remainder * seconds spent on B2,E5]. We would like to know general thoughts on whether this is fair.


If two players solved correctly the 28 remainder sudokus in the same time, and one spent much time on B2 and E5 as the other, would they get finally the same number of points ?
wicktroll
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 7:08 PM (#13479 - in reply to #13371) (#13479) Top




Posts: 16

Location: Hungary
 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? Just right
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Fair
 What is your opinion about the solving interface? Very nice


prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 8:09 PM (#13480 - in reply to #13478) (#13480) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
caudmont - 2013-11-16 6:15 PM

If two players solved correctly the 28 remainder sudokus in the same time, and one spent much time on B2 and E5 as the other, would they get finally the same number of points ?


Yes. I think in the event of the puzzles being canceled, that is fair.
auroux
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 10:06 PM (#13481 - in reply to #13371) (#13481) Top


Hex Slitherlink Author

Posts: 144
1002020
Location: France
Oh wait, the displayed rules for E4 were incorrect? (incomplete, not mentioning that no arrow means not in order). That's REALLY EVIL, and I'm pretty sure it caused me to submit a solution that was valid for the displayed rule but counted as wrong.
Hmmm... Prasanna, can we hope that future screen tests get implemented more carefully? Thanks!

-- Denis
rob
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 10:52 PM (#13482 - in reply to #13371) (#13482) Top


Classics & Regions (PR 2016/17) Author

Posts: 170
100202020
Location: Germany
Wheeee… going to http://logicmastersindia.com/ST/ST4/ after having finished the test (was wondering whether that allowed me to review the puzzles), my browser goes into something like a redirect loop. (Safari 6.1 (7537.71) / Mac)

The test was fun, but kind of stressful. Good practice.
An LMI player
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 10:59 PM (#13483 - in reply to #13371) (#13483) Top


 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? Too many hard puzzles
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Bit unfair
 What is your opinion about the solving interface? Very nice


Fred76
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 11:22 PM (#13484 - in reply to #13473) (#13484) Top



Diagonal Vision Author

Posts: 337
10010010020
Location: Switzerland
prasanna16391 - 2013-11-16 9:34 AM

chaotic_iak - 2013-11-16 9:22 AM

I'm curious whether people actually continue solving after the time is up or not. If they do, you can try removing the seconds spent in B2 and E5 and count the unofficial time for the length of time spent on B2 and E5? (For example, in my case, I spent 300 seconds in B2 and like 50 seconds in E5, so I gain an extension of 350 seconds, counting the first 350 unofficial seconds as official.)

(Ok this suggestion is a bit biased since with an additional of 300 seconds or so I would have finished the test. :P )


This would be ideal if everyone continued solving after time. But thats not the case, so its unfair to those who stopped.


I thought about what could the best decision to have a fairer ranking, given the 2 wrong puzzles. It's a bit complicated and I don't know if it's technically doable, but that's what I thought:

-cancel B2 and E5 and remove the times of both puzzles for every player.
-calculate a new time limit as 3600-(maximum time spent by a player on puzzles B2+E5)
-For players who didn't finish the 28 puzzles in the new time limit, you've to estimate points for the last puzzle (the puzzle player was solving when the new limit was reached). For example, you can take a percentage of points proportional to points gained and solving time of the player in the old ranking (if a player solved his last puzzle in 200 seconds and the new time limit was reached after 100 seconds, assign 50% of the points the player gained).

In my opinion, it's the best way to do as if both puzzles never existed.

Fred
prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-16 11:41 PM (#13485 - in reply to #13481) (#13485) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
auroux - 2013-11-16 10:06 PM

Oh wait, the displayed rules for E4 were incorrect? (incomplete, not mentioning that no arrow means not in order). That's REALLY EVIL, and I'm pretty sure it caused me to submit a solution that was valid for the displayed rule but counted as wrong.
Hmmm... Prasanna, can we hope that future screen tests get implemented more carefully? Thanks!



I'm sorry Denis, and others, for the problems. We will indeed work to make sure these don't happen in future Screen Tests. The problem here was the rules were so long they slipped out of the interface even though we entered them right. I confess I hadn't considered that possibility, and definitely will in future. About this time I agree that Rossini would've been a big problem for folks who hadn't seen/remembered the rules on the guide and relied on the interface. This seems a harder issue to fix than the 2 JOCs which can be dropped as suggested previously.
TiiT
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 12:26 AM (#13486 - in reply to #13371) (#13486) Top




Posts: 139
10020
Location: Estonia
 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? Just right
 What did you think about the puzzle quality of the test? Fairly Nice
 How did you feel about the length / time limit for this test? A bit too few puzzles
 What is your opinion about rules, points and scoring for this test? Fair
 What is your opinion about the solving interface? Fairly Nice


connect4
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 2:25 AM (#13487 - in reply to #13485) (#13487) Top




Posts: 7

Location: United States
prasanna16391 - 2013-11-16 1:41 PM
About this time I agree that Rossini would've been a big problem for folks who hadn't seen/remembered the rules on the guide and relied on the interface. This seems a harder issue to fix than the 2 JOCs which can be dropped as suggested previously.


First of all, I really enjoyed the set, so thanks for putting the puzzles out there!

I don't necessarily care about my ranking, but wanted to throw out there that, because I didn't think I was getting to the end, I did get bitten by the lack of converse (aka I was low on time, took a guess, and my solution was correct without the converse). I don't think there is a way to really fix that one (aside from either the JOC solution of throwing it out, but now we're possibly talking about taking 1/4 of the time spent on the test out, or alternatively grading that problem correct if they hit a correct solution without the converse rule). I do have the feeling that I would've come close to finishing Arrow had all of the rules appeared on the screen, but I don't know if I would've actually done it, so I'm certainly not going to push for any "advantage" from that puzzle.
Nilz
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 3:14 AM (#13488 - in reply to #13371) (#13488) Top




Posts: 29
20
Location: United Kingdom
 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? Just right
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Fair
 What is your opinion about the solving interface? Very nice


A nice test with nice puzzles. However, given that on the last sudoku screen test I ran out of time, this year I skipped a couple of puzzles more quickly. Obviously, I then found I had several minutes wasted at the end. Clearly this is my fault, and there was a note somewhere that these puzzles were generally easier than last years, but I didn't realise just how much easier they would be. Given that a lot of people won't expect to complete every puzzle, 'tactics' and puzzle choice becomes very important (given that the strategy 'never skip' clearly cannot be optimal, except for the best), so I wonder if it would be better to have a more accurate gauge of the level of difficulty of the puzzles, if possible?
Anyway, thanks for the test; I really enjoy screentests, and look forward to the next puzzle one. It's also nice to only have to set aside an hour or so, rather than two or more!
auroux
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 9:16 AM (#13489 - in reply to #13371) (#13489) Top


Hex Slitherlink Author

Posts: 144
1002020
Location: France
Prasanna: don't obsess over how to fix things -- all in all this test was still a lot of fun and I'm sure (at least I hope) that any vaguely reasonable solution to the problem of the two faulty JOCs will be fine for everyone. Also, no worry about the Rossini -- it's too bad, but it's not something I'll hold against you. Stuff happens.

Denis
prasanna16391
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 10:24 AM (#13490 - in reply to #13489) (#13490) Top


2021 World Sudoku+Puzzle Convention Organizer

Posts: 1762
1000500100100202020
Location: India
Few notes :

Firstly, we're making some changes to the score page now (computing bonus, canceling B2/E5 using my previous suggestion, and computing the changes). So if the score page does weird things for a while today, please bear with us

Secondly, we're not considering E4 errors for the bonus, and the bonus will be computed for the rest as announced. Something that isn't announced is, even players who have just one Sudoku wrong are eligible for bonus. So its either players who have just one grid wrong, or players who have 10 cells wrong across multiple grids.

An LMI player
Subject: Re: LMI Screen Test #4 — November Sudoku Test — 15th-18th November @ 2013-11-17 6:57 PM (#13494 - in reply to #13371) (#13494) Top


 How balanced do you think the puzzle types of this test were? Perfectly balanced
 What was your opinion of the distribution of easy/hard puzzles? Just right
 What did you think about the puzzle quality of the test? Very nice
 How did you feel about the length / time limit for this test? Just right
 What is your opinion about rules, points and scoring for this test? Very fair
 What is your opinion about the solving interface? Average


109 posts • Page 3 of 5 • 1 2 3 4 5
Jump to forum :
Search this forum
Printer friendly version