Login Register WSPC 2017 • Schedule • Participation • Location • WSC • WPC • Contact •Search •Recent





Poll Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September
   LMI Tests -> Monthly Sudoku and Puzzle Tests80 posts • Page 2 of 4 • 1 2 3 4
How frequently you would want to see Sprint tests at LMI?
The aim of the Sprint test is to have relatively easier and less number of puzzles so that many more players can complete the full set. Please let us know if we should have more Sprint tests at LMI.
OptionResults
Once in a month22 Votes - [47.83%]
Once in a quarter18 Votes - [39.13%]
Once in 6 months5 Votes - [10.87%]
Once in a year1 Votes - [2.17%]
Never. This should be the last Sprint Test.0 Votes - [0%]
View Results

thesubro
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-03 10:33 AM (#5509 - in reply to #5455) (#5509) Top




Posts: 23
20
Location: United States
As usual, LMI is the the top site for online puzzle test fun, both in terms of the quality of the test taking mechanisms as well as the product. Thanks for all of the hours that the puzzle creators (By Bastien « Ours brun » Vial-Jaime) and Deb put into these efforts.

With that all said, I personally stink at Galaxies and Snake puzzles, so I was not looking forward to them on the test - and my concerns were accurate. I guess I will need to wait for a treatise to be published by Motris or MellowMelon so that I can advance my puzzle career.

Folks, great fun again. Thanks so much.

TheSubro
pribaros
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-03 8:19 PM (#5510 - in reply to #5455) (#5510) Top




Posts: 2

Location: Turkey
i dont see the password and Pdf can not open, anyone knows? (my time is started, immediate pleasee :) )
debmohanty
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-03 8:28 PM (#5511 - in reply to #5510) (#5511) Top



1000500100100100202020
Location: India
pribaros - 2011-09-03 8:19 PM

i dont see the password and Pdf can not open, anyone knows? (my time is started, immediate pleasee :) )

The password is shown below the timer. If you still can't see the password, send me a message


pribaros
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-03 8:31 PM (#5512 - in reply to #5511) (#5512) Top




Posts: 2

Location: Turkey
ahh sooo, ok i see thanx for reply
Administrator
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-03 9:24 PM (#5514 - in reply to #5502) (#5514) Top


20001000500202020
Location: India
Administrator - 2011-09-03 6:15 AM

As usual, please use the score page to settle all claims
All claims will be looked into. Sometimes, it might take a while.
Please check your forum inbox for updates.
kiwijam
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-04 6:53 AM (#5516 - in reply to #5455) (#5516) Top




Posts: 187
10020202020
Location: New Zealand
Will the Hall of Fame entries be based on how much better than the Target Time you achieved?
Sure we want to know who was fastest overall, but the same names are always seen on the podium.
Here is a rare chance for the normal puzzlers to achieve a small amount of glory! :)
motris
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-04 11:36 PM (#5517 - in reply to #5455) (#5517) Top




Posts: 199
10020202020
Location: United States
My pulse is racing more than on any other test. Waiting till the end to do all the typing didn't help. Many good designs and definitely "sprint" was the captured feel. Thanks Bastien!
MellowMelon
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 12:59 AM (#5518 - in reply to #5517) (#5518) Top


Fillomino-Fillia 2 Author

100
Location: United States
Yeah, I can concur with having the pulse racing. Although here, that took the place of the huge amount of sweat I've started to feel all over me after finishing a 90+ minute test.
debmohanty
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 6:25 AM (#5519 - in reply to #5455) (#5519) Top



1000500100100100202020
Location: India
With no one participating now, Sprint test is over. MellowMelon (33:51), motris (34:05), xevs (37:48) take the top 3 positions. Their timings are extremely close (note that xevs took 3.5 minutes to recheck all answers before hitting 'Claim Bonus'). All of them and 3 more in top 10 are well ahead of their 'target' time.

Thank you everyone for participating and for voting in the poll. It is important for us to know what everyone expects.

Some stats :
Total number of participants : 264
Number of non-zero scores : 210
Number of players claiming bonus : 41
Number of players getting bonus : 36
Number of players submitting all 15, but not claiming bonus : 4
Number of players with all 15 correct: 29
Number of players with 14 correct: 19

Median Score : 110

debmohanty
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 6:36 AM (#5520 - in reply to #5455) (#5520) Top



1000500100100100202020
Location: India
Please post any feedback you might have regarding the test
  • Length of the test
  • Difficulty of puzzles
  • Complexity of puzzles
  • Number of puzzles
Bastien will share his thoughts some time later in the day.
spmcandrews
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 7:15 AM (#5521 - in reply to #5455) (#5521) Top




Posts: 1

Location: United States
Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?
motris
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 8:18 AM (#5522 - in reply to #5521) (#5522) Top




Posts: 199
10020202020
Location: United States
spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.


------------------
I really liked the test, particularly the page with the Star Battle (123 theme) and the Tapa below (with 1234 by quadrant theme). Some other puzzles also had cute themes that didn't compromise the lower difficulty goal.

You'll notice though that I am the voter with the least interest in seeing these every month or even every quarter. Just as I liked the Screen Test when it was run a year ago, I felt that was something that could happen every year and be a welcome change from the usual. I view this kind of test the same way. I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

One side comment on scoring - we have consistently been granular on the order of minutes when it comes to bonus. I see no reason to not have fractional points to give the most correct accounting of relative performance (particularly when this test greeted me with my score of 986.252 which has excessive significance anyway). One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)

Edited by motris 2011-09-05 8:21 AM
rakesh_rai
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 8:42 AM (#5524 - in reply to #5522) (#5524) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
debmohanty
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 8:49 AM (#5525 - in reply to #5524) (#5525) Top



1000500100100100202020
Location: India
rakesh_rai - 2011-09-05 8:42 AM

motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
Certainly a glitch there. Will fix that in a while.
debmohanty
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 9:44 AM (#5526 - in reply to #5455) (#5526) Top



1000500100100100202020
Location: India
Updated score page - http://logicmastersindia.com/M201109P/score.asp

skywalker > Janka1 > spelvin
ByronosaurusRex > S_Aoki > onigame

Also,
Para > tarotaro > ppeetteerr

Players with same scores but less than 14 puzzles correct are sorted by "Last Correct Submission" irrespective of "Claim Bonus Time"
debmohanty
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 9:50 AM (#5527 - in reply to #5522) (#5527) Top



1000500100100100202020
Location: India
motris - 2011-09-05 8:18 AM

spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.

It was not necessarily a typo, but was a misunderstanding of answer key. It was debatable whether it should be 100% or 80%. We had same problems in JPL as well (even though the authors had done a splendid job of explaining using an image)

In fact we had players who entered row A using one method, and row B using another method. So clearly, it is not a good answer key.

We should be using Method 4 described here for loop puzzles.
Valezius
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 11:24 AM (#5529 - in reply to #5455) (#5529) Top


WPMM Author

Posts: 66
202020
Location: Hungary
I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.
debmohanty
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 11:41 AM (#5530 - in reply to #5529) (#5530) Top



1000500100100100202020
Location: India
kiwijam - 2011-09-04 6:53 AM

Will the Hall of Fame entries be based on how much better than the Target Time you achieved?
Sure we want to know who was fastest overall, but the same names are always seen on the podium.
Here is a rare chance for the normal puzzlers to achieve a small amount of glory! :)


Valezius - 2011-09-05 11:24 AM

I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.


We had planned the Sprint test such that a 'lot' of players should be able to complete the whole set. That also meant top players will be completing the set much earlier. That is when we thought of adding a 'target time' for each player based on LMI ratings.

While giving bonus points based on 'target — achieved' certainly came across my mind, it was not done primarily because of reasons below.
1) There was no scientific / logical way to compute the target time. Rakesh had an interesting idea, but we stuck to a simple linear formula.
2) There are several new players who were playing first time. They didn't have a target time. For example onigame, Nilz
3) There are several players who have started to play at LMI recently (just 1 or 2 tests). Target time for them is clearly not accurate. For example murat, TiiT

In future Sprint Tests, it will be definitely interesting to fine tune target time. But I'm still now sure if we can give some points based on 'target — achieved' because of points 2 and 3 above.

And should there be penalty if target < achieved?
MellowMelon
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 11:59 AM (#5531 - in reply to #5530) (#5531) Top


Fillomino-Fillia 2 Author

100
Location: United States
I am inclined to believe a serious usage of target time will not be worth much if you base it only on ratings (and I have no idea what else to base it on), for the same reason winning Under-X rating sections in chess tournaments is usually a matter of being significantly underrated. Even among players with established ratings, they can be in the process of improving, or others conversely may be a little rusty if they took a brief break from these tests. Either way their rating would not be the best reflection of their skill level.

To me the current system, where the target time is a recommendation with no impact on scores or rankings, seems to serve all the intended purposes well enough. One change that couldn't hurt is to have a separate unofficial ranking list with the best performers relative to their target time.
Valezius
Subject: RE: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 12:18 PM (#5532 - in reply to #5530) (#5532) Top


WPMM Author

Posts: 66
202020
Location: Hungary
Naturally, I see the problems with "my" bonus system.
But in this test the target time hadnt function, and I hope it will have in the future :)

I dont have better idea than making an offical and unofficial result.
You can perform on offical list if you have at least 6 non-zero results before the Sprint test. And in this case the target time can be accurate.

I know, I disqualify many solvers, but if the LMI hold a Sprint test in every half year, than this isnt a big problem :)
vopani
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 12:41 PM (#5533 - in reply to #5531) (#5533) Top


WSPC Organizer

Posts: 739
50010010020
Location: India
There will always be players who's rating does not reflect their capability, especially, those who play few tests, or those who are new-comers, like Deb mentioned. So, I would second Palmer's suggestion of having the target time just as a 'benchmark' for players, having no impact on scores. A list of best players relative to their target time would be an interesting read.

Also, regarding the frequency of these tests, it is certainly not feasible to have it once a month. Once a quarter sounds like a good regular event. It helps amateurs gain confidence and motivation throughout the year when there are simpler tests.
forcolin
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 12:42 PM (#5534 - in reply to #5531) (#5534) Top





Posts: 172
100202020
Location: ITALY
I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.

Apart from this, the puzzle set was good (I like particularly the FORTRESS), but in my opinion the puzzles were not exactly "EASY" as defined somewhere (I had a debate with Deb on a different forum). Easier than usual, OK; the contest was solvable in the 75 minutes time, OK, (although my target seemed to me unrealistic, other players of similar level have achieved it), but if the target was to attract new players I believe only a few 5 or 10 points diagrams were simple enough for beginners.

stefano

Edited by rakesh_rai 2011-09-05 2:08 PM
debmohanty
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 12:53 PM (#5535 - in reply to #5534) (#5535) Top



1000500100100100202020
Location: India
forcolin - 2011-09-05 12:42 PM

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
Yet another bug. Updated score page. Melvy gets 225.
rakesh_rai
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 2:08 PM (#5536 - in reply to #5455) (#5536) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
forcolin - 2011-09-05 12:42 PM

...If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?


As far as I understand this, players with 14 correct will be awarded a bonus ONLY IF they have genuinely attempted the fifteenth puzzle also, i.e., it is not a bonus for doing 14 puzzles, but only on submitting 15 puzzles (with one mistake). So by hitting the CLAIM BONUS, you may not immediately gain 6 or 9 points automatically.

However, as you said, the interface is simpler without the extra button.
motris
Subject: Re: Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September @ 2011-09-05 10:41 PM (#5543 - in reply to #5534) (#5543) Top




Posts: 199
10020202020
Location: United States
forcolin - 2011-09-04 11:42 PM

I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
stefano


It doesn't sound to me that the system is broken in your case. You had 6 minutes to earn 45 points and chose to go for them instead of stopping early. (There was also the chance one of your 14 submissions was incorrect so you can not be sure you would even have gotten the 18 points for sure.)

When I've discussed "partial" bonus before, it has been in the context of having a reasonable but incorrect answer on the last puzzle. A blank submission would not count, and the administrators would judge whether to award it on a case-by-case basis. I believe this is the fairest way to do it, to sometimes award some points to early finishers (ie uvo) who made a mistake, but not so many that a solver would really benefit from stopping early and not trying to complete the test.

Having an end test button is also meant to allow someone who finishes early, for example 40 minutes early, to not have to spend the next 40 minutes constantly checking their work before seeing their score. It also exactly matches the WPC round/time bonus methodology of turning in your paper before you start your finish clock. That >90% of players (41 of 45) that could have claimed bonus did suggests the button generally works, particularly since the vast majority of those solvers ran into this situation for the first time.

Your last point is most important though. I agree that "claim bonus" should only affect time bonus points and not the 25 point overall bonus for being complete and correct. I do not recall if the instruction booklet was clear on this point, but I would view someone who took the last ~5 minutes to simply check their work and not turn in to be worth full marks and completion bonus whether here or on a WPC. They simply wouldn't get extra time/rank bonus.
80 posts • Page 2 of 4 • 1 2 3 4
Jump to forum :
Search this forum
Printer friendly version