Login Register WSPC 2017 • Schedule • Participation • Location • WSC • WPC • Contact •Search •Recent





Sticky LMI Players' Rating System
   LMI Tests -> Monthly Sudoku and Puzzle Tests270 posts • Page 6 of 11 • 1 2 3 4 5 6 7 8 9 10 11
motris
Subject: Re: LMI Players' Rating System @ 2011-08-03 12:53 AM (#5325 - in reply to #1357) (#5325) Top




Posts: 199
10020202020
Location: United States
For the goals of keeping a consistent rating, can I make a request that test authors keep control of the base scoring of tests (and twists like Puzzle Jackpot and Twist and such are ok as this is the base value), but that LMI admins set the value of time bonus (which is really just serving a role of standardizing scores from month to month) with a fixed standard for all tests? When set by authors, we get such a wide wide range of these values which are really problematic for comparing tests. The upcoming sudoku test has a 3x value for time bonus compared to puzzle minutes, so finishers will benefit excessively. Past tests have had closer to 0x value for time bonus compared to puzzle minutes, so finishers are punished excessively. Is total value/total time that hard a ratio to fix? Time bonus will never affect the ranks in a given test (which is why 1000 points a minute or .0001 points a minute could be chosen by test authors if they wanted) but it does affect the yearly rankings which is why it should not be a variable in the constructor's mind at all.
debmohanty
Subject: Re: LMI Players' Rating System @ 2011-08-03 4:49 AM (#5326 - in reply to #5325) (#5326) Top



1000500100100100202020
Location: India
Very valid argument, we will do that.

For Sudoku City, Nikola had asked me to review the bonus system, but I had missed it completely. I'll get it rectified. Thanks for bringing it up. And it indeed helps when the anomalies are brought up before the test itself, so that we can get it fixed as needed.
rakesh_rai
Subject: RE: LMI Players' Rating System @ 2011-08-03 12:52 PM (#5328 - in reply to #5310) (#5328) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
motris - 2011-08-01 11:31 PM

I think a consistent rating needs to be fair for solvers at the top and in the middle. The top is suited ok with the system as is with absolute top score contributing a lot more than rank score, rewarding a very good performance. The middle is suited ok by using the median score as the measure of 500, instead of actual score/top score which is where the median might drop to 300 or 400 on an exceptional test day. And the rank score further brings back the front-runner a bit and also separates ties by score (but not time) in the middle.

I think drastic changes from the current formula will result in a worse ranking system either for the top, or for the middle, based on the test data we have for the last 15 months. At most, I might like to see modeled what would happen if a third inflection point was built into the system, perhaps at the 1st standard deviation above and below the median, equaling another set of fixed score points. My guess is that the middle and top are stable but players at 70-85% in rank are more affected by test to test variation outside of their own performance.
Very nicely put.

Just one question: when you say 70-85% in rank, do you mean those ranked 71st-85th (out of 100) or those ranked 15th-30th? And, I would also like to know the degree (slightly/moderately/heavily) to which they are affected, so that we can think of further improvements at some point of time.
motris
Subject: RE: LMI Players' Rating System @ 2011-08-04 10:53 AM (#5336 - in reply to #5328) (#5336) Top




Posts: 199
10020202020
Location: United States
rakesh_rai - 2011-08-02 11:52 PM

motris - 2011-08-01 11:31 PM

I think a consistent rating needs to be fair for solvers at the top and in the middle. The top is suited ok with the system as is with absolute top score contributing a lot more than rank score, rewarding a very good performance. The middle is suited ok by using the median score as the measure of 500, instead of actual score/top score which is where the median might drop to 300 or 400 on an exceptional test day. And the rank score further brings back the front-runner a bit and also separates ties by score (but not time) in the middle.

I think drastic changes from the current formula will result in a worse ranking system either for the top, or for the middle, based on the test data we have for the last 15 months. At most, I might like to see modeled what would happen if a third inflection point was built into the system, perhaps at the 1st standard deviation above and below the median, equaling another set of fixed score points. My guess is that the middle and top are stable but players at 70-85% in rank are more affected by test to test variation outside of their own performance.
Very nicely put.

Just one question: when you say 70-85% in rank, do you mean those ranked 71st-85th (out of 100) or those ranked 15th-30th? And, I would also like to know the degree (slightly/moderately/heavily) to which they are affected, so that we can think of further improvements at some point of time.


By 70-85% in rank I meant those with a rank score around 700 to 850. So 15th to 30th place in your out of 100 example.
rakesh_rai
Subject: Updated Sudoku Ratings @ 2011-08-08 7:50 PM (#5371 - in reply to #5316) (#5371) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
Updated LMI Sudoku Ratings after Sudoku City (August 2011 LMI sudoku test) are now available.

The Top five: 1. motris, 2. nikola, 3. purifire, 4. deu, 5. misko

India Top five: 1. Rishi, 2. Rohan, 3. Rakesh, 4. Gaurav, 5. Sumit
rakesh_rai
Subject: Re: LMI Players' Rating System @ 2011-08-24 11:14 AM (#5453 - in reply to #1357) (#5453) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
Updated LMI Puzzle Ratings after Japanese Puzzle Land (August 2011 LMI puzzle test) are now available.

xevs is the only new name in the Top 10.

Rohan Rao at #43 is the top ranked puzzler from India.
anand2100
Subject: LMI rating @ 2011-08-30 11:50 AM (#5488 - in reply to #5244) (#5488) Top




Posts: 1

How to know my LMI rating?
debmohanty
Subject: Re: LMI Players' Rating System @ 2011-08-30 12:14 PM (#5489 - in reply to #5488) (#5489) Top



1000500100100100202020
Location: India
anand2100 - 2011-08-30 11:50 AM

How to know my LMI rating?

Didn't you register at LMI few minutes back?
rakesh_rai
Subject: Re: LMI Players' Rating System @ 2011-09-05 5:51 PM (#5542 - in reply to #1357) (#5542) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
Updated LMI Puzzle Ratings after Sprint Test (September 2011 LMI puzzle test) are now available.

MellowMelon sprints to the third place.
rakesh_rai
Subject: Re: LMI Players' Rating System @ 2011-09-14 5:48 PM (#5631 - in reply to #1357) (#5631) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
Updated LMI Sudoku Ratings after Crazy Arrows (September 2011 LMI sudoku test) are now available.

532 players representing 50 countries are now a part of the ratings. motris and nikola remain #1 and #2 repectively, and deu moved up to #3.

Amongst the heavy gainers, ppeetteerr gained 203 rating points to move to #40, and tarotaro gained 164 rating points to move up to #76.

USA has 6 players in the Top 50, while Japan and India have 5 each. Germany has 4 players in the Top 50.
rakesh_rai
Subject: Re: LMI Players' Rating System @ 2011-10-09 9:08 PM (#5778 - in reply to #5631) (#5778) Top



Mean Minis (2020) Author

Posts: 774
500100100202020
Location: India
Updated LMI Sudoku Ratings after A or B (October 2011 LMI sudoku test) are now available.

motris inched closer to the 1000 mark, gaining one point to reach 993. deu and Nikola exchanged places and are within a point of each other now. jaku111 and uvo, both made major gains to enter the Top 10. Four of the top 10 have palindromic ratings (which read the same whether read from left or right).

TiiT (palindrome again) who finished 2nd in A or B, gained 36 rating points to move to #15. Gotroch has a rating of 888 (which is a flush in poker). Hunsudoku, tarotaro, SCORPPROCS (another palindrome), tilansia and spelvin all gained over 100 points and should be rapidly moving towards the top in the coming months.

Among players from India, Rohan moved to within 2 points of 900 and is ranked 8th now. Prasanna gained 27 points.
debmohanty
Subject: RE: LMI Players' Rating System @ 2011-10-17 10:25 AM (#5818 - in reply to #1357) (#5818) Top



1000500100100100202020
Location: India
Ratings are updated after Double Decathlon - Link
I would wait till Rakesh double checks once and make it official.
debmohanty
Subject: RE: LMI Players' Rating System @ 2011-11-05 8:37 AM (#5917 - in reply to #5818) (#5917) Top



1000500100100100202020
Location: India
Ratings updated after ST#2

No changes in top 5, though all top 5 have 900+ ratings.
vopani
Subject: Re: LMI Players' Rating System @ 2011-11-20 1:13 PM (#5994 - in reply to #1357) (#5994) Top


WSPC Organizer

Posts: 739
50010010020
Location: India
Sudoku
1. 9 out of the top 10 of WSC are active on LMI.
2. The top 6 players of LMI Sudoku Ratings appeared in the WSC 2011 Playoffs.
3. 8 of the top 10 in WSC 2011 are in the top 15 of LMI Sudoku Ratings.

Puzzle
1. All 10 players of WPC playoffs are active on LMI.
2. The top 4 players of LMI Puzzle Ratings appeared in the WPC 2011 Playoffs.
3. 9 of the top 10 in WPC 2011 are in the top 20 of LMI Puzzle Ratings.

Not bad!
debmohanty
Subject: Re: LMI Players' Rating System @ 2011-11-20 1:20 PM (#5995 - in reply to #5994) (#5995) Top



1000500100100100202020
Location: India
Rohan Rao - 2011-11-20 1:13 PM

Not bad!

ditto!
neerajmehrotra
Subject: Re: LMI Players' Rating System @ 2011-11-20 1:54 PM (#5998 - in reply to #1357) (#5998) Top




Posts: 328
10010010020
Location: India
That gives a real good feeling.............
debmohanty
Subject: RE: LMI Players' Rating System @ 2011-11-21 10:19 AM (#6018 - in reply to #1357) (#6018) Top



1000500100100100202020
Location: India
Ratings update after Puzzle Fusion available here

We'll spend some time checking it manually before making this as default ratings.

The most significant change at the top is that MellowMelon moves to #2 position ahead of deu. Also, xevs gained 19 points to have ratings of 919.
debmohanty
Subject: RE: LMI Players' Rating System @ 2011-12-22 12:25 PM (#6238 - in reply to #1357) (#6238) Top



1000500100100100202020
Location: India
Sudoku ratings updated after December Test.

motris continues his dominance and retains the top spot throughout the year.

Edited by debmohanty 2011-12-22 12:58 PM
debmohanty
Subject: RE: LMI Players' Rating System @ 2011-12-27 10:50 AM (#6259 - in reply to #1357) (#6259) Top



1000500100100100202020
Location: India
LMI Puzzle ratings are updated now

No changes in top 3, but MellowMelon inches toward motris.
xevs gains lot of ratings and takes the 4th place now
debmohanty
Subject: RE: LMI Players' Rating System @ 2012-01-30 9:07 AM (#6541 - in reply to #1357) (#6541) Top



1000500100100100202020
Location: India
We have a technical problem, and it will take a while to update the ratings this time (and may be in future as well)
debmohanty
Subject: RE: LMI Players' Rating System @ 2012-01-31 11:03 AM (#6558 - in reply to #1357) (#6558) Top



1000500100100100202020
Location: India
Puzzle Ratings are updated after Marathon. No changes in top 5.
Administrator
Subject: Re: LMI Players' Rating System @ 2012-01-31 12:21 PM (#6559 - in reply to #1357) (#6559) Top


2000100050020
Location: India
Also added Ratings History in profile page.
Administrator
Subject: Re: LMI Players' Rating System @ 2012-03-13 3:45 PM (#6893 - in reply to #1357) (#6893) Top


2000100050020
Location: India
Sudoku Ratings updated after Diagonal Vision

TiiT moves to top5 after impressive performances.

Among players from India, Prasanna moves into top50 after few good tests.
zachpuzzle
Subject: RE: LMI Players' Rating System @ 2012-03-17 7:34 PM (#6947 - in reply to #1357) (#6947) Top




Posts: 14

Location: United States
what does a little orange bar by the name in the rankings mean? I'll send a picture of what i mean



(Those.PNG)



Attachments
----------------
Attachments Those.PNG (3KB - 0 downloads)
Fred76
Subject: Re: LMI Players' Rating System @ 2012-03-17 7:54 PM (#6948 - in reply to #6893) (#6948) Top



Diagonal Vision Author

Posts: 337
10010010020
Location: Switzerland
Administrator - 2012-03-13 3:45 PM

Sudoku Ratings updated after Diagonal Vision

TiiT moves to top5 after impressive performances.

Among players from India, Prasanna moves into top50 after few good tests.


And the author is punished for his too hard grids by losing 3 ranks and being kicked out of the top 20

270 posts • Page 6 of 11 • 1 2 3 4 5 6 7 8 9 10 11
Jump to forum :
Search this forum
Printer friendly version