Tapa Train - 25th Dec to 14th Jan | |
Reply LMI Tests -> Daily Puzzles Contest | 34 posts • Page 1 of 2 • 1 2 |
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | Announcements
| ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | AnnouncementsThank you everyone for their participation and making this contest a successfull run. It was first of its kind and many more to come. Thanks for all the feedback and you may have noticed that we constantly kept improving the overall interface. Congratulations to the winners.
There are some fascinating stats to observe. You can checkout full details here but I will highlight few:
Continue reading to the next post if you want to learn about the planning and thoughts for the contest. | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India |
BackgroundIt all started in Nov 2020. I wanted to revive the traditional Classic Tapa Contest that was held in the past on the Logic Masters India (LMI) and the one that I enjoyed a lot. In that regard, I started creating the puzzles and almost created around 30 Tapa's of various sizes. Unfortunately, it was the same time when browsers no longer supported Adobe FLASH. The classic tapa contest interface was using FLASH and hence no longer working. The puzzles I built were lying in the dust, and I had to patiently wait until we figured out some alternative solution for it. Fortunately, in 2021 I took Penpa+ development a bit more seriously and dedicated a lot of my time. This gave us the idea to utilize the Interface to introduce again/enable online solving on the LMI website. Thanks to Deb for his remarkable effort and time to integrate Penpa+ into the LMI server. You may have noticed constant improvements and developments. Initially, we started with contests by providing Penpa solvable links and then integrated them fully into LMI. With an online solving set up for the regular contests, it was time to think about the classic tapa contest and bring it to life. After many discussions between Deb, Prasanna, and myself, we came up with a Daily Puzzle Series Idea that will incorporate different puzzle genre runs. Finally, in November, the development towards this goal started, and we were ready to launch during Christmas. Also thanks to Deb for testing all the puzzles and providing great feedback. I will now share the thoughts behind the contest structure and content.Tapa Train thoughts/highlights:
Improvements: With all that said, there are some areas of improvement
Final thoughts:
| ||
IHNN |
| ||
Typed Logic Author Posts: 21 Location: United States | I've voiced my thoughts in a couple of other places, and think that the scoring method is the biggest flaw. I'll go into a bit more shortly, but I want to highlight the things I really liked about this series. Having replays, even if I didn't watch many, is a phenomenal addition that I'd love to see expanded- perhaps the solver could annotate certain moves or the actual times of inputs could also be logged to see where thinking times were? The puzzles themselves were generally very nice across the board showing a lot of variety in the genre, though I think there could have been another easy puzzle and another hard puzzle- there were a lot of middle difficulty ones (and to keep 16, two of these could have been saved for elsewhere). The comments area probably didn't need emoji as it made most of the comments a single emoji- dividing this into "reacts" and "comments" may work better for actually capturing comments? The system being in place is a huge plus though, and most of these are minor opinion based things. As an aside, I would definitely appreciate if there were 2 puzzles open at once instead of just 1, giving a longer period- even for 1 puzzle it's not always easy to fit it in. What I think is less of an opinion is the scoring system. I do not like going purely by placement but acknowledge it's the simplest way to aggregate results with different amounts of finishers. Expanding the scoring to more solvers, or perhaps having 51st and 52nd get 50 points, 53rd and 54th 49 and so on (or a similar adjustment) may help include more solvers who may have finished near the bottom on most solves. For a first run, top 100 makes sense as I expect the volume of people participating far exceeded what was expected- a great problem to be having! Even more egregious though is inconsistent penalties. A flat rate just doesn't work with this format, as 2 minutes on smaller or shorter puzzles could easily be 100 placements, while on the larger ones a penalty cost maybe a dozen placements or less. This ends up putting a much greater weight on the smaller and easier puzzles, which is backwards from what's typical. I firmly believe that going forwards, penalties should be based on either a percentage of your own time being added to it (perhaps plus a small flat amount to discourage guessing further) or based on the performance of others- as an arbitrary example, 25% of the 25th fastest error free time on a puzzle. Scoring is, of course, only relevant to the competitive aspects. The community aspects, the general format, the technical side of getting this to work and the puzzles themselves are all on point already I think. Looking forward to the future of these for sure. | ||
Realshaggy |
| ||
Posts: 69 Location: Germany | Great contest with great puzzles! I can't say much about the scoring system since I didn't thought about it since it was pretty clear that I will probably never get any points. Just two small remarks: 1.) Forcing feedback is always bad in my opinion. Especially in the exact moment after you finished the puzzle and want to see the results you get forced to press some emoji or whatever. You can bypass it, but for me it still feels annoying and the quality of feedback you get that way is questionable at best. 2.) The star system for quality feedback is also not good in my opinion, since a lot of popular sites use a 1-5 stars rating for difficulty (e.g. GMpuzzles and the LMG portal). Oh and I'd love to see replay in real-time added. Edited by Realshaggy 2022-01-14 5:03 PM | ||
Nola |
| ||
Posts: 18 Location: Germany | Thank you for a very nice series of wonderful Tapas. All could be solved purely by logic and I liked them a lot. | ||
ropeko |
| ||
Posts: 11 Location: Switzerland | That was a great contest with beautiful Tapas! Thank you! And the contest was very well doable just with the mobile phone, even the 20x20 puzzle. In future it would be great, if there is more time to solve the puzzles, i.e. every 30h a new puzzle but the puzzle counts during the next 5 days, since not everybody has time to solve them on a daily basis. As IHNN already mentioned, the scoring A for 1-100 rank is in my opinion suboptimal, because, luckily, of the high number of participants. It would motivate more if each participant get some points and not only the best solvers. The replay button is a great feature to learn from the top solvers or just to see the different approaches. I‘m looking forward for the next puzzle types :)! | ||
Administrator |
| ||
Location: India | IHNN - 2022-01-14 8:50 AM I've voiced my thoughts in a couple of other places, and think that the scoring method is the biggest flaw. I'll go into a bit more shortly, but I want to highlight the things I really liked about this series. Having replays, even if I didn't watch many, is a phenomenal addition that I'd love to see expanded- perhaps the solver could annotate certain moves or the actual times of inputs could also be logged to see where thinking times were? The puzzles themselves were generally very nice across the board showing a lot of variety in the genre, though I think there could have been another easy puzzle and another hard puzzle- there were a lot of middle difficulty ones (and to keep 16, two of these could have been saved for elsewhere). The comments area probably didn't need emoji as it made most of the comments a single emoji- dividing this into "reacts" and "comments" may work better for actually capturing comments? The system being in place is a huge plus though, and most of these are minor opinion based things. As an aside, I would definitely appreciate if there were 2 puzzles open at once instead of just 1, giving a longer period- even for 1 puzzle it's not always easy to fit it in. What I think is less of an opinion is the scoring system. I do not like going purely by placement but acknowledge it's the simplest way to aggregate results with different amounts of finishers. Expanding the scoring to more solvers, or perhaps having 51st and 52nd get 50 points, 53rd and 54th 49 and so on (or a similar adjustment) may help include more solvers who may have finished near the bottom on most solves. For a first run, top 100 makes sense as I expect the volume of people participating far exceeded what was expected- a great problem to be having! Even more egregious though is inconsistent penalties. A flat rate just doesn't work with this format, as 2 minutes on smaller or shorter puzzles could easily be 100 placements, while on the larger ones a penalty cost maybe a dozen placements or less. This ends up putting a much greater weight on the smaller and easier puzzles, which is backwards from what's typical. I firmly believe that going forwards, penalties should be based on either a percentage of your own time being added to it (perhaps plus a small flat amount to discourage guessing further) or based on the performance of others- as an arbitrary example, 25% of the 25th fastest error free time on a puzzle. Scoring is, of course, only relevant to the competitive aspects. The community aspects, the general format, the technical side of getting this to work and the puzzles themselves are all on point already I think. Looking forward to the future of these for sure. Thank you for your detailed thoughts. Some general responses here. - The scoring system will not change as of now because we value the simplicity of it where anyone can simply look at it and understand what's going on immediately. This helps the casual solvers as well to have a good idea of where they place and why, and on balance we want to prioritize that. Having 51st and 52nd get 50 and so on seems interesting though. We will definitely think about that. - We are definitely going to improve the penalty system. We will be implementing something similar to the Instant Grading in other LMI contests, but with increments in percentage of time increased per wrong submission. We will release more details when the next series is promoted here. - We are looking at ways to categorize the feedback better in general. | ||
Administrator |
| ||
Location: India | Realshaggy - 2022-01-14 4:57 PM Great contest with great puzzles! I can't say much about the scoring system since I didn't thought about it since it was pretty clear that I will probably never get any points. Just two small remarks: 1.) Forcing feedback is always bad in my opinion. Especially in the exact moment after you finished the puzzle and want to see the results you get forced to press some emoji or whatever. You can bypass it, but for me it still feels annoying and the quality of feedback you get that way is questionable at best. 2.) The star system for quality feedback is also not good in my opinion, since a lot of popular sites use a 1-5 stars rating for difficulty (e.g. GMpuzzles and the LMG portal). Oh and I'd love to see replay in real-time added. Thank you for your kind words and feedback. Regarding forcing feedback, as you said it can be bypassed pretty easily. We think from the perspective of authors that it is worth keeping it this way, even if the quality isn't the best, because people providing their puzzles freely generally like to see feedback and a possibility to engage with the solvers. We would rather appeal to solvers to use the feedback system productively with this in mind. This stance can change if more people feel the feedback system needs changes. We will be changing the star system to make things clearer. We are discussing/looking into the possibility and implementation of real-time replays. | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | ropeko - 2022-01-16 6:18 PMThat was a great contest with beautiful Tapas! Thank you!And the contest was very well doable just with the mobile phone, even the 20x20 puzzle.In future it would be great, if there is more time to solve the puzzles, i.e. every 30h a new puzzle but the puzzle counts during the next 5 days, since not everybody has time to solve them on a daily basis.As IHNN already mentioned, the scoring A for 1-100 rank is in my opinion suboptimal, because, luckily, of the high number of participants. It would motivate more if each participant get some points and not only the best solvers.The replay button is a great feature to learn from the top solvers or just to see the different approaches.I‘m looking forward for the next puzzle types :)! Thank you for your feedback. I am glad you enjoyed the ride. -- We already have regular contests which last for 5 days or a week and we wanted a different flavor of the contest with this. Said that we will consider this suggestion and have an internal discussion if any changes are needed. -- Each participant does get some points, that is what B is for. B is the puzzle points on solving the puzzle successfully and is not dependent on your ranking. Do note that your total points is equal to A+B. | ||
tluo5458 |
| ||
Posts: 1 Location: United States | I+seem+to+be+experiencing+some+technical+difficulties+%2D+whenever+I+click+%22Check+Solution%22%2C er+I+click+%22Check+Solution%22%2C+even+though+my+solutions+%28for+the+trial+tapas+and+the+ or+the+trial+tapas+and+the+first+actual+tapa%29+are+pretty+clearly+correct%2C+it+says+it%2 43;clearly+correct%2C+it+says+it%27s+incorrect%2E | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | %5BQUOTE%5Dtluo5458+%2D+2022%2D01%2D29++4%3A15+AM%0D%0A%0D%0AI+seem+to+be+experiencing+some+technical+difficulties+%2D+whenever+I+click+%22Check+Solut l+difficulties+%2D+whenever+I+click+%22Check+Solution%22%2C+even+though+my+solutions+%28for+the+trial+tapas+and+the+first+actual+tapa%29+are+pretty+cl l+tapas+and+the+first+actual+tapa%29+are+pretty+clearly+correct%2C+it+says+it%27s+incorrect%2E%5B%2FQUOTE%5D%0D%0A%0D%0AThank+you+for+reporting%2E+We+ QUOTE%5D%0D%0A%0D%0AThank+you+for+reporting%2E+We+have+fixed+the+issue+and+hopefully+it%27s+working+as+intended%2E+sorry+for+the+inconvenience%2E+Enjo as+intended%2E+sorry+for+the+inconvenience%2E+Enjoy+the+Tapa+ride%2E | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | Solve video for 20x20 by Ashish Kumar - https://www.youtube.com/watch?v=_4ukAng4874 | ||
theodoresan |
| ||
Posts: 1 Location: United States | Thanks%21+%F0%9F%91%8D%F0%9F%91%8D%F0%9F%91%8D | ||
Nizz |
| ||
Posts: 12 Location: Denmark | I know the contest is long over, but I am getting "Wrong solution" for several of my correct solutions. It seems this happens whenever I submit a wrong solution first - all subsequent submissions are then deemed wrong. This is still the case even if restarting from scratch ("delete all"). | ||
Administrator |
| ||
Location: India | Nizz - 2022-05-07 11:25 AM We are still trying to debug this issue and have not found anything missing at our end. I know the contest is long over, but I am getting "Wrong solution" for several of my correct solutions. It seems this happens whenever I submit a wrong solution first - all subsequent submissions are then deemed wrong. This is still the case even if restarting from scratch ("delete all"). Lets take one specific puzzle for example : Tapa 13 Can you submit the puzzle again and after you get the "Wrong Solution" message, can you please share a screenshot of your solved grid? | ||
david.g.niccolai@gma |
| ||
Posts: 1 Location: United States | I'm getting a similar error. I had it happen with Tapa 2, though I don't think I submitted a wrong solution unless I did so by accident. (Tapa2.png) Attachments ---------------- Tapa2.png (85KB - 1 downloads) | ||
Kahin1008 |
| ||
Posts: 1 Location: Turkey | I think this is the correct solution. | ||
Nizz |
| ||
Posts: 12 Location: Denmark | Administrator - 2022-05-10 1:18 AM Nizz - 2022-05-07 11:25 AM We are still trying to debug this issue and have not found anything missing at our end. I know the contest is long over, but I am getting "Wrong solution" for several of my correct solutions. It seems this happens whenever I submit a wrong solution first - all subsequent submissions are then deemed wrong. This is still the case even if restarting from scratch ("delete all"). Lets take one specific puzzle for example : Tapa 13 Can you submit the puzzle again and after you get the "Wrong Solution" message, can you please share a screenshot of your solved grid? Tapa 13 was a bad choice for this. I don't know if you chose that becase it was unfinished on my account, but it turns out my solution was indeed wrong, and after correcting it the submission went through. Tapa 2 on the other hand, I have checked and double checked. See attached screenshot (tapa2.png) Attachments ---------------- tapa2.png (53KB - 0 downloads) | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | Thanks for sharing. As per our current knowledge and based on others feedback, Tapa 2 is the only one giving trouble with answer verification. Rest all puzzles are working as intended. We haven't yet identified why this is happening with only Tapa 2. We did verify the solution string again but something else is going on apparently. We are still investigating. But otherwise I hope you enjoyed all the puzzles and the contest. | ||
Nizz |
| ||
Posts: 12 Location: Denmark | The same happens for Tapa 6 as well. Probably 7, 9, 14 and 15 as well, though I haven't checked them recently (tapa6.png) Attachments ---------------- tapa6.png (66KB - 0 downloads) | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | I did all of them again. You are right. Currently five puzzles are having troubles. Puzzle No 2, 6, 7, 14, 15. Hopefully we can figure out why. | ||
SharveSu |
| ||
Posts: 1 Location: India | I am a beginner and wants to solve sudoku | ||
swaroop2011 |
| ||
PR 2020 (Shading and Loops) Author Posts: 668 Location: India | AnnouncementsTapa solution check issue faced for few puzzles is now fixed. Thank you for your patience. | ||
Reply | 34 posts • Page 1 of 2 • 1 2 |
Search this forum Printer friendly version |