-
Notifications
You must be signed in to change notification settings - Fork 65
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Overhaul Fewest Moves #678
Conversation
- Clean up the structure. - Specify when the competitor may write their name: - Before the attempt. - While turning in a solution, in fron of the judge. - NOT after turning in a solution. - Define an unambiguous, valid solution. - Specify that a competitor should scribble out extra moves. (This is a "should", but placing it in the Regulations will hopefully encourage competitors to do this move consistently, leading to fewer frustrating calls while grading). Note that this does *not* address parentheses in solutions, which will be in a separate PR.
844110d
to
c85462a
Compare
@Laura-O, would you mind reviewing this change? @thewca/wrc-team: this is a pretty substantial overhaul, so I'd appreciate a review from anyone who has input! |
…ns in rotation moves.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A comment and a nitpick, but overall LGTM!
wca-guidelines.md
Outdated
- E2c1++) [EXPLANATION] The competitor is not required to submit a paper with the competition name, round, and/or attempt number, but may wish to do so in order to help the organization team keep track of submitted solutions. | ||
- E2c1+++) [ADDITION] If a judge finds a solution without a information to identify the attempt after the competitor has finished submitting it (e.g. while grading the attempt), they should find out the competitor who wrote the solution in order to assign them a DNF (rather than DNS). Note that the competitor must not be allowed to write information to identify the attempt at this point, so they must receive a DNF result. | ||
- E2c2+) [EXAMPLE] Examples that are not considered a single unambiguous move sequence: multiple solution sequences without exactly one clearly indicated solution, a solution with ambiguous symbols (e.g. a letter that looks similar to "B" and "R" but is not clearly one or the other), a solution with stars or long arrows indicating moves to be performed out of written order (e.g. "insertions" that are not written in-line with the rest of the move sequence, "pre-moves" that are not incorporated into the move sequence using valid notation), a move sequence that is not written out roughly as a series of lines in reading order, any arrangement of symbols that cannot be interpreted as an unambiguous move sequence. Exceptions to the examples above: small typographic corrections (e.g. blacking out a move and writing a move above that is clearly meant to replace it, moves written in subscript or superscript to fit between other moves). | ||
- E2c2++) [ADDITION] If a competitor with little 3x3x3 Fewest Moves experience uses the incorrect type of brackets/parentheses to write a rotation, the judge may interpret the competitor's intention as the correct brackets (and the competitor should be informed), at the discretion of the Delegate. Example: {r}, <r>, or (r) may be interpreted as [r]. Note that only the bracket type may reinterpreted this way, and notation such as or [R], [r u], or [r]2 is still considered invalid (see [Guideline E2c4+](guidelines:guideline:E2c4+)). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- E2c2++) [ADDITION] If a competitor with little 3x3x3 Fewest Moves experience uses the incorrect type of brackets/parentheses to write a rotation, the judge may interpret the competitor's intention as the correct brackets (and the competitor should be informed), at the discretion of the Delegate. Example: {r}, <r>, or (r) may be interpreted as [r]. Note that only the bracket type may reinterpreted this way, and notation such as or [R], [r u], or [r]2 is still considered invalid (see [Guideline E2c4+](guidelines:guideline:E2c4+)). | |
- E2c2++) [ADDITION] If a competitor with little 3x3x3 Fewest Moves experience uses the incorrect type of brackets/parentheses to write a rotation, the judge may interpret the competitor's intention as the correct brackets (and the competitor should be informed), at the discretion of the WCA Delegate. Example: {r}, <r>, or (r) may be interpreted as [r]. Note that only the bracket type may reinterpreted this way, and notation such as or [R], [r u], or [r]2 is still considered invalid (see [Guideline E2c4+](guidelines:guideline:E2c4+)). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also, that's quite unclear: what is little experience?
I would suggest to either remove it completely (i.e. allow it for all competitors) or using the same term as in A7g (caused by a new competitor's inexperience
).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'd really like to avoid implying that it's okay to use invalid notation.
I've changed this to "due to inexperience".
wca-guidelines.md
Outdated
- E2c1++) [EXPLANATION] The competitor is not required to submit a paper with the competition name, round, and/or attempt number, but may wish to do so in order to help the organization team keep track of submitted solutions. | ||
- E2c1+++) [ADDITION] If a judge finds a solution without a information to identify the attempt after the competitor has finished submitting it (e.g. while grading the attempt), they should find out the competitor who wrote the solution in order to assign them a DNF (rather than DNS). Note that the competitor must not be allowed to write information to identify the attempt at this point, so they must receive a DNF result. | ||
- E2c2+) [EXAMPLE] Examples that are not considered a single unambiguous move sequence: multiple solution sequences without exactly one clearly indicated solution, a solution with ambiguous symbols (e.g. a letter that looks similar to "B" and "R" but is not clearly one or the other), a solution with stars or long arrows indicating moves to be performed out of written order (e.g. "insertions" that are not written in-line with the rest of the move sequence, "pre-moves" that are not incorporated into the move sequence using valid notation), a move sequence that is not written out roughly as a series of lines in reading order, any arrangement of symbols that cannot be interpreted as an unambiguous move sequence. Exceptions to the examples above: small typographic corrections (e.g. blacking out a move and writing a move above that is clearly meant to replace it, moves written in subscript or superscript to fit between other moves). | ||
- E2c2++) [ADDITION] If a competitor with little 3x3x3 Fewest Moves experience uses the incorrect type of brackets/parentheses to write a rotation, the judge may interpret the competitor's intention as the correct brackets (and the competitor should be informed), at the discretion of the Delegate. Example: {r}, <r>, or (r) may be interpreted as [r]. Note that only the bracket type may reinterpreted this way, and notation such as or [R], [r u], or [r]2 is still considered invalid (see [Guideline E2c4+](guidelines:guideline:E2c4+)). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also, that's quite unclear: what is little experience?
I would suggest to either remove it completely (i.e. allow it for all competitors) or using the same term as in A7g (caused by a new competitor's inexperience
).
@Laura-O, could you review again? :-D |
- E2b) All competitors have a total time limit of 60 minutes to find and write a solution. | ||
- E2b1) The judge should call "5 MINUTES REMAINING" at 55 minutes, and must call "STOP" at 60 minutes. | ||
- E2c) At 60 minutes, each competitor must submit to the judge a single piece of paper with the competitor's written name (optionally accompanied by WCA ID) and solution, using the notation for the 3x3x3 Cube described in [Regulation 12a](regulations:regulation:12a). Penalty: disqualification of the attempt (DNF). | ||
- E2c) At 60 minutes, each competitor must submit to the judge a single piece of paper with a written solution and information to identify the attempt. | ||
- E2c1) Information to identify the attempt is: the competitor's name or WCA ID (at least one, optionally both), and optionally the competition name, round, and/or attempt number. Penalty for a submitted solution without a name or WCA ID: disqualification of the attempt (DNF). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Technically, "name" is quite ambiguous. Surely, we cannot require the exact WCA names (local names, Brazilians, etc.). Out of curiosity, which of the following "names" would you consider valid for myself: "S. Auroux", "Sébastien A.", "Sébastien", "Séb".
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think specifying this not particularly useful. A competitor who wants to get a valid result will write a sufficiently clear name, and I don't see this as a useful avenue for cheating. Open to suggestions, though!
I'm a little lost regarding writing identity information while turning in a solution, in front of the judge. Unless I am missing something, this is currently no longer included/planned? |
Looks like I lost E2c1+ somewhere in one of the draft commits; thanks for noticing. 😳 I've added it back. |
[perhaps this isn't the place?] I'm not particularly crazy about how we allow movements that are not listed like Rw. Explaining notations seems way too unnecessary. I think we should give some examples: F, F2, F', Fw, but imo there's no reason to list all the 18 face moves and all 18 cube rotations. Just to remember, if the change on regs lead to change on layout, we perhaps need to call for translations, which currently has 23 different languages. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[perhaps this isn't the place?] I'm not particularly crazy about how we allow movements that are not listed like Rw. Explaining notations seems way too unnecessary. I think we should give some examples: F, F2, F', Fw, but imo there's no reason to list all the 18 face moves and all 18 cube rotations.
I think I agree with you, but I'm not sure what you are saying. Are you asking for anything to change in/based on this PR?
- E2b) All competitors have a total time limit of 60 minutes to find and write a solution. | ||
- E2b1) The judge should call "5 MINUTES REMAINING" at 55 minutes, and must call "STOP" at 60 minutes. | ||
- E2c) At 60 minutes, each competitor must submit to the judge a single piece of paper with the competitor's written name (optionally accompanied by WCA ID) and solution, using the notation for the 3x3x3 Cube described in [Regulation 12a](regulations:regulation:12a). Penalty: disqualification of the attempt (DNF). | ||
- E2c) At 60 minutes, each competitor must submit to the judge a single piece of paper with a written solution and information to identify the attempt. | ||
- E2c1) Information to identify the attempt is: the competitor's name or WCA ID (at least one, optionally both), and optionally the competition name, round, and/or attempt number. Penalty for a submitted solution without a name or WCA ID: disqualification of the attempt (DNF). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think specifying this not particularly useful. A competitor who wants to get a valid result will write a sufficiently clear name, and I don't see this as a useful avenue for cheating. Open to suggestions, though!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- I don't think E2a1 is necessary - that kind of is just what you'd do regardless of this reg in place or not?
- E2c1+++ - I think if they are able to find out who did the attempt, it shouldn't be DNFed so I'm not for this change
- E3c4+ I would like to see this added somewhere on an FMC sheet if possible - letting everyone know what moves aren't allowed - this would take up a significant amount of space so I understand this might not be the best idea :/
- E2c+) [CLARIFICATION] Although the judge may provide a standard sheet for competitors to submit solutions, a competitor may submit a solution on a different piece of paper. (Note that the piece of paper must come from the judge, according to [Regulation E3a](regulations:regulation:E3a).) | ||
- E2c1+) [ADDITION] If the competitor forgot to write information to identify the attempt on their intended solution paper before the time limit, they are permitted to add it in front of a judge. In this case, the competitor must ask the judge while submitting their solution and then immediately write information to identify the attempt (and make no other changes) under direct supervision of the judge. Once a competitor has finished submitting their solution (e.g. placing it in the judge's hands and allowing the judge to move on to the next competitor, placing it on the judge's table and walking away), they are not permitted to add any information. If the competitor writes anything after the time limit but before asking the judge, the attempt remains disqualified (DNF). | ||
- E2c1++) [EXPLANATION] The competitor is not required to submit a paper with the competition name, round, and/or attempt number, but may wish to do so in order to help the organization team keep track of submitted solutions. | ||
- E2c1+++) [ADDITION] If a judge finds a submitted solution without information to identify the attempt (e.g. while grading the attempt), they should find out the competitor who wrote the solution in order to assign them a DNF (rather than DNS). Note that the competitor must not be allowed to write information to identify the attempt at this point, so they must receive a DNF result. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
E2c1+++ - I think if they are able to find out who did the attempt, it shouldn't be DNFed so I'm not for this change
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we need to be explicit about what is allowed to avoid inconsistent rulings from Delegates. The incidents from this year suggest that not every Delegate is on the same page about this right now.
@AlbertoPdRF, would you be in favor of allowing the result to count at the discretion of the Delegate?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If you can find out who did the attempt, you know who did the attempt, you have their attempt - it shouldn't be a DNF. That's just being way too strict and I think it's unnecessary to be that strict in FMC
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmm, I just double-check and we had a unanimous WRC consensus for "Can be added in front of judge while submitting" (as opposed to the explicit alternative "Can be added until the end of the competition"): #655 (comment)
Would you be alright sticking with that, or is it possible some of us didn't take into account this case while voting?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'd want it clarified that if the delegate can determine whose attempt it was to put the DNF in, why not put in the time? I guess when voting I completely overlooked that option. It just doesn't make any sense to me that if fit can be determined who did the attempt, that it gets entered as a DNF. If someone leaves and they can't confirm with the competitor that it is indeed their attempt, then sure, DNF the attempt, but if you can confirm it was there, I think it should be added.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Allowing this at the discretion of the WCA Delagate shouldn't be an option in my opinion, as we would still have the same inconsistent rulings.
My goal after the draft Regs are out are to work on guides, one of which would be a page with FMC grading instructions. I don't think we can fit it on the FMC sheet, but my hope is that competitors can be aware of the grading sheet and look at it if they want to be careful. |
Sorry, completely missed that this is still open. |
Thanks! |
This has been dangling for a while, and there are at least 3 additional changes I want to consider. In order to avoid complicating this, I'm going to dismiss @kingmathyall's review on this PR and make separate PRs for easier review for those parts. |
Could clarification be given on if people are allowed to write insertion stickers ahead of time? It gives a potential way to cheat by writing out algorithms or (in the worst case scenario) someone could have gotten the scramble ahead of time and written the solution out on stickers. I could see a solution to this problem being delegates have to check beforehand, but in a large scale competition that doesn't seem viable. |
#584 covers this. Unless we want to enforce draconian measures around the world, we need to trust competitors quite a bit for FMC. If you have any suggestions for how to restrict this, feel free to comment there. |
"should", but placing it in the Regulations will hopefully encourage
competitors to do this move consistently, leading to fewer frustrating calls
while grading).
{r}
,<r>
, or(r)
as[r]
for inexperienced competitors. (E2c2++)