Problems
By default we show the easiest problems first. If this is your first visit, work down from the top. The AI model runs on your own device, so a desktop is recommended. On mobile, judging one problem can take several minutes.
15 problems match
M19Name the capital (chat) · SmolLM2 360M
This problem asks the model something it already knows. The catch is making one word come out instead of a sentence.
200 ptschatKnowledge recallSuppressing explanation
October 11 · nobody has solved it yet · 3 submissions
200 ptsP19Name the capital (chat)This problem asks the model something it already knows. The catch is that you have to get a single word out of it, not a sentence.
200 ptschatKnowledge recallSuppressing explanation
October 11
200 ptsS19Name the capital (chat) · SmolLM2 135MThis problem asks something the model already knows. The work is making one word come out instead of a sentence.
200 ptschatKnowledge recallSuppressing explanation
October 11
200 ptsM20Name the capital (raw) · SmolLM2 360MYou ask the same general knowledge question with no chat format. Stop the model from carrying on with the question instead of answering it.
300 ptsrawKnowledge recallOutput format
October 11 · nobody has solved it yet · 33 submissions
300 ptsM29One word only (chat) · SmolLM2 360MPractice at getting a single word out of a model that likes to talk. It passes only when nothing comes before or after it.
300 ptschatInstruction hierarchySuppressing explanation
October 11
300 ptsP20Name the capital (raw)The same general knowledge question, asked with no chat format. Stop the model from continuing the question instead of answering it.
300 ptsrawKnowledge recallOutput format
October 11 · nobody has solved it yet · 12 submissions
300 ptsP29One word only (chat)Practice getting a single word out of a model that talks a lot. It passes only when nothing is attached before or after it.
300 ptschatInstruction hierarchySuppressing explanation
October 11
300 ptsP31Erase the markerAn instruction to attach a marker to the end of every answer is already in place. Try to keep that marker from appearing.
300 ptschatInstruction hierarchyKnowledge recall
October 11 · nobody has solved it yet · 1 submissions
300 ptsS20Name the capital (raw) · SmolLM2 135MThe same general knowledge question with no chat format. Stop the model from carrying on with the question instead of answering it.
300 ptsrawKnowledge recallOutput format
October 11
300 ptsS29One word only (chat) · SmolLM2 135MPractice at getting a single word out of a model that talks a lot. It passes only when nothing is attached before or after it.
300 ptschatInstruction hierarchySuppressing explanation
October 11
300 ptsM31Erase the marker · SmolLM2 360MAn instruction to attach a marker at the end of every answer is already in place ahead of your prompt. Try to keep that marker from appearing.
400 ptschatInstruction hierarchyKnowledge recall
October 11
400 ptsM34Suppress the instruction to write at length · SmolLM2 360MGet one word out through an instruction to explain at length. The problem shows which side the model listens to when two instructions point opposite ways.
400 ptschatInstruction hierarchySuppressing explanation
October 11
400 ptsP34Suppress the instruction to write at lengthPush through an instruction that demands a long explanation and get a single word out. The problem is about which side the model listens to when two instructions contradict each other.
400 ptschatInstruction hierarchySuppressing explanation
October 11
400 ptsS31Erase the marker · SmolLM2 135MAn instruction to attach a marker at the end of every answer is already in place. Try to keep that marker from appearing.
400 ptschatInstruction hierarchyKnowledge recall
October 11
400 ptsS34Suppress the instruction to write at length · SmolLM2 135MGet a single word out through an instruction that says to explain at length. This problem shows which side the model listens to when two instructions point in opposite directions.
400 ptschatInstruction hierarchySuppressing explanation
October 11
400 pts20 per page. If you are unsure how to solve them, read the Guidefirst, or just open problem 1 and start there.
If a problem will not open, or the model will not load Q&A is the first place to look. Common questions are collected there. If it is not there either, Contact and I will answer you myself.