The model arena
Found this helpful? Share it:
Found this helpful? Share it:
The arena shows you two answers to the same task without telling you which model produced either one. You pick the better answer, and only then do the names appear. The point is to judge the work, not the label.
You do not have to pick. If the two are too close to call, choose Tie and the pair counts as a draw for both models. If you cannot judge the task at all, choose Skip: your answer is recorded, it counts as activity, and it moves no rating. A forced choice between two answers you cannot separate is not evidence, and the arena would rather have your honest draw than a coin flip.
The arena votes in four lanes: text, image, video and audio. Each lane has its own ranking, because a preference between two images says nothing about a preference between two paragraphs. Open the lane you want from the tabs above the pair, and set a default lane in your preferences if you mostly judge one kind of work.
Every vote you cast builds your own board: a ranking of the models you have compared, in the lane you compared them. It is yours, it is not the public leaderboard, and it is not a claim about which model is best. You can share it or keep it private, and the switch is per lane.
The public leaderboard is built from everyone's weighted votes, one board per plan class, so a burst of votes in one class cannot reorder another. Raw vote counts are never published, and votes are screened for coordination before they reach a rating.
Looking for the benchmark tables instead? They live at /rankings/benchmarks. The arena ranking answers "which model did people prefer on this kind of work", and a benchmark answers "which model scored higher on this test". They are different questions and they are kept apart on purpose.
The arena lives at /arena on the public site, and at /app/arena inside the app. You can start without an account: a guest gets five votes, and they carry over to your account the first time you sign in and vote.
The arena only serves pairs you have not judged yet. If you see the message that you have judged every pair, it means the pool is being replenished, not that something is broken. Check back shortly, or switch lane: a fresh lane usually has pairs you have not seen.
Was this helpful?