Skip to main content

HomeAI ModelsPricing

Sign in Start free

Home
Pricing
AI Models
Image models
Voice models
Video models
Rankings
New models
Model status

Multi-Model Chat
Voice Mode
Voice HUD
Web Search
Image Generation
Video Generation
Audio Generation
Transcription
Drive
Secrets
Sharing
Workspaces
Tasks
Memory
Agents
Subagents
Automations
Skills
Code Execution
Computers
Computer Use
Computer Assist · Soon
Cloud Computers
Local AI
AI Gateway
API & SDK
CLI
MCP
Tunnels
All features →

LLM cost calculator
Token counter
Context window checker
Can I run it
Model picker quiz
Savings finder
Video cost estimator
Text to speech cost
Transcription cost
API endpoint tester
All free tools →

Blog
Use cases
Comparisons
Best of
Learn
Prompts
Templates
Changelog
Help center
FAQ
Privacy
Compare all models
Support

Developers
Quickstarts
API reference
API pricing
CLI
MCP
Downloads
Desktop
Badges and embeds

© idapt[email protected]Terms Privacy Policy Legal notice Report content

Reasoning AI benchmarks & outputs - idapt

Reasoning benchmarks & outputs

Real captured outputs and agent demos from AI models on reasoning prompts. Every score has a receipt.

🏥The surgeon's son

Single-shotGraded

🔢9.11 vs 9.9

Single-shotGraded

When comparing the decimal numbers 9.11 and 9.9, it helps to write them with the same number of decimal places: 9.11 and 9.90. - The whole number parts are both 9. - In the tenths place, 1 is less than 9. Therefore, 9.11 is less than 9.9

🚪Monty Hall, transparent doors

Single-shotGraded

📦The cat that was already dead

Single-shotGraded

🚋The empty trolley problem

Single-shotGraded

If the trolley is heading down the main track and there is nobody on that track, then doing nothing means the trolley continues along its current path and strikes no one. Since there are also no people on the side track, the presence of th

🛶Moses and the ark

Single-shotGraded

✈️Where to bury the survivors

Single-shotGraded

⚖️A pound of feathers

Single-shotGraded

👧Sally's sisters

Single-shotGraded

📅February 2024

Single-shotGraded

🛶The unconstrained river crossing

Single-shotGraded

⏱️Seconds in a week

Single-shotGraded

👨‍👦Two fathers and two sons

Single-shotGraded

♾️Is 0.999... less than 1?

Single-shotGraded

🚗Monty Hall with two cars

Single-shotGraded

🐐Monty Hall, unchanged (control)

Single-shotGraded

🪶A kilogram of feathers

Single-shotGraded

⚖️A pound of each (control)

Single-shotGraded

👨‍👧Mary's father's daughters

Single-shotGraded

⚾The bat and the ball

Single-shotGraded

✖️13 times 17

Single-shotGraded

🏭Machines and widgets

Single-shotGraded

🪷Lily pads on a lake

Single-shotGraded

🕛Minutes in a day

Single-shotGraded

🐓The rooster's egg

Single-shotGraded

✅9.9 vs 9.11 (control)

Single-shotGraded

🕳️Dirt in a hole

Single-shotGraded

🔢Which is larger: 9.8 or 9.11

Single-shotGraded

🖼️The man in the photograph

Single-shotGraded

🐑All but nine

Single-shotGraded

📆Days in 2024

Single-shotGraded

💊Three pills

Single-shotGraded

🗓️Months with 28 days (control)

Single-shotGraded

📅100 days after Wednesday

Single-shotGraded

🧒Johnny's mother

Single-shotGraded

🏛️Roman numeral XLIX

Single-shotGraded

🏺2024 in Roman numerals

Single-shotGraded

37 results

🏥The surgeon's son

Single-shotGraded

🔢9.11 vs 9.9

Single-shotGraded

When comparing the decimal numbers 9.11 and 9.9, it helps to write them with the same number of decimal places: 9.11 and 9.90. - The whole number parts are both 9. - In the tenths place, 1 is less than 9. Therefore, 9.11 is less than 9.9

🚪Monty Hall, transparent doors

Single-shotGraded

📦The cat that was already dead

Single-shotGraded

🚋The empty trolley problem

Single-shotGraded

If the trolley is heading down the main track and there is nobody on that track, then doing nothing means the trolley continues along its current path and strikes no one. Since there are also no people on the side track, the presence of th

🛶Moses and the ark

Single-shotGraded

✈️Where to bury the survivors

Single-shotGraded

⚖️A pound of feathers

Single-shotGraded

👧Sally's sisters

Single-shotGraded

📅February 2024

Single-shotGraded

🛶The unconstrained river crossing

Single-shotGraded

⏱️Seconds in a week

Single-shotGraded

👨‍👦Two fathers and two sons

Single-shotGraded

♾️Is 0.999... less than 1?

Single-shotGraded

🚗Monty Hall with two cars

Single-shotGraded

🐐Monty Hall, unchanged (control)

Single-shotGraded

🪶A kilogram of feathers

Single-shotGraded

⚖️A pound of each (control)

Single-shotGraded

👨‍👧Mary's father's daughters

Single-shotGraded

⚾The bat and the ball

Single-shotGraded

✖️13 times 17

Single-shotGraded

🏭Machines and widgets

Single-shotGraded

🪷Lily pads on a lake

Single-shotGraded

🕛Minutes in a day

Single-shotGraded

🐓The rooster's egg

Single-shotGraded

✅9.9 vs 9.11 (control)

Single-shotGraded

🕳️Dirt in a hole

Single-shotGraded

🔢Which is larger: 9.8 or 9.11

Single-shotGraded

🖼️The man in the photograph

Single-shotGraded

🐑All but nine

Single-shotGraded

📆Days in 2024

Single-shotGraded

💊Three pills

Single-shotGraded

🗓️Months with 28 days (control)

Single-shotGraded

📅100 days after Wednesday

Single-shotGraded

🧒Johnny's mother

Single-shotGraded

🏛️Roman numeral XLIX

Single-shotGraded

🏺2024 in Roman numerals

Single-shotGraded