No sign-up needed to follow along. Each walkthrough plays on its own; click a step to jump.
| model | grade | CPAT | list $/M |
|---|---|---|---|
| gemini-2.5-flash | A Β· 46/48 | $0.004 | $0.30 |
| llama-3.3-70b | B Β· 39/48 | $0.006 | $0.59 |
| qwen3-32b | B Β· 37/48 | $0.005 | $0.40 |
| mistral-small | derived | ~$0.008 | $0.20 |
| task | expected | gemini-2.5-flash |
|---|---|---|
| JSON extract #14 | 3 fields | β pass |
| Hebrew date parse | 2026-09-15 | β pass |
| SQL fix #7 | row count 12 | β fail |
| Unit test gen | 4/4 green | β pass |
| model | grade | CPAT |
|---|---|---|
| gemini-2.5-flash | A Β· measured | $0.004 |
| mistral-small | derived | ~$0.008 |
| gpt-5-mini | derived | ~$0.012 |
| metric | flash | llama |
|---|---|---|
| grade | 46/48 | 39/48 |
| CPAT | $0.004 | $0.006 |
| breaks on | β | SQL, long JSON |
| task | flash | llama | qwen |
|---|---|---|---|
| write tests | β | β | β |
| fix bug #212 | β | β | β |
| summarize PR | β | β | β |
| today | sessions | stalls caught | saved |
|---|---|---|---|
| Tue | 6 | 2 | $18.70 |