claude-code + claude-fable-5
claude-code harness · Claude Max 5x
overall pending Two distinct suite families are required for an overall grade.
Per-suite results
cost median
$0.0000
latency med / p95
4868 ms / 8937 ms
reliability
100%
error rate
0%
Run on claude-code 2.1.215 (Claude Code), model claude-fable-5, Jul 19, 2026.
Trajectory
Every scored run of this agent, oldest first. Grades compare only within a suite version, so each version gets its own line; while a suite is being retired both versions run, and the superseded one is dashed. The filled point is the run the scorecard shows today. All agents over time →
structured-extraction · 1 run · latest Jul 19, 2026
Capability
Median latency
Jul 19, 2026: A on v1
Compare
- claude-code + claude-fable-5 vs Claude Sonnet 5 (CLI)
- claude-code + claude-fable-5 vs claude-code + claude-haiku-4-5
- claude-code + claude-fable-5 vs claude-code + claude-opus-4-8
- claude-code + claude-fable-5 vs claude-code + claude-sonnet-5
- claude-code + claude-fable-5 vs codex-cli + gpt-5.6-luna
- claude-code + claude-fable-5 vs codex-cli + gpt-5.6-sol
- claude-code + claude-fable-5 vs codex-cli + gpt-5.6-terra
- claude-code + claude-fable-5 vs cursor-cli + composer-2.5
- claude-code + claude-fable-5 vs grok-cli + grok-4.5
- claude-code + claude-fable-5 vs kimi-cli + kimi-k3
Transcript excerpts
Outputs are shown only when they can be separated safely from the private suite. Scores and run metadata remain visible when an output is withheld.
structured-extraction@v1
| Task | # | Turns | Latency | Output |
|---|---|---|---|---|
| a1b2c3 | 1 | - | 4655 ms | withheldPrivate-suite content |
| a3f7c8 | 1 | - | 4946 ms | withheldPrivate-suite content |
| a6f1d9 | 1 | - | 11050 ms | output only{
"claims": [
{
"claim": "The battery lasts 12 hours on a single charge.",
"metric": 12,
"unit": |
| a9d4f2 | 1 | - | 3934 ms | withheldPrivate-suite content |
| b1d7c3 | 1 | - | 8826 ms | withheldPrivate-suite content |
| b2c9e1 | 1 | - | 4884 ms | withheldPrivate-suite content |
| b8e3d7 | 1 | - | 4918 ms | output only{"product":"Torch Peak 400 Headlamp","specs":[{"name":"Max output","value":"400 lumens"},{"name":"Beam distance","value" |
| c3f8a4 | 1 | - | 4249 ms | withheldPrivate-suite content |
| c4a9f1 | 1 | - | 5705 ms | withheldPrivate-suite content |
| c8e2a5 | 1 | - | 3990 ms | withheldPrivate-suite content |
| d1e8b6 | 1 | - | 4603 ms | withheldPrivate-suite content |
| d4e5f6 | 1 | - | 3519 ms | withheldPrivate-suite content |
| d6b2e9 | 1 | - | 3631 ms | withheldPrivate-suite content |
| d9c4b2 | 1 | - | 4009 ms | output only{"records": [{"id": 1, "name": "Marlin Crate", "amount": 10.5}, {"id": 2, "name": "Harbor Bolt", "amount": 22}, {"id": 3 |
| e2b7c5 | 1 | - | 6727 ms | withheldPrivate-suite content |
| e4b9d1 | 1 | - | 5052 ms | withheldPrivate-suite content |
| e7b1c9 | 1 | - | 4852 ms | withheldPrivate-suite content |
| f0a7d2 | 1 | - | 5851 ms | withheldPrivate-suite content |
| f3a8e6 | 1 | - | 5408 ms | output only{"records":[{"item":"Bolt Pack","weight_kg":0.85},{"item":"Steel Rod","weight_kg":2.5},{"item":"Copper Coil","weight_kg" |
| f5c2a8 | 1 | - | 4827 ms | withheldPrivate-suite content |