{
  "meta": {
    "generated_at": "2026-07-16T18:54:27.615432186Z",
    "publisher_version": "4"
  },
  "model_key": "claude-cli-claude-sonnet-5",
  "display_name": "Claude Sonnet 5 (CLI)",
  "provider": "claude-cli",
  "open_weight": false,
  "per_suite": [
    {
      "suite": "structured-extraction",
      "suite_version": "v1",
      "scoring_id": "scoring-20260716T185157.349Z",
      "run_id": "claude-cli-claude-sonnet-5__structured-extraction@v1__20260716T184534Z",
      "capability": 1,
      "grade": "A",
      "cost_median_usd": 0,
      "latency_median_ms": 5704,
      "latency_p95_ms": 9261,
      "reliability": 1,
      "error_rate": 0
    },
    {
      "suite": "structured-extraction",
      "suite_version": "v2",
      "scoring_id": "scoring-20260713T211128.276Z",
      "run_id": "claude-cli-claude-sonnet-5__structured-extraction@v2__20260713T210738Z",
      "capability": 1,
      "grade": "A",
      "cost_median_usd": 0,
      "latency_median_ms": 3974,
      "latency_p95_ms": 15945,
      "reliability": 1,
      "error_rate": 0
    }
  ],
  "attempts": {
    "structured-extraction@v1": [
      {
        "task_id": "a1b2c3",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5670,
        "input_tokens": 24514,
        "output_tokens": 194,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a1b2c3",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 4566,
        "input_tokens": 24516,
        "output_tokens": 171,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a1b2c3",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 10615,
        "input_tokens": 24514,
        "output_tokens": 721,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a3f7c8",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 10675,
        "input_tokens": 25137,
        "output_tokens": 429,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a3f7c8",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 9248,
        "input_tokens": 25139,
        "output_tokens": 509,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a3f7c8",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 9024,
        "input_tokens": 25139,
        "output_tokens": 482,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a6f1d9",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 8820,
        "input_tokens": 25048,
        "output_tokens": 467,
        "cost_usd": 0,
        "output": "```json\n{\n  \"claims\": [\n    {\n      \"claim\": \"The battery lasts 12 hours on a single charge.\",\n      \"metric\": 12,\n      \"unit\": \"hours\"\n    },\n    {\n      \"claim\": \"It weighs just 240 grams.\",\n      \"metric\": 240,\n      \"unit\": \"grams\"\n    },\n    {\n      \"claim\": \"The build quality feels premium and sturdy.\",\n      \"metric\": null,\n      \"unit\": null\n    },\n    {\n      \"claim\": \"And it charges fully in 90 minutes.\",\n      \"metric\": 90,\n      \"unit\": \"minutes\"\n    }\n  ],\n  \"claim_count\": 4\n}\n```",
        "redacted": true
      },
      {
        "task_id": "a6f1d9",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 7468,
        "input_tokens": 25048,
        "output_tokens": 467,
        "cost_usd": 0,
        "output": "```json\n{\n  \"claims\": [\n    {\n      \"claim\": \"The battery lasts 12 hours on a single charge.\",\n      \"metric\": 12,\n      \"unit\": \"hours\"\n    },\n    {\n      \"claim\": \"It weighs just 240 grams.\",\n      \"metric\": 240,\n      \"unit\": \"grams\"\n    },\n    {\n      \"claim\": \"The build quality feels premium and sturdy.\",\n      \"metric\": null,\n      \"unit\": null\n    },\n    {\n      \"claim\": \"And it charges fully in 90 minutes.\",\n      \"metric\": 90,\n      \"unit\": \"minutes\"\n    }\n  ],\n  \"claim_count\": 4\n}\n```",
        "redacted": true
      },
      {
        "task_id": "a6f1d9",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 6753,
        "input_tokens": 25048,
        "output_tokens": 452,
        "cost_usd": 0,
        "output": "```json\n{\n  \"claims\": [\n    {\n      \"claim\": \"The battery lasts 12 hours on a single charge.\",\n      \"metric\": 12,\n      \"unit\": \"hours\"\n    },\n    {\n      \"claim\": \"It weighs just 240 grams.\",\n      \"metric\": 240,\n      \"unit\": \"grams\"\n    },\n    {\n      \"claim\": \"The build quality feels premium and sturdy.\",\n      \"metric\": null,\n      \"unit\": null\n    },\n    {\n      \"claim\": \"And it charges fully in 90 minutes.\",\n      \"metric\": 90,\n      \"unit\": \"minutes\"\n    }\n  ],\n  \"claim_count\": 4\n}\n```",
        "redacted": true
      },
      {
        "task_id": "a9d4f2",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5687,
        "input_tokens": 25181,
        "output_tokens": 202,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a9d4f2",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5393,
        "input_tokens": 25181,
        "output_tokens": 141,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "a9d4f2",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 5667,
        "input_tokens": 25179,
        "output_tokens": 211,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b1d7c3",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 7155,
        "input_tokens": 25020,
        "output_tokens": 500,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b1d7c3",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 6884,
        "input_tokens": 25020,
        "output_tokens": 450,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b1d7c3",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 6838,
        "input_tokens": 25020,
        "output_tokens": 445,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b2c9e1",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5402,
        "input_tokens": 24842,
        "output_tokens": 329,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b2c9e1",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5469,
        "input_tokens": 24842,
        "output_tokens": 262,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b2c9e1",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 5497,
        "input_tokens": 24842,
        "output_tokens": 175,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b8e3d7",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 6179,
        "input_tokens": 24916,
        "output_tokens": 350,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b8e3d7",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5335,
        "input_tokens": 24914,
        "output_tokens": 320,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "b8e3d7",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 6220,
        "input_tokens": 24916,
        "output_tokens": 344,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c3f8a4",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5666,
        "input_tokens": 25307,
        "output_tokens": 240,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c3f8a4",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5722,
        "input_tokens": 25305,
        "output_tokens": 211,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c3f8a4",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 8043,
        "input_tokens": 25305,
        "output_tokens": 116,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c4a9f1",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 7744,
        "input_tokens": 25407,
        "output_tokens": 490,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c4a9f1",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 8510,
        "input_tokens": 25407,
        "output_tokens": 560,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c4a9f1",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 7192,
        "input_tokens": 25405,
        "output_tokens": 479,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c8e2a5",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5389,
        "input_tokens": 25093,
        "output_tokens": 252,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c8e2a5",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5149,
        "input_tokens": 25093,
        "output_tokens": 107,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "c8e2a5",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 5443,
        "input_tokens": 25091,
        "output_tokens": 129,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d1e8b6",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5593,
        "input_tokens": 25699,
        "output_tokens": 377,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d1e8b6",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 6518,
        "input_tokens": 25697,
        "output_tokens": 457,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d1e8b6",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 6663,
        "input_tokens": 25697,
        "output_tokens": 414,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 3921,
        "input_tokens": 24478,
        "output_tokens": 53,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 4985,
        "input_tokens": 24478,
        "output_tokens": 58,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 4077,
        "input_tokens": 24478,
        "output_tokens": 37,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d6b2e9",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 4133,
        "input_tokens": 25174,
        "output_tokens": 62,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d6b2e9",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5246,
        "input_tokens": 25172,
        "output_tokens": 143,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d6b2e9",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 4347,
        "input_tokens": 25174,
        "output_tokens": 62,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d9c4b2",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 4801,
        "input_tokens": 24702,
        "output_tokens": 150,
        "cost_usd": 0,
        "output": "```json\n{\n  \"records\": [\n    {\"id\": 1, \"name\": \"Marlin Crate\", \"amount\": 10.5},\n    {\"id\": 2, \"name\": \"Harbor Bolt\", \"amount\": 22},\n    {\"id\": 3, \"name\": \"Tidewater Clamp\", \"amount\": 7.25},\n    {\"id\": 4, \"name\": \"Beacon Spool\", \"amount\": 18.4}\n  ],\n  \"record_count\": 4\n}\n```",
        "redacted": true
      },
      {
        "task_id": "d9c4b2",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 4381,
        "input_tokens": 24702,
        "output_tokens": 193,
        "cost_usd": 0,
        "output": "{\"records\":[{\"id\":1,\"name\":\"Marlin Crate\",\"amount\":10.5},{\"id\":2,\"name\":\"Harbor Bolt\",\"amount\":22},{\"id\":3,\"name\":\"Tidewater Clamp\",\"amount\":7.25},{\"id\":4,\"name\":\"Beacon Spool\",\"amount\":18.4}],\"record_count\":4}",
        "redacted": true
      },
      {
        "task_id": "d9c4b2",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 4611,
        "input_tokens": 24702,
        "output_tokens": 201,
        "cost_usd": 0,
        "output": "{\"records\":[{\"id\":1,\"name\":\"Marlin Crate\",\"amount\":10.5},{\"id\":2,\"name\":\"Harbor Bolt\",\"amount\":22},{\"id\":3,\"name\":\"Tidewater Clamp\",\"amount\":7.25},{\"id\":4,\"name\":\"Beacon Spool\",\"amount\":18.4}],\"record_count\":4}",
        "redacted": true
      },
      {
        "task_id": "e2b7c5",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 6900,
        "input_tokens": 25104,
        "output_tokens": 465,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e2b7c5",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 7122,
        "input_tokens": 25104,
        "output_tokens": 509,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e2b7c5",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 6987,
        "input_tokens": 25104,
        "output_tokens": 459,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e4b9d1",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5251,
        "input_tokens": 25421,
        "output_tokens": 376,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e4b9d1",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5889,
        "input_tokens": 25419,
        "output_tokens": 339,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e4b9d1",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 5040,
        "input_tokens": 25421,
        "output_tokens": 318,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e7b1c9",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 4937,
        "input_tokens": 25109,
        "output_tokens": 137,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e7b1c9",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5350,
        "input_tokens": 25109,
        "output_tokens": 361,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "e7b1c9",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 4884,
        "input_tokens": 25109,
        "output_tokens": 251,
        "cost_usd": 0,
        "output": "{\"action_items\":[{\"task\":\"Update the onboarding deck with the new depot list\",\"owner\":\"Marcus\",\"due\":\"2026-07-20\"},{\"task\":\"Reconcile the Q2 vendor invoices\",\"owner\":\"Lena\",\"due\":null},{\"task\":\"Schedule the security review with IT\",\"owner\":\"Tomas\",\"due\":\"2026-07-24\"}],\"open_count\":3}",
        "redacted": true
      },
      {
        "task_id": "f0a7d2",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 8577,
        "input_tokens": 25151,
        "output_tokens": 629,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "f0a7d2",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 8094,
        "input_tokens": 25149,
        "output_tokens": 616,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "f0a7d2",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 7566,
        "input_tokens": 25151,
        "output_tokens": 590,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "f3a8e6",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 9524,
        "input_tokens": 24919,
        "output_tokens": 422,
        "cost_usd": 0,
        "output": "{\"records\": [{\"item\": \"Bolt Pack\", \"weight_kg\": 0.85}, {\"item\": \"Steel Rod\", \"weight_kg\": 2.5}, {\"item\": \"Copper Coil\", \"weight_kg\": 1.2}, {\"item\": \"Rubber Gasket\", \"weight_kg\": 0.4}, {\"item\": \"Aluminum Sheet\", \"weight_kg\": 3.2}, {\"item\": \"Nylon Washers\", \"weight_kg\": 0.64}], \"record_count\": 6, \"total_weight_kg\": 8.79}",
        "redacted": true
      },
      {
        "task_id": "f3a8e6",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 6288,
        "input_tokens": 24921,
        "output_tokens": 479,
        "cost_usd": 0,
        "output": "{\"records\":[{\"item\":\"Bolt Pack\",\"weight_kg\":0.85},{\"item\":\"Steel Rod\",\"weight_kg\":2.5},{\"item\":\"Copper Coil\",\"weight_kg\":1.2},{\"item\":\"Rubber Gasket\",\"weight_kg\":0.4},{\"item\":\"Aluminum Sheet\",\"weight_kg\":3.2},{\"item\":\"Nylon Washers\",\"weight_kg\":0.64}],\"record_count\":6,\"total_weight_kg\":8.79}",
        "redacted": true
      },
      {
        "task_id": "f3a8e6",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 7458,
        "input_tokens": 24921,
        "output_tokens": 509,
        "cost_usd": 0,
        "output": "```json\n{\n  \"records\": [\n    {\"item\": \"Bolt Pack\", \"weight_kg\": 0.85},\n    {\"item\": \"Steel Rod\", \"weight_kg\": 2.5},\n    {\"item\": \"Copper Coil\", \"weight_kg\": 1.2},\n    {\"item\": \"Rubber Gasket\", \"weight_kg\": 0.4},\n    {\"item\": \"Aluminum Sheet\", \"weight_kg\": 3.2},\n    {\"item\": \"Nylon Washers\", \"weight_kg\": 0.64}\n  ],\n  \"record_count\": 6,\n  \"total_weight_kg\": 8.79\n}\n```",
        "redacted": true
      },
      {
        "task_id": "f5c2a8",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 4861,
        "input_tokens": 24765,
        "output_tokens": 146,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "f5c2a8",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 5769,
        "input_tokens": 24767,
        "output_tokens": 135,
        "cost_usd": 0,
        "output": "{\"product\":\"Nimbus Slate 9 Tablet\",\"specs\":[{\"name\":\"Display\",\"value\":\"10.9 inch LCD\"},{\"name\":\"Storage\",\"value\":\"128 GB\"},{\"name\":\"Battery\",\"value\":\"8200 mAh\"},{\"name\":\"Weight\",\"value\":\"466 g\"},{\"name\":\"Ports\",\"value\":\"USB-C 3.2\"}],\"spec_count\":5}",
        "redacted": true
      },
      {
        "task_id": "f5c2a8",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 3925,
        "input_tokens": 24767,
        "output_tokens": 167,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      }
    ],
    "structured-extraction@v2": [
      {
        "task_id": "a1b2c3",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 3186,
        "input_tokens": 32091,
        "output_tokens": 117,
        "cost_usd": 0,
        "output": "```json\n{\n  \"invoice_number\": \"INV-4471\",\n  \"total\": 135.50,\n  \"currency\": \"USD\",\n  \"line_items\": [\n    {\"description\": \"Widget assembly\", \"amount\": 120.00},\n    {\"description\": \"Freight\", \"amount\": 15.50}\n  ]\n}\n```",
        "redacted": false
      },
      {
        "task_id": "a1b2c3",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 3974,
        "input_tokens": 32093,
        "output_tokens": 172,
        "cost_usd": 0,
        "output": "```json\n{\n  \"invoice_number\": \"INV-4471\",\n  \"total\": 135.50,\n  \"currency\": \"USD\",\n  \"line_items\": [\n    {\"description\": \"Widget assembly\", \"amount\": 120.00},\n    {\"description\": \"Freight\", \"amount\": 15.50}\n  ]\n}\n```",
        "redacted": false
      },
      {
        "task_id": "a1b2c3",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 3292,
        "input_tokens": 32091,
        "output_tokens": 124,
        "cost_usd": 0,
        "output": "```json\n{\n  \"invoice_number\": \"INV-4471\",\n  \"total\": 135.50,\n  \"currency\": \"USD\",\n  \"line_items\": [\n    {\"description\": \"Widget assembly\", \"amount\": 120.00},\n    {\"description\": \"Freight\", \"amount\": 15.50}\n  ]\n}\n```",
        "redacted": false
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 5041,
        "input_tokens": 32055,
        "output_tokens": 37,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 3136,
        "input_tokens": 32055,
        "output_tokens": 37,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "d4e5f6",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 3681,
        "input_tokens": 32053,
        "output_tokens": 37,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "g7h8i9",
        "repeat_n": 1,
        "state": "ok",
        "score": 0,
        "latency_ms": 18223,
        "input_tokens": 32458,
        "output_tokens": 1145,
        "cost_usd": 0,
        "output": "```json\n{\n  \"customer\": \"H. Brandt (Kellerei Brandt)\",\n  \"order_date\": \"2026-06-03\",\n  \"items\": [\n    { \"sku\": \"FE-1100\", \"quantity\": 2, \"unit_price_eur\": 34.90 },\n    { \"sku\": \"KRT-40\", \"quantity\": 1, \"unit_price_eur\": 189.00 }\n  ],\n  \"total_eur\": 258.80\n}\n```\n\nAnomalies: The FE-1100 line item was listed twice with slightly different phrasing (\"2x ... Rolle\" and \"2 Rollen ... siehe oben, zur Sicherheit nochmal\") and was deduplicated into a single line, the two dates in the thread use inconsistent/ambiguous formats (03.06.2026 in DD.MM.YYYY vs. 06/01/2026 in MM/DD/YYYY from the quoted sales reply), and the doubled \"FW: FW:\" subject with trailing \"??\" suggests the order's confirmed status was uncertain even though the stated total (258.80 EUR) does arithmetically match the line items.",
        "redacted": true
      },
      {
        "task_id": "g7h8i9",
        "repeat_n": 2,
        "state": "ok",
        "score": 0,
        "latency_ms": 12530,
        "input_tokens": 32458,
        "output_tokens": 869,
        "cost_usd": 0,
        "redacted": true,
        "output_withheld": true,
        "redaction_reason": "private-suite content"
      },
      {
        "task_id": "g7h8i9",
        "repeat_n": 3,
        "state": "ok",
        "score": 0,
        "latency_ms": 10117,
        "input_tokens": 32458,
        "output_tokens": 794,
        "cost_usd": 0,
        "output": "```json\n{\n  \"customer\": \"H. Brandt (Kellerei Brandt)\",\n  \"order_date\": \"2026-06-03\",\n  \"items\": [\n    { \"sku\": \"FE-1100\", \"quantity\": 2, \"unit_price_eur\": 34.90 },\n    { \"sku\": \"KRT-40\", \"quantity\": 1, \"unit_price_eur\": 189.00 }\n  ],\n  \"total_eur\": 258.80\n}\n```\n\nAnomalies: The FE-1100 line item was restated a third time (\"zur Sicherheit nochmal\") in a way that could be misread as a separate/additional order line rather than a duplicate confirmation of the same 2 rolls, and the stated total of 258.80 EUR is only consistent if it is *not* double-counted (2×34.90 + 189.00 = 258.80) and the phrase \"inkl. allem\" leaves it ambiguous whether tax/shipping are actually included or just verbally waved at.",
        "redacted": true
      }
    ]
  }
}