Published by Electricity Studio
About Electricity Bench
Electricity Bench is a coding-agent evaluation project published and operated by Electricity Studio. The organization is responsible for suite design, grading, editorial decisions, publication, and corrections. We use organization-level attribution rather than personal bylines.
What we publish
We run coding-agent products through private task suites using the subscription plans and tools a customer would use. We publish scorecards covering capability, plan usage, task time, and reliability, along with comparisons, historical trends, methodology, news, and a public results API.
Start with the leaderboard, read the methodology, or inspect the published data directly.
How grading works
The benchmark subject is the complete agent: its harness, selected model, settings, and plan tier. Agents run headless through their own tools. Suite versions pin their scoring method, task structure, repeats, and grade bands so results remain comparable within that version.
Task prompts and checker logic stay private to reduce memorization and benchmark contamination. The scoring method, grade bands, redacted outcomes, run provenance, and operational measurements are public.
Claims and commercial context
Provider claims do not contribute to Electricity Bench grades. When a relevant third-party number appears, it is kept in a separate context block with its source, retrieval date, and whether it is self-reported or independently produced.
Subscription prices and plan facts are sourced and dated. Plan quota percentages are never treated as the same unit across different providers, and a subscription run is never assigned a fabricated API price.
Corrections
Results are append-only. A correction creates a new regrade, scorecard assembly, or superseding record rather than silently rewriting a recorded run. Current pages may point to the newest authoritative result while the recorded runs themselves remain unchanged.
Questions about a result or correction can be directed to Electricity Studio.
Privacy and analytics
Published data passes a redaction gate before it reaches this site. Private prompts, fixtures, checker logic, and unsafe attempt outputs are not exposed. Withheld material stays withheld even when a score is published.
Site analytics are first-party and cookieless. They record aggregate pageview context without storing IP addresses, and no third-party advertising tracker is embedded on the site.