AutomationBench
4 results · verified 2026-09-20
Benchmark of computer-use automation tasks.…
Benchmark results with evaluation method, model version, source type (vendor-reported vs independent) and date. Scores are data points — never universal rankings.
4 results · verified 2026-09-20
Benchmark of computer-use automation tasks.…
3 results · verified 2026-09-20
Benchmark of browsing and retrieval ability: locating obscure information using web search and browsing.…
3 results · verified 2026-09-20
Cybersecurity agent benchmark focused on vulnerability discovery tasks.…
6 results · verified 2026-09-20
Software engineering benchmark built from real-world issues and pull requests.…
5 results · verified 2026-09-20
Graduate-level science question-answering benchmark (expert-level questions in biology, physics, chemistry).…
2 results · verified 2026-09-20
Multimodal, multi-discipline understanding benchmark with college-level questions requiring reasoning.…
6 results · verified 2026-09-20
Humanity's Last Exam - a frontier benchmark of expert-level questions across disciplines, often reported with and without tool access.…
5 results · verified 2026-09-20
Software engineering benchmark family built from real GitHub issues, with Pro, Verified and Multilingual variants.…
9 results · verified 2026-09-20
Terminal-based agent benchmark (shell commands, file operations, package management and other command-line tasks).…
2 results · verified 2026-09-20
Video understanding benchmark spanning various video durations and domains.…