Fireworks Specialized Intelligence Index
An index that gathers 66 practitioner-built benchmarks in 14 domains, such as legal, finance, healthcare and software. It combines score, cost and duration per benchmark into one number.
Launched September 22nd, 2026 with Rogo BigFinanceBench as the first partner. Fireworks runs partner tasks in Harbor format. The benchmark index formula is 100 times score^0.706 times cost^0.176 times duration^0.118.
- Made by
- Fireworks AI
- Released
- September 2026
- Kind
- Composite indices
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Agent task
No scores here yet
We have no scores for Fireworks Specialized Intelligence Index yet.
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness.
Gemini 4 Carbon 59.0 - SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
sonar 42% - Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output.
Nemotron 3 Ultra 5.15