Benchmark Almanac

University of Augsburg

We track 2 benchmarks that University of Augsburg made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MecEng Models generate rigid and flexible multibody simulations from text. The evaluator checks system connections, geometry, and numerical outputs against engineering references. Scientific code Aug 2026 91.4% Not in cards
CAR-bench Agents act as an in-car voice assistant that talks with an LLM-simulated driver and uses 58 connected tools for navigation, productivity, charging and vehicle control under set policies. Besides ordinary tasks, hallucination tasks remove a needed tool or fact, and disambiguation tasks need a clarifying question or a lookup. Scores reward consistent success across repeated runs. General assistants Jan 2026 70% Not in cards