Benchmark Almanac

Learning Lab

We track 3 benchmarks that Learning Lab made or helped make.

0 in use 3 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Embodied Agent Interface Models interpret goals, decompose them into subgoals, sequence actions, and predict state transitions in BEHAVIOR and VirtualHome. The evaluator checks task completion and distinguishes hallucinations, invalid actions, and planning errors. Embodied reasoning Oct 2024 70.3 Not in cards
BEHAVIOR Challenge 2026 Robot policies solve 100 full-length household tasks in seven BEHAVIOR-1K scenes from RGB, depth and proprioception. Ranking uses average task success with partial credit. Simulated robots Jul 2026 Not in cards
BEHAVIOR-1K Embodied agents do 1,000 everyday household activities, such as cleaning and cooking, in realistic simulation built on OmniGibson. Success is checked against task goal definitions. Simulated robots Mar 2024 Not in cards