Benchmark Almanac

Institute of Computing Technology

We track 3 benchmarks that Institute of Computing Technology made or helped make.

0 in use 3 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Doc2Harness Models build a coding-agent harness from an interface skeleton and a development document. The frozen harness then runs 328 scripted test cases in separate containers. AI research tasks Oct 2026 53% Not in cards
RealBench (Verilog) Models write Verilog modules or complete systems from design specifications. Testbenches check behavior, and a formal checker compares the result with the reference implementation. Electronics Jul 2025 6.65% Not in cards
ChipGPTV Models write Verilog from circuit diagrams and descriptions with different levels of detail. Testbenches check whether the generated circuits behave correctly. Electronics Jul 2024 71.8% Not in cards