CheckerBench: Can Long-Horizon Agents Synthesize S...
52▲ • Humanlaya Data Lab
Static-analysis checker synthesis requires agents to interpret a defect specification, inspect a repository, implement analyzer-specific logic, and...
- Existing coding-agent benchmarks do not adequately assess whether agents can develop working static-analysis checkers fr
- CheckerBench introduces an executable benchmark of 300 tasks with vulnerable/fixed code revisions and CheckerLab, an eva