Build-Bench Challenge
Cross-Architecture Package Build Repair
Build an agent that diagnoses and repairs real software packages which build on one instruction set architecture but fail on another. Repairs are judged by executable builds in a controlled environment.
Competition data, starter kit, API contract, and submission portal are planned releases.
Project and organizing team
Build-Bench is organized by Nankai University with industry collaboration from Microsoft.
Project team
- Chenyu ZhaoProject leadNankai University
- Zihao HuangProject contributorNankai University
- Yihang LinProject contributorNankai University
- An XuProject contributorNankai University
- Chengtai LiProject contributorNankai University
Academic and industry advisors
- Shenglin ZhangCompetition and evaluationNankai University
- Zeshun HuangDocumentation and reproductionNankai University
- Minghua MaIndustry collaborationMicrosoft
One Agent, one controlled evaluation path
Teams provide an Agent that follows the published interface. Organizers run it against competition cases and verify each repair with the official containerized build validator.
Read the draft Agent contract- 01Submit Agent
Provide a reproducible Agent artifact using the announced packaging format.
- 02Run hidden case
The harness supplies one case through the standardized interface.
- 03Collect repair
The Agent returns the prescribed repair artifact and structured status.
- 04Build and score
The official validator checks the repair and feeds Build Success Rate to the leaderboard.
From starter kit to ICSE 2027
Dates below come from the accepted proposal and remain subject to alignment with the official ICSE 2027 schedule.
View the complete timeline