Tweet by jyangballin
May 5, 2026
How much of SQLite, FFmpeg, PHP compiler can LMs code from scratch? Given just an executable and no starter code or internet access. Introducing ProgramBench: 200 rigorous, whole-repo generation tasks where models design, build, and ship a working program end to end. 🧵 https://t.co/8ayeDJLXaJ
- Author
- jyangballin
- Date
- May 5, 2026
- Canonical URL
- /tweets/jyangballin-2051677497562210552-7e84a4