Why computer use benchmarks are so hard to run
Running a computer use benchmark like OSWorld is easy to start and hard to get right. I read about 200 GitHub issues to see what goes wrong. Here are the 10 problems you will face, and how I would handle each.
October 12, 2026 · 17 min read
My checklist for reading computer use benchmarks
I read about 40 benchmark repositories and 230 sources to understand computer use scores. I came out with six questions I now ask before I believe any of them.
October 6, 2026 · 16 min read
How to engineer a Jev harness
I went through how people actually wire Jev into their agents: where it sits in the loop, what they feed it, and when they stop trusting it.
September 20, 2026 · 9 min read
Terminal UIs for Harnesses in 2026: who builds on what, and why
We spent forty years escaping the command line. Then AI agents arrived, and the best-funded interface teams in software went back to a grid of monospaced characters.
August 6, 2026 · 9 min read
AI Agent Security in 2026: Why Hooks Are the New Firewall?
The problem we solved in operating systems years ago rises again with AI agents. A four-property framework for AI agent security in 2026.
May 16, 2026 · 13 min read
