Blog
Notes from building computer use for phones
How ready is Android for AI agents? What broke in 3,324 actions on 45 phones
For four weeks Claude, ChatGPT and Codex used 45 Android phones through Opposable. Their taps and swipes worked 99% of the time, and the most common failure was the phone itself: 27 of the 45 dropped off while an agent was using it.
Computer use on the phone itself: a 2B model that operates Android apps
GUI-Owl 2B runs inside an Android app and taps through other apps with no server. One step takes 7.3 s on a laptop CPU, and its vision encoder takes 236 ms on a Galaxy S25's NPU instead of 3.9 s.
Driving an iPhone from a Mac with a fake Bluetooth keyboard
Apple doesn't let any app control other apps. An iPhone will, however, accept a keyboard and a mouse, and that turns out to be enough.
Phones are the last big body of software only people can use
What we learned getting AI agents to use real phones, including the payment bugs we found in our own code, and some guesses about where computer use on phones goes from here.