Aditya Ramabadran, Simon Mahns and Tobias Gessler, engineers at the startup Axiom, connected OpenAI’s GPT‑6 Astra to a 2024 Toyota Corolla. The model, normally a text‑and‑code generator, was given live video from windscreen cameras and control of the steering. With a safety driver ready to brake, the AI guided the car to the In‑N‑Out take‑out window so the team could collect lunch. The stunt shows a language‑based model beginning to handle real‑world physical tasks.
Why it matters
If general‑purpose language models can reliably control physical devices, they could be repurposed for robotics and automation without building dedicated control software.