Researchers introduced Cambrian-BEV, a way to map visual patches from video into a shared bird's-eye-view grid. It uses depth and camera pose to merge observations of the same place, regardless of viewpoint or time. The method keeps the same model architecture but replaces frame tokens with 27×27 BEV tokens. On the VSI-Bench test it scored 63.48, 8.5 points higher than a frame‑token baseline while using far fewer tokens.
Why it matters
It lets developers build faster, lighter video‑based AI assistants that can reason about space more reliably.