PRODUCED IN PARTNERSHIP WITH

Real Ball Tracking in Mixed Reality: How 'Ballee' Turns Physical Balls into Core XR Gameplay

Most mixed reality experiences rely on standard handheld controllers or bare hand tracking. But physical feedback changes everything.

In this session, I will take you into the engine room of Ballee, an experimental mixed reality sandbox and arcade experience where a real soccer ball becomes your primary interaction tool.

Building high energy physical games like Attack of the Zombie Elves introduces unique technical hurdles that standard XR tutorials never cover. We will explore how to achieve robust real time color tracking for fast moving balls on standalone hardware without tanking the frame rate.

Moving from living room sandboxes to location based arcade setups also changes the architecture. I will show how instant spatial calibration using ArUco markers allows multiple players to share a compact physical playing field while keeping virtual targets and physical soccer balls perfectly synced.