An infinite procedural runner for PC that uses artificial intelligence and computer vision to track the player's physical movement through a webcam and translate it into gameplay.
Technical Challenges
Processing live video feeds in real-time requires high optimization to prevent lag between the physical movement and the in-game action. Achieving accurate tracking without relying on external sensors meant strictly optimizing the computer vision scripts. Integrating Python libraries such as CV2 with Unity Engine game systems using UDP was also a significant challenge. Implementing smooth procedural level generation while maintaining performance was a key element for the gameplay of the game.
DATA FLOW
WEBCAM → PLAYER MOVEMENT → COMPUTER VISION → TRACKING DATA → GAMEPLAY
