Distributed, multi-sensor tracking of multiple participants within immersive environments using a 2-cohort camera setup

Vision-based human motion tracking has gained significant interest in recent years, as the need for more intuitive human–computer interaction paradigms are sought after. Immersive environments, such as large-scale displays and virtual reality systems are particularly suitable for such interaction mechanisms, as they provide a controlled basis for experimentation and evaluation. However, despite the growing interest, human-motion tracking within immersive environments is still in its infancy. The lack of visible light and the presence of multiple people within such environments pose several challenges to the problem. In this research a robust framework for real-time, multi-camera human-motion tracking within an immersive environment is presented. The static nature of the environment is exploited to utilise a novel 2-cohort camera layout. This layout proves to be highly useful for tracking, providing several benefits over existing techniques, which treat all cameras as the same.