A new paradigm for Human-Building Interaction: the use of CFD and Augmented Reality

This paper presents an interactive speech and gesture recognition-based, immersive Augmented Reality (AR) model designed to visualize and interact with buildings and their thermal environments. The paper introduces a Human–Building Interaction (HBI) model that allows for the efficient exploration of Computational Fluid Dynamics (CFD) data sets in real time. This model includes four components: wireless sensor data, CFD analysis, Human–Computer Interaction (HCI), and AR visualization. The sensor data component tracks temperature and velocity changes that occur within a room and updates the boundary conditions for simulation. The CFD analysis component performs simulation with the new boundary conditions, and the post-processed data are exported as Virtual Reality Modeling Language (VRML) models. The HCI component consists of a library of gesture recognition tasks. These tasks update and process data for the AR visualization component. The AR visualization component aids in tracking the user's movement in real time and poses graphical information onto the Head-Mounted Device (HMD), allowing the user to visualize CFD data sets that are superimposed on to the actual scene.