How video informs cognitive systems engineering: making experience count

Cognitive systems engineering (CSE) requires perspectives that demand users and teams be understood in relation to the context they act in. Situated problems that emerge in the context of use are frequently distributed across people, information and artefacts (distributed cognition) that characterise the temporal emergence of activities. Current tools and capabilities within the digital video revolution make it possible to actively capture, record, explore and analyse video streams to assist in understanding distributed cognition and the implications it has for envisioned designs. Yet, there are research issues and questions to address. The Living Laboratory Framework is described and posited as one way to systematically integrate video into CSE to enhance the reliability and validity of design artefacts in practice. Case examples (Jasper and NeoCITIES simulations) are explored to provide specific ways of understanding different kinds of video representation and analysis within CSE.