A multidimensional activity theory framework for human–computer interaction with Digital Twins

Abstract

This article proposes a user-centered framework to address interaction and usability challenges in complex Digital Twin systems(DTs) through an adaptation of Activity Theory, termed Pyramidal Activity Theory (PAT).Despite the growing adoption of DTs across industries, designing effective user interactions remains challenging due to the diversity of application domains, where multiple models, stakeholders, phases, and operational scales are often distributed across heterogeneous software environments. These complexities can lead to fragmented workflows, communication barriers, and inconsistent interaction experiences. PAT adapts the framework to focus on interaction structures by explicitly incorporating users, tools (models), live Data, interfaces, and outcomes.The framework is demonstrated through two conceptual case studies.The first case study conceptually maps interactions in an advanced manufacturing environment, while the second demonstrates how PAT can inform the design of a prototype Digital Twin interface for industrial energy systems. PAT provides a structured mechanism for analyzing interaction pathways and translating socio-technical relationships into interface design considerations. Future work will include empirical evaluation and usability assessment.