Augmented Human Assistance

The Augmented Human Assistant project was an ambitious scientific and technological endeavor that aimed at providing solutions to alleviate the social, psychological and economical burden related to sedentarism and aging-related morbidities. It brought together innovation and research in a cross-disciplinary consortium with expertise in diverse areas such as Human Functioning and Performance, Augmented Reality (AR) technologies, serious games for health, physiological signal acquisition systems, computer vision systems, robot navigation, and intelligent scene assessment. The integrated AHA system was composed of a mobile robotic platform with advances in perception, navigation, and control skills; leveraged with an extended set of sensors for human sensing and emotional state estimation; serious gaming abilities through novel augmented reality methods yielding extended feedback modalities for physical exercising and motor rehabilitation; and a virtual coach system with technologies and techniques that assisted and encouraged users while they performed rehabilitation exercises and instilled better compliance with their prescribed exercise regimen. Such a platform defined a new class of assistive devices for healthy, elderly and patient users, allowing new modalities of interaction and engagement not yet available in the state-of-the-art.


The Augmented Human Assistant project was a scientific and technological effort aimed at helping people with sedentary lifestyles and aging-related health problems. The project combined innovation and research in various fields, such as robotics, augmented reality, and physiological signal acquisition systems, among others. The result was an integrated system that included a mobile robot with advanced perception and navigation skills, sensors for human sensing and emotional state estimation, and a virtual coach system that assisted users with rehabilitation exercises. This new class of assistive devices offered better interaction and engagement for healthy, elderly, and patient users, improving their compliance with prescribed exercise regimens.


08/01/2014 - 25/09/2023

Funding scheme

Fundação para a Ciência e Tecnologia, CMU Portugal

Project reference



Carnegie Mellon University; Institute for Systems and Robotics; Madeira Interactive Technologies Institute; Universidade Nova de Lisboa; Human Kinectics Faculty; Plux; YDreams

Project website


HCI Subfields

Accessibility and Aging; Health