ITI Talks: Fixing injuries with VR / Climate change communication

During the event, the team discussed research on rehabilitating injuries with VR help and climate change communication

The Interactive Technologies Institute hosted the ITI Talks event held this month. It was a great success, with two speakers presenting their latest research. The event occurred in a hybrid format, with physical locations in Lisbon and Funchal. During the event, the team discussed research on rehabilitating injuries with VR help and climate change communication.

The talks

Cristiano França presented his study on “Virtual Reality Gaming in Rehabilitation after Musculoskeletal Injury – User Experience Pilot Study.” He described a new technological solution for rehabilitating musculoskeletal injuries using virtual reality (VR) gaming. The study analysed the variation in rated perceived exertion (RPE) and heart rate (HR) of participants undergoing rehabilitation based on different VR gaming. The study’s results indicated a statistically significant difference in RPE scale and HR across the five VR games throughout a complete rehabilitation session. Moreover, the results showed high perceived usability of the system. Additionally, there was a greater intrinsic motivation to perform the rehabilitation exercises, a high level of immersion, and a good experience in the VR gaming environment. The study has important implications for rehabilitating athletes recovering from musculoskeletal injuries.

Afterwards, the second speaker, Marta Ferreira, presented her research on “Reconnecting Audiences with Climate Change: Towards Relatable and Action-focused Data Interactions.” She discussed the design and testing of Finding Arcadia, an interactive data story that uses data humanism to shift the dialogue from crisis-focused to action-focused. The study focused on the communication potential of different media and their intersection with sustainability. In particular, she aims to develop engaging and action-focused climate change data interactions. The study had two pilot tests, one in Pavilhão do Conhecimento and the other in a local traditional market. The study’s results showed the effectiveness of the data visualisation approach in engaging and inspiring audiences towards climate action.

The speakers

Cristiano França is a researcher at ITI/LARSyS who has focused on virtual reality technology for the past three years. He holds a bachelor’s degree in Computer Engineering and a master’s in Interactive Media Design. In the meantime, he has developed a new technological solution for rehabilitating musculoskeletal injuries based on virtual reality gaming.

Marta Ferreira is a design researcher with a degree in Communication Design and a Master’s degree in Typographic and Editorial Practices from FBAUL. Presently, she is pursuing a PhD in Digital Media from FCT/Técnico and is focused on applying her research interests in interaction projects related to sustainability. Marta’s research explores the intersection between different media and their communication potential.

Overall, the ITI Talks event held in March 2023 was an excellent opportunity for researchers to share their latest findings on essential topics. The presentations were informative and engaging, sparking exciting discussions during the lunch break. We are excited to see the next ITI Talks event in April.

Engaging teenagers using interactive technology in museums

Engaging teenagers using interactive technology in museums

The Interactive Technologies Institute has recently conducted research on the preferences of teenagers when it comes to using visiting interactive technology in museums. The research was carried out in collaboration with the Natural History Museum of Funchal, and was led by Vanessa Cesário.

The research aimed to find out how museums can better engage with their younger audiences and found that technology was the key to attracting teenagers. For that reason, the team conducted participatory design sessions with 155 teenagers between the ages of 15 and 19 to understand what kind of experience they would like to have in a museum. The sessions revealed that while teenagers did not consider museums attractive, they were excited about the prospect of having interactive technology guide them through exhibitions.

Then, the feedback from the teenagers was categorized into two themes – game mechanics and narratives. Most participants preferred gamification experiences in museums, while a few preferred narrative-based experiences. The researchers also reached out to Cultural Management students, who will become the future curators of museums. They found that while they believed storytelling and narrative were the keys to attracting young people, teenagers preferred game-based experiences.

Games vs narratives

Afterwards, and based on this feedback, we developed two different prototypes – a location-based game and a narrative-based experience. Furthermore, the team studied the impact of these experiences on the engagement levels of teenagers and found that those who were motivated by competition preferred game-based approaches. In contrast, those who were intrigued by the plot preferred narrative-based approaches. To sum up, most teenagers preferred stories except for the most competitive ones, who engaged more with game-based methods.

In conclusion, the research conducted by the Interactive Technologies Institute highlights the importance of considering the preferences of teenagers when it comes to designing museum experiences. In fact, by incorporating technology, museums can create engaging and meaningful experiences that cater to the needs and desires of their younger audiences.

References

Cesário, V., & Nisi, V. (2022). Designing with teenagers: A teenage perspective on enhancing mobile museum experiences. International Journal of Child-Computer Interaction33, 100454. https://doi.org/10.1016/j.ijcci.2022.100454

Cesário, V., Olim, S., Nisi, V. (2020). A Natural History Museum Experience: Memories of Carvalhal’s Palace – Turning Point. In: Bosser, AG., Millard, D.E., Hargood, C. (eds) Interactive Storytelling. ICIDS 2020. Lecture Notes in Computer Science(), vol 12497. Springer, Cham. https://doi.org/10.1007/978-3-030-62516-0_31

Cesário, V., Petrelli, D., & Nisi, V. (2020). Teenage Visitor Experience: Classification of Behavioral Dynamics in Museums. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–13. Presented at the Honolulu, HI, USA. https://doi.org/10.1145/3313831.3376334

Cesário, V., Trindade, R., Olim, S., Nisi, V. (2019). Memories of Carvalhal’s Palace: Haunted Encounters, a Museum Experience to Engage Teenagers. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds) Human-Computer Interaction – INTERACT 2019. INTERACT 2019. Lecture Notes in Computer Science(), vol 11749. Springer, Cham. https://doi.org/10.1007/978-3-030-29390-1_36

Nisi, V., Cesario, V., Nunes, N. (2019). Augmented Reality Museum’s Gaming for Digital Natives: Haunted Encounters in the Carvalhal’s Palace. In: van der Spek, E., Göbel, S., Do, EL., Clua, E., Baalsrud Hauge, J. (eds) Entertainment Computing and Serious Games. ICEC-JCSG 2019. Lecture Notes in Computer Science(), vol 11863. Springer, Cham. https://doi.org/10.1007/978-3-030-34644-7_3

Cesário, V. (2019). Guidelines for Combining Storytelling and Gamification: Which Features Would Teenagers Desire to Have a More Enjoyable Museum Experience? Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6. Presented at the Glasgow, Scotland Uk. https://doi.org/10.1145/3290607.3308462

Researchers study how to boost balance performance in football

Researchers study how to boost balance performance in football

An international team of researchers from the University of Madeira and the University of Lisbon carried out a study to improve the performance of young footballers. The project focuses on youngsters between 13 and 16 years old. It  found a relationship between balance performance, body composition, and physical fitness.  

“We identified a gap in the study of balance performance in young footballers, a decisive ability to improve techniques such as dribbling, passing, and positioning among opponents,” says Cíntia França, a researcher at the Interactive Technologies Institute from the Instituto Superior Técnico. 

The researchers found strong relationships between the balance ability of young athletes and the percentage of body fat. The higher this percentage, the worse the performance of athletes in balancing tasks. On the other hand, the strength training and flexibility of the athletes can contribute positively to a greater balance performance. 

The research team, therefore, recommends that young athletes’ football coaches  promote balance training together with other exercises. “Sports agents should consider including exercises focused on the development of physical fitness, including strength, in the training process. In addition, monitoring body composition, particularly the percentage of body fat, is essential to avoid its negative effect on physical performance,” adds Cíntia França. 

Next step: longitudinal studies

To understand the impacts of the proposed methodology, the team has already outlined follow-up plans. “The objective is to follow up with these young soccer players longitudinally. We would need to study their progress in body composition and physical fitness. This way we can understand the effects of long-term training”, concludes the researcher. 

This research was carried out within the scope o the Marítimo Training Lab project, which aims to develop a high-performance training center for the Marítimo da Madeira football club. In addition to Portuguese institutions, the study also included the collaboration of researchers from research institutions in Brazil, Switzerland, and Poland. 

Researchers develop technology to detect dangerous mosquitoes

Researchers develop technology to detect dangerous mosquitoes

The researcher Dinarte Vasconcelos is developing a tech solution within the scope of his Doctoral thesis. “My research aims to produce an economically viable solution packed with a set of sensors that can detect dangerous mosquitoes and distinguish them from other insects,” says the researcher.  Nuno Nunes and João Pedro Gomes, professors at the Instituto Superior Técnico, and researchers at the Institute of Interactive Technologies (ITI) and Institute of Systems and Robotics (ISR), respectively advise the research project.

Mosquitoes inhabit various regions of the world, with more than 3,000 species already identified in the world. Some of these are transmission vectors of several diseases such as malaria, yellow fever, or dengue. According to the World Health Organization, 627,000 people died of malaria in 2020.

The first prototype

Initially, the researchers performed tests using microphones that captured the sound of  flapping wings.  This allows sensors to detect dangerous mosquitoes close. “As the frequency of the flapping of the wings varies between species, it is possible to recognize the pattern of the species found by the microphones,” explains Dinarte Vasconcelos. However, this approach allowed only the measurement within a short range.  Morevover, the system was not prepared to handle background noise. With the inclusion of infrared optical sensors, it was possible to increase the system’s reach and make it resilient against ambient noise. However, the existence of multiple species of insects requires the use of artificial intelligence to achieve better results. “We will need a database to identify which of the detected insects are mosquitoes,” he adds.

Testing in Thailand

Under favorable conditions, a female mosquito can hatch between 100 and 200 eggs in 7 days. For this reason, the prototype must be able to distinguish males and females. “The laboratory tests we did in partnership with the Natural History Museum of Funchal reveal that the prototype correctly identified more than 90% of mosquitoes are concerning species and sex,” says Dinarte Vasconcelos. The researcher carried out further testing in Thailand, in partnership with Mahidol University. Here, the malaria-transmitting mosquitoes – Aedes and Anopheles are abundant. Dinarte and a local team ran experiments near the Rajanagarindra Tropical Disease International Centre (RTIC). The team placed  light and dry ice traps to attract mosquitoes. These tests were important to calibrate sensors, identify problems and improve detection in a real life environment.

Sensor to detect mosquitoes
The researchers tested the technology in Thailand

A precious tool to health authorities

Once finalized, the prototype will be able to transmit information to health authorities. It will use radio frequency to transmit information, since it is more energy efficient than WiFi, thus allowing a real-time mapping of mosquito presence. In this sense, the Interactive Technologies Institute, the University College London, and the Regional Directorate of Health of Madeira signed a research protocol to develop a monitoring system in Funchal.

In the future, researchers intend to continue the development of the technology so that it can distinguish between mosquitoes and other insects. Additionally to serving the original purpose, the same technology can be used to monitor other insect species of special interest such as bees and other pollinators, whose population has been dwelling over the past few years.

Portugal leads climate neutrality project funded with € 5 million

Bauhaus of the Seas Sails is a project led by Portugal to achieve climate neutrality and funded with € 5 million

Bauhaus of the Sea Sails is one of the projects selected under the call for the development of ‘lighthouse demonstrators’ of the New European Bauhaus (NEB) that will focus on climate neutrality.

The project, selected for funding of approximately €5 million by the European Commission, will pursue the broad Vision of the New Bauhaus of the Seas to demonstrate and archive solutions for climate neutrality. There is a particular focus on coastal cities as an interface to healthy seas, ocean and water bodies.  Instituto Superior Técnico will lead a network of 18 project partners and gather a multidisciplinary research team ranging from Universities to Municipalities and Museums, across six European countries. The Project will also count on the institutional support of international partners such as the Carnegie Mellon Portugal Program (CMU Portugal).

Why the ocean?

The project team chose the Ocean as the main focus of the project because of its ecological impact and housing relevance – oceans capture a third of CO2 emissions and coastal areas are home to 41% of the European population. “The oceans currently face several challenges such as plastic pollution, reduced fish stocks or rising sea levels. With this project, we want to promote an interdisciplinarity ecosystem between designers, architects, engineers, artists, managers and scientists with the vision of creating sustainable design solutions to solve environmental problems in coastal areas”, says the project coordinator Nuno Jardim Nunes, Full Professor at Técnico and head of the Interactive Technologies Institute (ITI), one of the participant institutions.

Where will the project take place?

With this goal in mind, the Bauhaus of the Sea Sails will implement seven demonstrators located in European coastal regions. These include two in Portugal (Lisbon and Oeiras), two in Italy (Venice and Genova), and one in four other countries: Sweden (Malmø), Germany (Hamburg), the Netherlands and Belgium (Rhine delta). Additionally, the project plans to deploy observers in Azores and Madeira’s autonomous regions and other Portuguese-speaking countries.
The lighthouse demonstrators will exhibit artistic projects focused on the oceans, taking them from a cultural, artistic and closed circle to the streets, neighborhoods and close to the community. “This project will create opportunities for interaction with communities to achieve an environmentally sustainable, socially fair and appealingly transition”, adds the project lead.

In Lisbon and Oeiras, the project will be based in the future “Hub do Mar”, in Pedrouços, where the consortium will develop various demonstration activities related to the blue economy. Moreover, the team will focus on ocean literacy, sustainable food and solutions to mitigate and adapt to rising sea levels.

The “New European Bauhaus” Program, which funds the six selected projects, aims at creating more sustainable, inclusive, and beautiful spaces in locations across the EU and involving citizens in the green transition at the local level. The projects will contribute with innovative ideas and solutions within two years, helping to point the way forward for other NEB actions.