Publications
During the year of 2022, the Interactive Technologies Institute research team has excelled in the production of scientific outputs. The team has successfully published 94 papers in journals, 76 in international conferences and 26 book chapters
2023
Timóteo, Rafaela; Pinto, David; Martinho, Marta; Gouveia, Pedro; Lopes, Daniel Simões; Mavioso, Carlos; Cardoso, Maria João
Skin deformation analysis for pre-operative planning of DIEAP flap reconstruction surgery Journal Article
In: Medical Engineering & Physics, vol. 119, pp. 104025, 2023, ISSN: 1350-4533.
@article{timoteo_skin_2023,
title = {Skin deformation analysis for pre-operative planning of DIEAP flap reconstruction surgery},
author = {Rafaela Timóteo and David Pinto and Marta Martinho and Pedro Gouveia and Daniel Simões Lopes and Carlos Mavioso and Maria João Cardoso},
url = {https://www.sciencedirect.com/science/article/pii/S1350453323000802},
doi = {https://doi.org/10.1016/j.medengphy.2023.104025},
issn = {1350-4533},
year = {2023},
date = {2023-01-01},
journal = {Medical Engineering & Physics},
volume = {119},
pages = {104025},
abstract = {Deep inferior epigastric artery perforator (DIEAP) flap reconstruction surgeries can potentially benefit from augmented reality (AR) in the context of surgery planning and outcomes improvement. Although three-dimensional (3D) models help visualize and map the perforators, the anchorage of the models to the patient's body during surgery does not consider eventual skin deformation from the moment of computed tomography angiography (CTA) data acquisition until the position of the patient while in surgery. In this work, we compared the 3D deformation registration from supine arms down (CTA position) to supine with arms at 90° degrees (surgical position), estimating the patient's skin deformation. We processed the data sets of 20 volunteers with a 3D rigid registration tool and performed a descriptive statistical analysis and statistical inference. With 2.45 mm of root mean square and 2.89 mm of standard deviation, results include 30% cases of deformation above 3 mm and 15% above 4 mm. Pose transformation deformation indicates that 3D surface data from the CTA scan position differs from data acquired in loco at the surgical table. Such results indicate that research should be conducted to construct accurate 3D models using CTA data to display on the patient, while considering projection errors when using AR technology.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Deep inferior epigastric artery perforator (DIEAP) flap reconstruction surgeries can potentially benefit from augmented reality (AR) in the context of surgery planning and outcomes improvement. Although three-dimensional (3D) models help visualize and map the perforators, the anchorage of the models to the patient's body during surgery does not consider eventual skin deformation from the moment of computed tomography angiography (CTA) data acquisition until the position of the patient while in surgery. In this work, we compared the 3D deformation registration from supine arms down (CTA position) to supine with arms at 90° degrees (surgical position), estimating the patient's skin deformation. We processed the data sets of 20 volunteers with a 3D rigid registration tool and performed a descriptive statistical analysis and statistical inference. With 2.45 mm of root mean square and 2.89 mm of standard deviation, results include 30% cases of deformation above 3 mm and 15% above 4 mm. Pose transformation deformation indicates that 3D surface data from the CTA scan position differs from data acquired in loco at the surgical table. Such results indicate that research should be conducted to construct accurate 3D models using CTA data to display on the patient, while considering projection errors when using AR technology.
2020
Cesário, Vanessa; Olim, Sandra; Nisi, Valentina
A Natural History Museum Experience: Memories of Carvalhal’s Palace – Turning Point Proceedings
Springer, Cham, vol. 12497, 2020, ISBN: 978-3-030-62515-3.
@proceedings{Cesário2020b,
title = {A Natural History Museum Experience: Memories of Carvalhal’s Palace – Turning Point},
author = {Vanessa Cesário and Sandra Olim and Valentina Nisi},
editor = {Millard David E. Anne-Gwenn Bosser},
url = {https://doi.org/10.1007/978-3-030-62516-0_31},
doi = {10.1007/978-3-030-62516-0_31},
isbn = {978-3-030-62515-3},
year = {2020},
date = {2020-10-27},
booktitle = {Proceedings of the 13th International Conference on Interactive Digital Storytelling (ICIDS ’20)},
issuetitle = {Interactive Storytelling. ICIDS 2020. Lecture Notes in Computer Science},
volume = {12497},
pages = {339-343},
publisher = {Springer, Cham},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
2019
Nisi, Valentina; Cesário, Vanessa; Nunes, Nuno
Augmented Reality Museum’s Gaming for Digital Natives: Haunted Encounters in the Carvalhal’s Palace Proceedings
Springer, Cham, vol. 11863, 2019, ISBN: 978-3-030-34643-0.
@proceedings{Nisi2019,
title = {Augmented Reality Museum’s Gaming for Digital Natives: Haunted Encounters in the Carvalhal’s Palace},
author = {Valentina Nisi and Vanessa Cesário and Nuno Nunes},
editor = {Ellen Yi-Luen Do Stefan Göbel Erik van der Spek},
url = {https://doi.org/10.1007/978-3-030-34644-7_3},
doi = {10.1007/978-3-030-34644-7_3},
isbn = {978-3-030-34643-0},
year = {2019},
date = {2019-11-04},
booktitle = {Entertainment Computing and Serious Games - First IFIP TC 14 Joint International Conference, ICEC-JCSG 2019},
issuetitle = {Proceedings of the Entertainment Computing and Serious Games (ICEC-JCSG ’19)},
volume = {11863},
pages = {28-41},
publisher = {Springer, Cham},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
Cesário, Vanessa; Trindade, Rui; Olim, Sandra; Nisi, Valentina
Memories of Carvalhal’s Palace: Haunted Encounters, a Museum Experience to Engage Teenagers Proceedings
Springer, Cham, vol. 11749, 2019, ISBN: 978-3-030-29389-5.
@proceedings{Cesário2019b,
title = {Memories of Carvalhal’s Palace: Haunted Encounters, a Museum Experience to Engage Teenagers},
author = {Vanessa Cesário and Rui Trindade and Sandra Olim and Valentina Nisi},
editor = {Lennart Nacke Fernando Loizides David Lamas},
url = {https://doi.org/10.1007/978-3-030-29390-1_36},
doi = {10.1007/978-3-030-29390-1_36},
isbn = {978-3-030-29389-5},
year = {2019},
date = {2019-08-23},
booktitle = {Human-Computer Interaction – INTERACT 2019.},
issuetitle = {Proceedings of the 17th International Conference on Human-Computer Interaction (INTERACT ’19) - Lecture Notes in Computer Science book series},
volume = {11749},
pages = {554-557},
publisher = {Springer, Cham},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
2018
Hsieh, Yi-Ta; Orso, Valeria; Andolina, Salvatore; Canaveras, Manuela; Cabral, Diogo; Spagnolli, Anna; Gamberini, Luciano; Jacucci, Giulio
Interweaving Visual and Audio-Haptic Augmented Reality for Urban Exploration Conference
Proceedings of the 2018 Designing Interactive Systems Conference, ACM ACM, New York, NY, USA, 2018, ISBN: 978-1-4503-5198-0.
@conference{10598,
title = {Interweaving Visual and Audio-Haptic Augmented Reality for Urban Exploration},
author = {Yi-Ta Hsieh and Valeria Orso and Salvatore Andolina and Manuela Canaveras and Diogo Cabral and Anna Spagnolli and Luciano Gamberini and Giulio Jacucci},
url = {http://doi.acm.org/10.1145/3196709.3196733},
doi = {10.1145/3196709.3196733},
isbn = {978-1-4503-5198-0},
year = {2018},
date = {2018-01-01},
booktitle = {Proceedings of the 2018 Designing Interactive Systems Conference},
publisher = {ACM},
address = {New York, NY, USA},
organization = {ACM},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
2017
Colley, Ashley; Thebault-Spieker, Jacob; Lin, Allen Yilun; Degraen, Donald; Fischman, Benjamin; Hakkila, Jonna; Kuehl, Kate; Nisi, Valentina; Nunes, Nuno; Wenig, Nina; Wenig, Dirk; Hecht, Brent; Schöning, Johannes
The Geography of PokéMon GO: Beneficial and Problematic Effects on Places and Movement Proceedings
ACM, New York, NY, USA, 2017, ISBN: 978-1-4503-4655-9.
@proceedings{10286,
title = {The Geography of PokéMon GO: Beneficial and Problematic Effects on Places and Movement},
author = {Ashley Colley and Jacob Thebault-Spieker and Allen Yilun Lin and Donald Degraen and Benjamin Fischman and Jonna Hakkila and Kate Kuehl and Valentina Nisi and Nuno Nunes and Nina Wenig and Dirk Wenig and Brent Hecht and Johannes Schöning},
url = {http://doi.acm.org/10.1145/3025453.3025495},
doi = {10.1145/3025453.3025495},
isbn = {978-1-4503-4655-9},
year = {2017},
date = {2017-01-01},
journal = {Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems},
pages = {1179–1192},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
2014
Campos, Pedro; calves, Frederica Gonc; Martins, Michael; Campos, Miguel; Freitas, Paulo
Second Look: Combining Wearable Computing and Crowdsourcing to Support Creative Writing Conference
Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational [Acceptance rate: 25%], NordiCHI textquoteright14 ACM ACM, Helsinki, 2014, ISBN: 978-1-4503-2542-4.
@conference{8662,
title = {Second Look: Combining Wearable Computing and Crowdsourcing to Support Creative Writing},
author = {Pedro Campos and Frederica Gonc calves and Michael Martins and Miguel Campos and Paulo Freitas},
url = {http://doi.acm.org/10.1145/2639189.2670250},
isbn = {978-1-4503-2542-4},
year = {2014},
date = {2014-10-01},
booktitle = {Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational [Acceptance rate: 25%]},
pages = {959–962},
publisher = {ACM},
address = {Helsinki},
organization = {ACM},
series = {NordiCHI textquoteright14},
abstract = {We present "Second Look", a platform for helping people, in particular creative writers, to overcome writertextquoterights block. This ubiquitous platform combines augmented reality (Google Glass and AR markers), ubiquitous computing (mobile phones), and crowdsourcing in order to improve the creativity, focus and performance of creative writers.
A primary challenge in developing and evaluating creativity support tools is that we are not able to detect when a person is being creative. Our approach improves current ones by exploring the "in-the-moment" creativity and supporting it with adaptive ubiquitous technologies that try to keep people in a creative experience peak for a longer period of time},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
We present "Second Look", a platform for helping people, in particular creative writers, to overcome writertextquoterights block. This ubiquitous platform combines augmented reality (Google Glass and AR markers), ubiquitous computing (mobile phones), and crowdsourcing in order to improve the creativity, focus and performance of creative writers.
A primary challenge in developing and evaluating creativity support tools is that we are not able to detect when a person is being creative. Our approach improves current ones by exploring the "in-the-moment" creativity and supporting it with adaptive ubiquitous technologies that try to keep people in a creative experience peak for a longer period of time
A primary challenge in developing and evaluating creativity support tools is that we are not able to detect when a person is being creative. Our approach improves current ones by exploring the "in-the-moment" creativity and supporting it with adaptive ubiquitous technologies that try to keep people in a creative experience peak for a longer period of time
2012
Lee, Chang-Gyu; Oakley, Ian; Ryu, Jeha
Exploring the impact of visual-haptic registration accuracy in augmented reality Proceedings
Springer-Verlag, Berlin, Heidelberg, 2012, ISBN: 978-3-642-31403-2.
@proceedings{8987,
title = {Exploring the impact of visual-haptic registration accuracy in augmented reality},
author = {Chang-Gyu Lee and Ian Oakley and Jeha Ryu},
url = {http://dx.doi.org/10.1007/978-3-642-31404-9_15},
isbn = {978-3-642-31403-2},
year = {2012},
date = {2012-06-01},
journal = {Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part II},
pages = {85–90},
publisher = {Springer-Verlag},
address = {Berlin, Heidelberg},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
2011
Boring, Sebastian; Gehring, Sven; Wiethoff, Alexander; Blöckner, Anna Magdalena; Schöning, Johannes; Butz, Andreas
Multi-user Interaction on Media Facades Through Live Video on Mobile Devices Proceedings
ACM, New York, NY, USA, 2011, ISBN: 978-1-4503-0228-9.
@proceedings{9147b,
title = {Multi-user Interaction on Media Facades Through Live Video on Mobile Devices},
author = {Sebastian Boring and Sven Gehring and Alexander Wiethoff and Anna Magdalena Blöckner and Johannes Schöning and Andreas Butz},
url = {http://doi.acm.org/10.1145/1978942.1979342},
doi = {10.1145/1978942.1979342},
isbn = {978-1-4503-0228-9},
year = {2011},
date = {2011-01-01},
journal = {SIGCHI Conference on Human Factors in Computing Systems},
pages = {2721–2724},
publisher = {ACM},
address = {New York, NY, USA},
abstract = {<p class="rtejustify"><span style="font-size:12px"><span style="color:rgb(0, 0, 0); font-family:verdana,arial,helvetica,sans-serif">The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facadetextquoterights canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.</span></span></p>},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
<p class="rtejustify"><span style="font-size:12px"><span style="color:rgb(0, 0, 0); font-family:verdana,arial,helvetica,sans-serif">The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facadetextquoterights canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.</span></span></p>
Boring, Sebastian; Gehring, Sven; Wiethoff, Alexander; Blöckner, Anna Magdalena; ö, Johannes Sch; Butz, Andreas
Multi-user Interaction on Media Facades Through Live Video on Mobile Devices Proceedings
ACM, New York, NY, USA, 2011, ISBN: 978-1-4503-0228-9.
@proceedings{9147,
title = {Multi-user Interaction on Media Facades Through Live Video on Mobile Devices},
author = {Sebastian Boring and Sven Gehring and Alexander Wiethoff and Anna Magdalena Blöckner and Johannes Sch ö and Andreas Butz},
url = {http://doi.acm.org/10.1145/1978942.1979342},
doi = {10.1145/1978942.1979342},
isbn = {978-1-4503-0228-9},
year = {2011},
date = {2011-01-01},
journal = {SIGCHI Conference on Human Factors in Computing Systems},
pages = {2721–2724},
publisher = {ACM},
address = {New York, NY, USA},
abstract = {<p class="rtejustify"><span style="font-size:12px"><span style="color:rgb(0, 0, 0); font-family:verdana,arial,helvetica,sans-serif">The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facadetextquoterights canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.</span></span></p>},
keywords = {},
pubstate = {published},
tppubtype = {proceedings}
}
<p class="rtejustify"><span style="font-size:12px"><span style="color:rgb(0, 0, 0); font-family:verdana,arial,helvetica,sans-serif">The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facadetextquoterights canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.</span></span></p>
2009
Kruger, A.; Schöning, Johannes; Steinicke, F.; Lochtefeld, M.; Rohs, M.
About Two Physical Interaction Metaphors: Narrowing the Gap between the Real and the Virtual World Conference
Ubiquitous Virtual Reality, 2009. ISUVR textquoteright09. International Symposium on, 2009.
@conference{9321b,
title = {About Two Physical Interaction Metaphors: Narrowing the Gap between the Real and the Virtual World},
author = {A. Kruger and Johannes Schöning and F. Steinicke and M. Lochtefeld and M. Rohs},
year = {2009},
date = {2009-07-01},
booktitle = {Ubiquitous Virtual Reality, 2009. ISUVR textquoteright09. International Symposium on},
pages = {11-14},
abstract = {<p class="rtejustify"><span style="font-size:12px">In this paper we present ideas that can help to close the gap between virtual reality and embedded interaction, which are usually assumed to be the two extremes of a dimension that describes mixed reality interaction. We present our preliminary ideas on surface interaction with stereoscopic data as well as our work on mobile camera-projector units. While the first line of research tries to increase the degree of the interaction experience in virtual worlds, the second uses the physical properties of the real world to enhance the augmented reality experience. The first idea uses the physical world to constraint the interaction in the virtual world. The second idea embeds virtual information into the physical world by respecting its physical properties.</span></p>},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
<p class="rtejustify"><span style="font-size:12px">In this paper we present ideas that can help to close the gap between virtual reality and embedded interaction, which are usually assumed to be the two extremes of a dimension that describes mixed reality interaction. We present our preliminary ideas on surface interaction with stereoscopic data as well as our work on mobile camera-projector units. While the first line of research tries to increase the degree of the interaction experience in virtual worlds, the second uses the physical properties of the real world to enhance the augmented reality experience. The first idea uses the physical world to constraint the interaction in the virtual world. The second idea embeds virtual information into the physical world by respecting its physical properties.</span></p>