7.1.1 OpenVIBE

• Keywords:
  Neurosciences, Interaction, Virtual reality, Health, Real time, Neurofeedback, Brain-Computer Interface, EEG, 3D interaction
• Functional Description:
  OpenViBE is a free and open-source software platform devoted to the design, test and use of Brain-Computer Interfaces (BCI). The platform consists of a set of software modules that can be integrated easily and efficiently to design BCI applications. The key features of OpenViBE software are its modularity, its high performance, its portability, its multiple-user facilities and its connection with high-end/VR displays. The designer of the platform enables users to build complete scenarios based on existing software modules using a dedicated graphical language and a simple Graphical User Interface (GUI). This software is available on the Inria Forge under the terms of the AGPL licence, and it was officially released in June 2009. Since then, the OpenViBE software has already been downloaded more than 60000 times, and it is used by numerous laboratories, projects, or individuals worldwide. More information, downloads, tutorials, videos, documentations are available on the OpenViBE website.
• Release Contributions:

  Added: - Build: conda env for dependency management - Build: OSX support (Intel) except Advanced Visualization - Box: PulseRateCalculator - Box: Asymmetry Index Metabox - CI: gitlab-ci

  Updated: - Box: LDA Classifier scale independant - Box: Classifier trainer randomized k-fold option move from conf to box settings - Dependency: Boost version 1.71 -> 1.77 - Dependency: Eigen version 3.3.7 -> 3.3.8 - Dependency: Expat version 2.1.0 -> 2.5.0 - Dependency: Xerces-C version 3.1.3 -> 3.2.4 - Dependency: OGG version 1.2.1 -> 1.3.4 - Dependency: Vorbis version 1.3.2 -> 1.3.7 - Dependency: Lua version 5.1.4 -> 5.4.6

  Removed: - Build: CMake ExternalProjects dependencies (now in conda) - Build: Scripted dependency management - CI: Jenkins CI (now in gitlab)

• URL:
  http://­openvibe.­inria.­fr
• Publication:
  hal-00477153v1
• Contact:
  Anatole Lecuyer
• Participants:
  Marie-Constance Corsi, Fabrizio De Vico Fallani, Arthur Desbois, Sebastien Rimbert, Axel Bouneau, Laurent Garnier, Tristan Cabel, Marc Mace, Lea Pillette, Anatole Lecuyer, Fabien Lotte, Laurent Bougrain, Théodore Papadopoulo, Thomas Prampart
• Partners:
  INSERM, GIPSA-Lab

7.1.2 Xareus

• Name:
  Xareus
• Keywords:
  Virtual reality, Augmented reality, 3D, 3D interaction, Behavior modeling, Interactive Scenarios
• Scientific Description:
  Xareus mainly contains a scenario engine (#SEVEN) and a relation engine (#FIVE) #SEVEN is a model and an engine based on petri nets extended with sensors and effectors, enabling the description and execution of complex and interactive scenarios #FIVE is a framework for the development of interactive and collaborative virtual environments. #FIVE was developed to answer the need for an easier and a faster design and development of virtual reality applications. #FIVE provides a toolkit that simplifies the declaration of possible actions and behaviours of objects in a VE. It also provides a toolkit that facilitates the setting and the management of collaborative interactions in a VE. It is compliant with a distribution of the VE on different setups. It also proposes guidelines to efficiently create a collaborative and interactive VE.
• Functional Description:
  Xareus is implemented in C# and is available as libraries. An integration to the Unity3D engine, also exists. The user can focus on domain-specific aspects for his/her application (industrial training, medical training, etc) thanks to Xareus modules. These modules can be used in a vast range of domains for augmented and virtual reality applications requiring interactive environments and collaboration, such as in training. The scenario engine is based on Petri nets with the addition of sensors and effectors that allow the execution of complex scenarios for driving Virtual Reality applications. Xareus comes with a scenario editor integrated to Unity 3D for creating, editing and remotely controlling and running scenarios. The relation engine contains software modules that can be interconnected and helps in building interactive and collaborative virtual environments.
• Release Contributions:
  This version contains various bug fixes as well as better performances and memory usage Added : - Decision Trees - Visual Scripting
• URL:
  https://­xareus.­insa-rennes.­fr/
• Publications:
  hal-01147733, hal-01199738, tel-01419698, hal-01086237, hal-01147734
• Contact:
  Valerie Gouranton
• Participants:
  Florian Nouviale, Valerie Gouranton, Bruno Arnaldi, Vincent Goupil, Carl-Johan Jorgensen, Emeric Goga, Adrien Reuzeau, Alexandre Audinot

7.1.3 AvatarReady

• Name:
  A unified platform for the next generation of our virtual selves in digital worlds
• Keywords:
  Avatars, Virtual reality, Augmented reality, Motion capture, 3D animation, Embodiment
• Scientific Description:
  AvatarReady is an open-source tool (AGPL) written in C#, providing a plugin for the Unity 3D software to facilitate the use of humanoid avatars for mixed reality applications. Due to the current complexity of semi-automatically configuring avatars coming from different origins, and using different interaction techniques and devices, AvatarReady aggregates several industrial solutions and results from the academic state of the art to propose a simple and fast way to use humanoid avatars in mixed reality in a seamless way. For example, it is possible to automatically configure avatars from different libraries (e.g., rocketbox, character creator, mixamo), as well as to easily use different avatar control methods (e.g., motion capture, inverse kinematics). AvatarReady is also organized in a modular way so that scientific advances can be progressively integrated into the framework. AvatarReady is furthermore accompanied by a utility to generate ready-to-use avatar packages that can be used on the fly, as well as a website to display them and offer them for download to users.
• Functional Description:
  AvatarReady is a Unity tool to facilitate the configuration and use of humanoid avatars for mixed reality applications. It comes with a utility to generate ready-to-use avatar packages and a website to display them and offer them for download.
• URL:
  https://­gitlab.­inria.­fr/­avatar/­avatarreadypackage
• Contact:
  Ludovic Hoyet

7.2.1 Immerstar

Participants: Florian Nouviale, Ronan Gaugne.

URL: Immersia website

With the two virtual reality technological platforms Immersia and Immermove, grouped under the name Immerstar, the team has access to high-level scientific facilities. This equipment benefits the research teams of the center and has allowed them to extend their local, national and international collaborations. In 2023, the Immersia platform was extended to offer a new space dedicated to scientific experimentations in XR, named ImmerLab (see figure 2, left). A Photography Rig was also installed (see figure 2, right). This system given by Interdigital will allow to explore head/face picture computing and rendering.

Show image description

Immerlab experimental room and Rig installation

Since 2021, Immerstar is granted by a PIA3-Equipex+ funding, CONTINUUM. The CONTINUUM project involves 22 partners and animates a collaborative research infrastructure of 30 platforms located throughout France. Driven by the consortium of Continuum, Immerstar is involved in a new National Research Infrastructure since the end of 2021, which gathers the main platforms of CONTINUUM 25

Immerstar is highly involved in the Continuum project. It hosted the annual plenary meeting in July 2024, joint with a scientific session of the CNRS GDR IG-RV. During the 3 days of the meeting, Immersia presented several demos to the participants. In addition, during the year, Immersia was involved in several remote collaborative tests, with the platforms Tore and Revica in Lille, and TransLife in Compiègne. The tests with the two platforms in Lille were based on a collaborative virtual environment developed in the Hybrid team, in collaboration with the department of digital art in Paris 8 (see figure 3). Another test with Tore in Lille and TransLife in Compiègne was based on the MiddleVR software platform (see figure 4). This French software is deployed in Immerstar since 2013, and we act as bêta testers for this software since its installation.

Immerstar is also involved in EUR Digisport led by University of Rennes, H2020 EU projects GuestXR and ShareSpace, and PIA4 DemoES AIR led by University of Rennes.

After the recruitment of Adrien Reuzeau in october 2023 as a permanent research engineer by the University of Rennes, Immerstar recruited Alexandre Vu on a 2-year research engineer position with University Rennes 2, in January 2024. His role is dedicated to the development of partnership with private entities.

Immersia also hosted teaching activities for students from INSA Rennes, ENS Rennes, University of Rennes, and University Rennes 2.

Show image description

Collaboration between platforms in Continuum with Creative Harmony

Show image description

Collaboration between platforms in Continuum with MiddleVR

8.1.1 The Influence of a prop mass on task performance in Virtual Reality

Participants: Guillaume Moreau [contact].

As Virtual Reality (VR) applications continue to develop further, many questions persist regarding how to optimize user performance in virtual environments. Among the numerous variables that could influence performance, the mass props used within VR applications is particularly noteworthy. This work investigates 43 the influence of the mass of a tool replica on users' performance in a pointing task. A VR within-subject experiment was conducted, with three different weighted replicas, to collect objective and subjective data from participants (see Figure 5). Results suggest that the mass of the replica can influence task performance in terms of error-free selection time, number of errors, and subjective perceptions such as perceived difficulty and cognitive load. Indeed, performance was significantly better when using a lighter replica than a heavier one, and subjective user-experience-related metrics were also significantly improved with a light replica. These results help pave the way for additional research on user performance within virtual environments.

Show image description

Experimental setup

This work was done in collaboration with the INUIT team of the IMT-Atlantique Brest and Clarté.

8.1.2 Influence of rotation gains on unintended positional drift during virtual steering navigation in virtual reality

Participants: Ferran Argelaguet [contact].

Unintended Positional Drift (UPD) is a phenomenon that occurs during navigation in Virtual Reality (VR). It is characterized by the user's unconscious or unintentional physical movements in the workspace while using a locomotion technique (LT) that does not require physical displacement (e.g., steering, teleportation). Recent work showed that some factors, such as the LT used and the type of trajectory, can influence UPD. However, little is known about the influence of rotation gains (commonly used in redirection-based LTs) on UPD during navigation in VR. In this work 30, we conducted two user studies to assess the influence of rotation gains on UPD. In the first study, participants had to perform consecutive turns in a corridor virtual environment. In the second study, participants had to explore a large office floor and collect spheres freely. We compared the conditions between rotation gains and without gains, and we also varied the turning angle to perform the turns while considering factors such as sensitivity to cybersickness and the learning effect. We found that rotation gains and lower turning angles decreased UPD during the first study, but the presence of rotation gains increased UPD in the second study. This work contributes to the understanding of UPD, which tends to be an overlooked topic and discusses the design implications of these results for improving navigation in VR.

This work was done in collaboration with the TU Wien and Telecom SudParis.

8.1.3 Examining the effects of teleportation on semantic memory of a virtual museum compared to natural walking

Participants: Ferran Argelaguet [contact].

Over the past decades there has been extensive research investigating the trade-offs between various Virtual Reality (VR) locomotion techniques. One of the most highly researched techniques is teleportation, due to its ability to quickly traverse large virtual spaces even in limited physical tracking spaces. The majority of teleportation research has been focused on its effects on spatial cognition, such as spatial understanding and retention. However, relatively little is known about whether the use of teleportation in immersive learning experiences can effect the acquisition of semantic knowledge -our knowledge about facts, concepts, and ideas -which is essential for long-term learning. In this work 32 we conducted a human-subject study to investigate the effects of teleportation compared to natural walking on the retention of semantic information about artifacts in a virtual museum. Participants visited unique 3D artifacts accompanied by audio clips and artifact names (see Figure 6). Our results show that participants reached the same semantic memory performance with both locomotion techniques but with different behaviors, self-assessed performance, and preferences. In particular, participants subjectively indicated that they felt that they recalled more semantic memory with walking than teleportation. However, objectively, they spent more time with the artifacts while walking, meaning that they learnt less per a set amount of time than with teleportation. We discuss the relationships, implications, and guidelines for VR experiences designed to help users acquire new knowledge.

Show image description

Photography and VR snapshot of the experimental setup

This work was done in collaboration with the University of Central Florida (SReal team) and the university of Trento.

8.1.4 To use or not to use viewpoint oscillations when walking in VR? State of the art and perspectives

Participants: Yann Moullec, Justine Saint-Aubert, Mélanie Cogné, Anatole Lécuyer [contact].

Viewpoint oscillations are periodic changes in the position and/or orientation of the point of view in a virtual environment. They can be implemented in Virtual Reality (VR) walking simulations to make them feel closer to real walking (see Figure 7. This is especially useful in simulations where users remain in place because of space or hardware constraints. As for today, it remains unclear what exact benefit they bring to user experience during walking simulations, and with what characteristics they should be implemented. To answer these questions, in this work 28 we conducted a systematic literature review focusing on five main dimensions of user experience (walking sensation, vection, cybersickness, presence and embodiment) and discussed 44 articles from the fields of VR, Vision, and Human-Computer Interaction. Overall, the literature suggests that viewpoint oscillations benefit vection, and with less evidence, walking sensation and presence. As for cybersickness, the literature contains contrasted results. Based on these results, we recommend using viewpoint oscillations in applications that require accurate distance or speed perception, or that aim to provide compelling walking simulations without a walking avatar, and a particular attention should be paid to cybersickness. Taken together, this work gives recommendations for enhancing walking simulations in VR, which may be applied to entertainment, virtual visits, and medical rehabilitation.

Show image description

Illustration of head motions while walking

8.1.5 Handing pedagogical scenarios back over to domain experts: A scenario authoring model for VR with pedagogical objectives

Participants: Mathieu Risy, Bruno Arnaldi, Valérie Gouranton [contact].

Teachers and trainers make pedagogical decisions for their training courses, so why not do the same for Virtual Reality (VR) training courses? Virtual Environments for Training (VETs) are becoming prominent educational tools. However, VET models have yet to propose scenario authoring aligned with pedagogical objectives that can account for the diversity of approaches available to teachers. This work 40 proposes a scenario authoring model for VET that directly involves domain experts and validates their pedagogical objectives. In addition, it proposes the coexistence of multiple pedagogical scenarios within the same VET, using three types of scenarios (see Figure 8). The validity of the model is then discussed using a VR welding application as a use case.

Show image description

Schematics of a scenario

8.1.6 Generating and evaluating data of daily activities with an autonomous agent in a virtual smart home

Participants: Lysa Gramoli, Bruno Arnaldi, Valérie Gouranton [contact].

Training machine learning models to identify human behavior is a difficult yet essential task to develop autonomous and adaptive systems such as smart homes. These models require large and diversified amounts of labeled data to be trained effectively. Due to the high variety of home environments and occupant behaviors, collecting datasets that are representative of all possible homes is a major challenge. In addition, privacy and cost are major hurdles to collect real home data. To avoid these difficulties, one solution consists of training these models using purely synthetic data, which can be generated through the simulation of home and their occupants. Two challenges arise from this approach: designing a methodology with a simulation able to generate credible simulated data and evaluating this credibility. In this work 23, we explain the methodology used to generate diversified synthetic data of daily activities, through the combination of an agent model to simulate an occupant, and a simulated 3D house enriched with sensors and effectors to produce such data (see Figure 9). We demonstrate the credibility of the generated synthetic data by comparing their efficacy for training human context understanding models against the efficacy generated by real data. To achieve this, we replicate a real dataset collection setting with our smart home simulator. The occupant is replaced by an autonomous agent following the same experimental protocol used for the real dataset collection. This agent is a BDI-based model enhanced with a scheduler designed to offer a balance between control and autonomy. This balance is useful in synthetic data generation since strong constraints can be imposed on the agent to simulate desired situations while allowing autonomous behaviors outside these constraints to generate diversified data. In our case, the constraints are those imposed during the real dataset collection that we want to replicate. The simulated sensors and effectors were configured to react to the agent's behaviors similarly to the real ones. We experimentally show that data generated from this simulation is valuable for two human context understanding tasks: current human activity recognition and future human activity prediction. In particular, we show that models trained solely with simulated data can give reasonable predictions about real situations occurring in the original dataset.

Show image description

VR environment snapshots

This work was done in collaboration with Orange Labs.

8.1.7 Priming and personality effects on the Sense of Embodiment for human and non-human avatars in Virtual Reality

Participants: Jean-Marie Normand [contact].

The increasingly widespread use of Virtual Reality (VR) technology necessitates a deeper understanding of virtual embodiment and its relationship to human subjectivity. Individual differences and primed perceptual associations that could influence the perception of one’s virtual body remain incompletely explored. In this work 37, we exposed participants to human and nonhuman avatars, with half of the sample experiencing a concept primer beforehand (see Figure 10). We also gathered measurements on subjective traits, in the Multidimensional Assessment of Interoceptive Awareness and the Ten Item Personality Inventory. Results support previous work which suggests greater body ownership in human as opposed to non-human avatars, and suggest that concept priming could have an influence on embodiment and state body mindfulness. Additionally, results highlight an array of personality trait influences on embodiment and body mindfulness measures.

Show image description

VR snapshot of the avatars

This work was done in collaboration with Trinity College Dublin.

8.1.8 Avatar-centered feedback: Dynamic avatar alterations can induce avoidance behaviors to virtual dangers

Participants: Antonin Cheymol, Anatole Lécuyer, Rebecca Fribourg, Jean-Marie Normand, Ferran Argelaguet [contact].

One singularity of VR is its capacity to generate a strong sensation of being present in a dangerous environment, without risking the physical consequences. However, this absence of consequences when interacting with virtual dangers might also limit the induction of realistic responses, such as avoidance behaviors, which are a key factor of various VR applications (e.g., training, journalism, or exposure therapies). To address this limitation, we propose avatar-centered feedback 31, a novel, device-free approach, consisting of dynamically altering the avatar’s appearance and movements to offer coherent feedback from interactions with the virtual environment, including dangers. To begin with, we present a design space clarifying the range of potential implementations for this approach. Then, we tested this approach in a metallurgy scenario, where participants’ virtual hands would redden and display burns as they got closer to a virtual fire (appearance alteration), and simulate short withdrawal reflexes movements when a spark burst next to them (movement alteration)(see Figure 11). Our results show that in comparison to a control group, participants receiving avatar-centered feedback demonstrated significantly more avoidance behaviors to the virtual fire. Interestingly, we also found that experiencing avatar-centered feedback of fire significantly increased avoidance behaviors toward a following danger of different nature (a circular saw). These results suggest that avatar-centered feedback can also impact the general perception of the avatar vulnerability to the virtual environment.

Show image description

Snapshots of the VR environment

8.1.9 Experiencing an elongated limb in virtual reality modifies the tactile distance perception of the corresponding real limb

Participants: François Le Jeune [contact].

In measurement, a reference frame is needed to compare the measured object to something already known. This raises the neuroscientific question of which reference frame is used by humans when exploring the environment. Previous studies suggested that, in touch, the body employed as measuring tool also serves as reference frame. Indeed, an artificial modification of the perceived dimensions of the body changes the tactile perception of external object dimensions. However, it is unknown if such a change in tactile perception would occur when the body schema is modified through the illusion of owning a limb altered in size (see Figure 12). Therefore, employing a virtual hand illusion paradigm with an elongated forearm of different lengths, we systematically tested the subjective perception of distance between two points (tactile distance perception task, TDP task) on the corresponding real forearm following the illusion  26. Thus, TDP task is used as a proxy to gauge changes in the body schema. Embodiment of the virtual arm was found significantly greater after the synchronous visuo-tactile stimulation condition compared to the asynchronous one, and the forearm elongation significantly increased the TDP. However, we did not find any link between the visuo-tactile induced ownership over the elongated arm and TDP variation, suggesting that vision plays the main role in the modification of the body schema. Additionally, the effect of elongation found on TDP but not on proprioception suggests that these are affected differently by body schema modifications. These findings confirm the body schema malleability and its role as reference frame in touch.

Show image description

VR snapshots of elongated arm conditions

This work was done in collaboration with Rome Bio-Medico University.

8.1.10 Preparing users to embody their avatars in VR: Insights on the effects of priming, mental imagery, and acting on embodiment experiences

Participants: Anatole Lécuyer [contact].

Establishing a strong connection between users and their avatars in virtual reality poses an enduring challenge. Despite technical advancements, some users resist their avatars, while others seamlessly accept them as replacements for their bodies. In this work 35, we investigate the feasibility of pre-conditioning users to embrace their avatars prior to immersion. To do so, we propose a user preparation protocol involving three stages: first, users receive information about their avatar's identity, capabilities, and appearance. Next, they engage in a mental imagery exercise, envisioning themselves as their avatar. Finally, they physically impersonate their avatar's character through an acting exercise (see Figure 13). Testing this protocol involved a study with 48 participants embodying an avatar representing the Hulk, with and without preparation. We could not find significant effects of the user preparation on the sense of embodiment, Proteus effects, or affective bond. This prompts further discussion on how users can be primed to accept their avatars as their own bodies, an idea introduced for the first time in this paper.

Show image description

Photographies of the preparation protocol and VR snapshot of a user impersonnating the Hulk

This work was done in collaboration with Inria BIVWAK team, Melbourne University and Nara Institute.

8.1.11 Evaluation of power wheelchair driving performance in simulator compared to driving in real-life situations: the SIMADAPT (simulator ADAPT) project — a pilot study

Participants: Valérie Gouranton [contact].

The objective of this study was to evaluate users’ driving performances with a Power Wheelchair (PWC) driving simulator in comparison to the same driving task in real conditions with a standard power wheelchair. Three driving circuits of progressive difficulty levels (C1, C2, C3) that were elaborated to assess the driving performances with PWC in indoor situations, were used in this study. These circuits have been modeled in a 3D Virtual Environment to replicate the three driving task scenarios in Virtual Reality (VR) (see Figure 14). Users were asked to complete the three circuits with respect to two testing conditions during three successive sessions, i.e. in VR and on a real circuit (R). During each session, users completed the two conditions. Driving performances were evaluated using the number of collisions and time to complete the circuit. In addition, driving ability by Wheelchair Skill Test (WST) and mental load were assessed in both conditions. Cybersickness, user satisfaction and sense of presence were measured in VR. The conditions R and VR were randomized. Thirty-one participants with neurological disorders and expert wheelchair drivers were included in the study. The driving performances between VR and R conditions were statistically different for the C3 circuit but were not statistically different for the two easiest circuits C1 and C2. The results of the WST was not statistically different in C1, C2 and C3. The mental load was higher in VR than in R condition. The general sense of presence was reported as accept- able (mean value of 4.6 out of 6) for all the participants, and the cybersickness was reported as acceptable (SSQ mean value of 4.25 on the three circuits in VR condition). Driving performances were statistically different in the most complicated circuit C3 with an increased number of collisions in VR, but were not statistically different for the two easiest circuits C1 and C2 in R and VR conditions. In addition, there were no significant adverse effects such as cybersickness. The results show the value of the simulator for driving training applications. Still, the mental load was higher in VR than in R condition, thus mitigating the potential for use with people with cognitive disorders 22.

Show image description

Photography and VR snapshot of the experimental setup

This work was done in collaboration with Inria RAINBOW team and the Pôle Saint-Hélier (Rennes CHU hospital).

8.2.1 PalmEx: Adding palmar force-feedback for 3D manipulation with haptic exoskeleton gloves

Participants: Anatole Lécuyer [contact].

Haptic exoskeleton gloves are a widespread solution for providing force-feedback in Virtual Reality (VR), especially for 3D object manipulations. However, they are still lacking an important feature regarding in-hand haptic sensations: the palmar contact. In this work  20, we present PalmEx, a novel approach which incorporates palmar force-feedback into exoskeleton gloves to improve the overall grasping sensations and manual haptic interactions in VR. PalmEx's concept is demonstrated through a self-contained hardware system augmenting a hand exoskeleton with a palmar contact interface physically encountering the users' palm (see Figure 15). We build upon current taxonomies to elicit PalmEx's capabilities for both the exploration and manipulation of virtual objects. We first conduct a technical evaluation optimizing the delay between the virtual interactions and their physical counterparts. We then empirically evaluate PalmEx's proposed design space in a user study (n=12) to assess the potential of a palmar contact for augmenting an exoskeleton. Results show that PalmEx offers the best rendering capabilities to perform believable grasps in VR. PalmEx highlights the importance of the palmar stimulation, and provides a low-cost solution to augment existing high-end consumer hand exoskeletons.

Show image description

Palmex device photography: exosqueleton and encountered-type interface

This work was done in collaboration with Inria RAINBOW team.

8.2.2 Cool me down: Effects of thermal feedback on cognitive stress in virtual reality

Participants: Vincent Philippe, Jeanne Hecquard [contact], Emilie Hummel, Ferran Argelaguet, Marc Macé, Valérie Gouranton, Anatole Lécuyer, Justine Saint-Aubert.

This work 39 investigates the influence of thermal haptic feedback on stress during a cognitive task in virtual reality. We hypothesized that cool feedback would help reduce stress in such task where users are actively engaged. We designed a haptic system using Peltier cells to deliver thermal feedback to the left and right trapezius muscles (see Figure 16). A user study was conducted on 36 participants to investigate the influence of different temperatures (cool, warm, neutral) on users' stress level during mental arithmetic tasks. Results show that the impact of the thermal feedback depends on the participant's temperature preference. Interestingly, a subset of participants (36%) felt less stressed with cool feedback than with neutral feedback but had similar performance levels, and expressed a preference for the cool condition. Emotional arousal also tended to be lower with cool feedback for these participants. This suggests that cool thermal feedback has the potential to induce relaxation in cognitive tasks. Taken together, our results pave the way for further experimentation on the influence of thermal feedback.

Show image description

Experimental setup

This work was done in collaboration with Inria RAINBOW team.

8.2.3 Studying the influence of contact force on thermal perception at the fingertip

Participants: Jeanne Hecquard, Ferran Argelaguet, Justine Saint-Aubert [contact], Marc Macé, Anatole Lécuyer.

This paper 44 investigates the influence of contact force applied to the human's fingertip on the perception of hot and cold temperatures, studying how variations in contact force may affect the sensitivity of cutaneous thermoreceptors or their interpretation. A psychophysical experiment (see Figure 17) involved 18 participants exposed to cold (20 °C) and hot (38 °C) thermal stimuli at varying contact forces, ranging from gentle (0.5 N) to firm (3.5 N) touch. Results show a tendency to overestimate hot temperatures (hot feels hotter than it really is) and underestimate cold temperatures (cold feels colder than it really is) as the contact force increases. This result might be linked to the increase in the fingertip contact area that occurs as the contact force between the fingertip and the plate delivering the stimuli grows.

Show image description

Experimental setup

This work was done in collaboration with Inria RAINBOW team and the University of Pisa.

8.2.4 Warm regards: Influence of thermal haptic feedback during social interactions in VR

Participants: Jeanne Hecquard, Justine Saint-Aubert [contact], Ferran Argelaguet, Anatole Lécuyer, Marc Macé.

In this work 36, we study how thermal haptic feedback can influence social interactions in virtual environments, with an emphasis on persuasion, focus, co-presence, and friendliness. Physical and social warmth have been repeatedly linked in psychological literature, which allows for speculations on the effect of thermal haptics on virtual social interactions. To that effect, we conducted a study on thermal feedback during simulated social interactions with a virtual agent. We tested three conditions: warm, cool, and neutral (see Figure 18). Results showed that warm feedback positively influenced users' perception of the agent and significantly enhanced persuasion and thermal comfort. Multiple users reported the agent feeling less 'robotic' and more 'human' during the warm condition. Moreover, multiple studies have previously shown the potential of vibrotactile feedback for social interactions. A second study thus evaluated the combination of warmth and vibrations for social interactions. The study included the same protocol and three similar conditions: warmth, vibrations, and warm vibrations. Warmth was perceived as more friendly, while warm vibrations heightened the agent's virtual presence and persuasion. These results encourage the study of thermal haptics to support positive social interactions. Moreover, they suggest that some haptic feedback are more suited to certain types of social interactions and communication than others.

Show image description

Experiment conditions

This work was done in collaboration with Inria RAINBOW team.

8.2.5 Towards end-user customization of haptic experiences

Participants: Tom Roy, Yann Glémarec, Ferran Argelaguet [contact].

A Haptic Experience may take many shapes or forms, ranging from simple UI notifications on a phone, to fully immersive multi-sensorial experiences. In this context, dedicated Haptic authoring tools have been flourishing and the literature on Haptic design introduced many concepts and guidelines to improve Haptic Experiences. In this work 41, we propose to go beyond haptic design and explore the potential of end-user customization of Haptic Experiences. First, we discuss and extend a theoretical model of Haptic Experience. We revisit the proposed design parameters to account for the spatialized notion of haptic feedback and study the suitability of these parameters for end-user customization. Then, we detail a user study (n=52) exploring how users can customize different haptic effects (18 different effects) through haptic customization parameters, i.e., intensity and spatial density (see Figure 19). Finally, our results indicate significant variability in these parameters depending on the context and provide directions for future user studies regarding haptic profile design determined by subjective data.

Show image description

Experimental setup and VR snapshots

This work was done in collaboration with Interdigital.

8.3.1 Introducing the use of thermal neurofeedback

Participants: François Le Jeune, Emile Savalle, Anatole Lécuyer, Marc Macé, Léa Pillette [contact].

Motor imagery-based brain-computer interfaces (MI-BCIs) enable users to control digital devices by performing motor imagery tasks while their brain activity is recorded, typically using electroencephalography. Performing MI is challenging, especially for novices. To tackle this challenge, neurofeedback (NFB) training is frequently used and usually relies on visual feedback to help users learn to modulate the activity of their sensorimotor cortex when performing MI tasks. Improving the feedback provided during these training is essential. This study investigates the feasibility and effectiveness of using thermal feedback for MI-based NFB compared to visual feedback (see Figure 20) 46, 47. Thirteen people participated to a NFB training session with visual-only, thermal-only, and combined visuo-thermal feedback. Both visual-only and combined visuo-thermal feedback elicited significantly greater desynchronization over the sensorimotor cortex compared to thermal-only feedback. No significant difference between visual-only and combined visuo-thermal feedback was found, thermal feedback thus not impairing visual feedback. This study outlines the need for further exploration of alternative feedback modalities in BCI research.

Show image description

Experimental setup

This work was done in collaboration with Inria EMPENN team.

8.3.2 Towards electrophysiological measurement of presence in virtual reality through auditory oddball stimuli

Participants: Emile Savalle, Léa Pillette, Kyung-Ho Won, Ferran Argelaguet, Anatole Lécuyer, Marc Macé [contact].

In this work, we present a way of evaluating presence, which is an important aspect of user experience in virtual reality (VR). It corresponds to the illusion of being physically located in a virtual environment (VE). This feeling is usually measured through questionnaires that disrupt presence itself, are subjective and do not allow for real-time measurement. Electroencephalography (EEG), which measures brain activity, is increasingly used to monitor the state of users, especially while immersed in VR. Here we evaluate presence through the measure of the attention dedicated to the real environment via an EEG oddball paradigm (see Figure 21 for the setup) 29, 42. Using breaks in presence, this experimental protocol constitutes an ecological method for the study of presence, as different levels of presence are experienced in an identical VE. Through analysing the EEG data of 18 participants, a significant increase in the neurophysiological reaction to the oddball, i.e. the P300 amplitude, was found in low presence condition compared to high presence condition. This amplitude was significantly correlated with the self-reported measure of presence. Using Riemannian geometry to perform single-trial classification, we present a classification algorithm with 79% accuracy in detecting between two presence conditions. Taken together our results promote the use of EEG and oddball stimuli to monitor presence offline or in real-time without interrupting the user in the VE.

Show image description

Experimental setup

8.3.3 Which imagined sensations mostly impact electrophysiological activity?

Participants: Emile Savalle, Francois Le Jeune, Marc Macé, Léa Pillette [contact].

Motor imagery brain-computer interfaces (MI-BCI) user training aims at teaching people to control their sensorimotor cortex activity using feedback on the latter, often acquired using electroencephalography (EEG). During training, people are mostly asked to focus their imagery on the sensations associated with a movement, though very little is known on the sensations that mostly favor sensorimotor cortex activity. Our goal was to assess the influence of imagining different sensations on EEG data. Thirty participants performed MI tasks involving the following sensations: (i) interoceptive, arising from the muscles, tendons, and joints, (ii) exteroceptive, arising from the skin, such as thermal sensations, or (iii) both interoceptive and exteroceptive (see Figure 22 for the experimental conditions) 49. The results indicate that imagining exteroceptive sensations generates a greater neurophysiological response than imagining interoceptive sensations or both. Imagining external sensations should thus not be neglected in the instructions provided during MI-BCI user training. Our results also confirm the negative influence of mental workload and use of visual imagery on the resulting neurophysiological activity.

Show image description

Table illustrating the experimental conditions

8.3.4 Neuromarkers of real touch vs. illusory touch

Participants: Emile Savalle, Léa Pillette, Kyung-Ho Won, Ferran Argelaguet, Anatole Lécuyer, Marc Macé [contact].

Haptic feedback allows virtual reality (VR) users to physically interact with virtual content. However, due to the limitations on haptic technology, delivering haptic feedback is still challenging [1]. To overcome such limitations, alternative methods leverage visual dominance to induce haptic illusions [2]. A few studies investigated the effects of tactile stimuli on user perception through EEG in VR, such as for texture discrimination [3] or to study social touch [4]. However, there is room for understanding the brain activity during the perception of tactile stimuli within Virtual Environment (VE) [3]. This experimental protocol aims to investigate the brain activity in response to the anticipation and perception of physical and virtual touch, and the impact of the virtual body representation  50. During the experiment, users will be immersed in a virtual environment replicating the real environment, including a desk, their body, and a robotic arm. Touch stimulation will be generated haptically, a gentle physical touch on the back of the hand using a robotic arm (see Figure 23), and/or visually, a visual stimulation matching the motion of the robot in VR. The experiment will have two within-subjects factors. Touch stimulation, either coherent visual and tactile touch feedback or just visual touch; and body representation, realistic human avatar or geometric body representation, as we hypothesize that body representation and ownership will alter the user’s perception. We will study the impact of our design on two aspects: • Anticipation of touch: Brain activity preceding touch using contingent negative variation • Perception of touch: Somatosensory cortex response with somatosensory evoked potential and mirror neuron system activation. Our results could provide insights about perception and anticipation of illusory and real touch by observing relevant neuromarkers.

Show image description

Phtotography of the experimental setup

8.3.5 EEG markers of acceleration perception in virtual reality

Participants: Anatole Lécuyer [contact].

This work 38 investigates neural patterns of acceleration in virtual reality (VR) using electroencephalography (EEG). Participants experienced accelerating white spheres in VR while EEG signals were recorded. Significant EEG differences were found at the fronto-central region between acceleration and slow speed, regardless of direction, and at the central region depending on the acceleration direction. Topographic responses also show differences in spatial patterns between the conditions. These findings give insights into the perception of acceleration in the brain and show potential for passive BCI applications.

This work was done in collaboration with the univerty of Lille and the university of Essex.

8.3.6 Comparing EEG on interaction roles during a motor task

Participants: Kyung-Ho Won, Léa Pillette, Marc Macé, Anatole Lécuyer [contact].

This work compared the electroencephalography (EEG) activity of leaders who moved their hands and followers who followed the leader’s movements (see Figure 24, bottom for the experimental setup). Such interaction is common in hyperscanning studies, but the influence of the leader and follower roles on EEG activity has scarcely been investigated 51. The log band power (LBP) and relative power level (RPL) were compared in theta and alpha bands. As a result, we found that LBP and RPL were higher in the theta band for the follower, which could be related to a greater cognitive load for the follower (see Figure 24, top for the main EEG results). The alpha band presented opposite patterns in LBP and RPL. LBP was higher in alpha for the follower, whereas the RPL was lower. RPL indicates that the alpha power among different bands is lower for the follower, which can be related to attentional suppression in alpha, although the absolute power is higher in the follower. This work indicates that different cognitive workloads are involved depending on the role of the interaction.

Show image description

Main result and setup

8.3.7 Real-Time neurofeedback on Inter-Brain Synchrony: Current states and perspectives

Participants: Kyung-Ho Won, Léa Pillette, Marc Macé, Anatole Lécuyer [contact].

During neurofeedback (NFB) user training, participants learn to control the feedback associated with specific components of their brain activity, also called neuromarkers, to improve the cognitive abilities related to these neuromarkers, such as attention and mental workload. The recent development of methods to record the activity of several people’s brains simultaneously opens up the study of neuromarkers related to social interactions, computed from inter-brain synchrony (IBS). Here, we review the previous articles that trained participants to control electroencephalographic neuromarkers computed from inter-brain metrics (see Figure 25, left for article selection method) 52. The topic remains relatively unexplored as we only identified seven articles in the literature. We specifically studied the characteristics of the user’s training, i.e., instruction, task and feedback, and the neuromarkers used to provide feedback (see Figure 25, right for an example of our results on the feedback that were used). The reported results are promising as four studies including subjective measures of interaction report higher interaction and relationship scores with higher IBS during NFB training. Finally, we draw guidelines, identify open challenges, and suggests recommendations for future studies on this topic.

Show image description

Study selection flowchart (left) and selected studies (right)

8.3.8 Large scale investigation of the effect of gender on mu rhythm suppression in motor imagery brain-computer interfaces

Participants: Léa Pillette [contact].

The utmost issue in Motor Imagery Brain-Computer Interfaces (MI-BCI) is the BCI poor performance known as ‘BCI inefficiency’. Although past research has attempted to find a solution by investigating factors influencing users’ MI-BCI performance, the issue persists. One of the factors that has been studied in relation to MI-BCI performance is gender. Research regarding the influence of gender on a user’s ability to control MI-BCIs remains inconclusive, mainly due to the small sample size and unbalanced gender distribution in past studies. To address these issues and obtain reliable results, this study combined four MI-BCI datasets into one large dataset with 248 subjects and equal gender distribution 24. The datasets included EEG signals from healthy subjects from both gender groups who had executed a right- vs. left-hand motor imagery task following the Graz protocol. The analysis consisted of extracting the Mu Suppression Index from C3 and C4 electrodes and comparing the values between female and male participants. Unlike some of the previous findings which reported an advantage for female BCI users in modulating mu rhythm activity, our results did not show any significant difference between the Mu Suppression Index of both groups, indicating that gender may not be a predictive factor for BCI performance (see Figure 26 for some of our neurophysiological results).

Show image description

Neurophysiological results indicating an absence of significant difference of neurofeedback performances between men and women

This work was done in collaboration with Inria POTIOC team and the university of Tilburg.

8.3.9 Influence of feedback transparency on motor imagery neurofeedback performance

Participants: Léa Pillette [contact].

Neurofeedback (NF) is a cognitive training procedure based on real-time feedback (FB) of a participant’s brain activity that they must learn to self-regulate. It is widely used by athletes as it can increase motor skills. A classical visual FB delivered in a NF task is a filling gauge reflecting a measure of brain activity. This abstract visual FB is not transparently linked—from the subject's perspective—to the task performed (e.g., motor imagery). This may decrease the sense of agency, that is, the participants’ reported control over FB. In these two different experiments, we assessed (i) the influence of FB transparency on NF performance and the role of agency in this relationship (see Figure 27 for the experimental conditions) 21 and (ii) how athlete motor performances influence neurophysiological changes during neurofeedback compared to non athletes 45.

Show image description

Illustration of the experimental protocol

This work was done in collaboration with INCIA and Paris Brain Institute.

8.3.10 Evaluation of multimodal EEG-fNIRS neurofeedback for motor imagery

Participants: Thomas Prampart [contact].

Neurofeedback (NF) enables self-regulation of brain activity through real-time feedback extracted from brain activity measures. Recently, the association of several neuroimaging methods to characterize brain activity has led to growing interest in NF. The integration of various portable recording techniques, such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), respectively based on electrical and hemodynamics activity, could enhance the characterization of brain signals and subsequently improve NF performance. Such multimodal NF could benefit post-stroke motor rehabilitation. Nevertheless, their concomitant use in NF to discriminate specific features of brain activity has not been exhaustively studied. The objective of this study is to evaluate benefits of combining EEG and fNIRS for NF 48. Thirty right-handed participants are undergoing three randomized NF sessions: EEG-only, fNIRS-only, and EEG-fNIRS. EEG (Actichamp, Brain Products) and fNIRS (NIRScout, NIRx) channels are positioned above the primary sensorimotor cortex(see Figure 28 for the EEG and fNIRS montage). A NF score is computed from the right primary motor cortex signal along the 3 different sessions. The participants are presented with a visual representation of a ball along a one-dimension gauge, that moves up by imagining left-hand movements. The association between the score of NF, the neuroimaging modalities and the motor imagery strategy is then analyzed. Data collection is currently ongoing. We hypothesize that presenting the participants with a visual NF representing a score based on both EEG and fNIRS signals will result in higher control of the NF gauge, translating in higher NF scores. Moreover, we expect that multimodal feedback compared to unimodal feedback will enhance task-specific brain activity in both EEG and fNIRS modalities. This study investigates the benefits of combined EEG-fNIRS to provide multimodal NF. With potentially increased neuroplasticity, such system could find applications in clinical contexts, particularly in motor and brain rehabilitation, such as in post-stroke units.

Show image description

EEG and fNIRS montage

This work was done in collaboration with Inria EMPENN team and Rennes CHU hospital.

8.4.1 A dissemination experiment centered on the scientific analysis of a cat mummy

Participants: Ronan Gaugne, Valérie Gouranton [contact].

This study combines virtual reality (VR) and 3D printing to enhance the scientific study of a cat mummy from the Musée des Beaux-Arts in Rennes. Using data collected through X-rays, CT scans, and photogrammetry, two main media were created: a transparent 1:1 scale 3D print revealing the internal structures and an interactive VR experience, Secret of Bastet, allowing users to explore the scientific process (see Figure 29) 34. Presented in 2023 at professional events and in the museum, the project received enthusiastic feedback from participants (83 in total). The two media offer complementary experiences: the 3D print unveils invisible details, while the VR experience provides an educational and narrative immersion. This innovative approach effectively engages the public in scientific discovery.

Show image description

Photography of the experimental setup

This work was done in collaboration with UMR Trajectoires, Orange Labs, Polymoprh, Musée des beaux arts de Rennes and Rennes Métropole.

8.4.2 Do we study an archaeological artifact differently in VR and in reality?

Participants: Maxime Dumonteil, Valérie Gouranton [contact], Marc Macé, Ronan Gaugne.

The use of virtual reality (VR) in archaeological research is increasing year over year. Nevertheless, the influence of VR technologies on researchers' perception and interpretation is frequently overlooked. These device-induced biases require careful consideration and mitigation strategies to ensure the integrity and reliability of archaeological research results. This work 33 aimed at identifying potential interpretation biases introduced by the use of VR tools in this field, by analyzing both eye-tracking patterns and participant's behavior. We designed a user study consisting of an analysis task on a corpus of archaeological artifacts across different modalities: a real environment and two virtual environments, one using a head-mounted device and the other an immersive room (see Figure 30). The aim of this experiment is to compare participants’ behavior (head movements, gaze patterns and task performance) between the three modalities. The main contribution of this work is to design a methodology to generate comparable and consistent results between the data recorded during the experiment in the three different contexts. The results highlight a number of points to watch out when using VR in archaeology for analysis and interpretative purposes.

Show image description

Photography of the experiment in Immersia CAVE

This work was done in collaboration with UMR Trajectoires, Equipex+ Continuum and CNRS AJAX Project.

8.4.3 Collaboration in a virtual reality artwork: co-creation and relaxation beyond technology

Participants: Julien Lomet, Ronan Gaugne, Valérie Gouranton [contact].

Collaborative virtual spaces allow to establish rich relations between involved actors in an artistic perspective. Our work contributes to the design and study of artistic collaborative virtual environments through the presentation of immersive and interactive digital artwork installation, named “Creative Harmony” (see Figure 31). In this project, we explore different levels of collaborations proposed by the “Creative Harmony” environment, and we question the experience and interactivity of several actors immersed in this environment, through different technological implementations 27.

Show image description

Principle of multiple collaborations in Creative Harmony

Nemo.AI Laboratory with InterDigital

Participants: Ferran Argelaguet [contact], Anatole Lécuyer, Yann Glemarrec, Tom Roy, Philippe Clermont de Gallerande.

To engage and employ scientists and engineers across the Brittany region in researching the technologies that will shape the metaverse, Inria, the French National Institute for Research in Digital Science and Technology, and InterDigital, Inc. (NASDAQ:IDCC), a mobile and video technology research and development company, launched the Nemo.AI Common Lab. This public-private partnership is dedicated to leveraging the combined research expertise of Inria and InterDigital labs to foster local participation in emerging innovations and global technology trends. Named after the pioneering Captain Nemo from Jules Verne’s 20,000 leagues under the sea, the Nemo.AI Common Lab aims to equip the Brittany region with resources to pursue cutting edge scientific research and explore the technologies that will define media experiences in the future. The project reflects the recognized importance of artificial intelligence (AI) in enabling new media experiences in a digital and responsible society.

IRT b<>com

Participants: Florian Nouviale, Valérie Gouranton [contact].

Our participation in the IRT b<>com involves using the Xareus software with the project partners.

10.1.1 Visits to international teams

10.2.1 Horizon Europe

10.2.2 H2020 projects

10.2.3 Other european programs/initiatives

10.3.1 ANR

10.3.2 PIA

10.3.3 Inria projects

Rennes Métropole: Voyage du geste

Participants: Valérie Gouranton [contact], Ronan Gaugne, Adrien Reuzeau, Julien Lomet.

• Duration:
  2024 - 2025
• Coordinator:
  UR2 - M2S
• Partners:
  IRISA - Hybrid; IRISA Virtus; Centre Eugène Marquis; Kirae
• Description:
  This project combines digital art, virtual reality, movement sciences and health sciences, with the aim of developing an immersive work of art to help women undergoing treatment for breast cancer, offering them a stimulating experience to help them get back into movement.

11.1.1 Scientific events: organisation

• Hybrid team is organizing IEEE VR'25 conference (1000+ participants) in Saint Malo in March 2025.

11.1.2 Scientific events: selection

11.1.3 Journal

11.1.4 Invited talks

• Mélanie Cogné and Rebecca Fribourg were invited to give a talk at the SOFMER congress on the topic of “Physical medicine and rehabilitation & Virtual Reality (VR), a promising tool for neurological disorders”, Toulouse, Oct. 2024.
• Rebecca Fribourg was invited to give a talk at Laval Virtual on the topic of "Avatars in VR" with Geoffrey Gorisse, Laval, Apr. 2024.
• Valérie Gouranton was invited to give a talk at the AFXR congress on the topic of "Models and Tools for the Production of XR Applications, Focus on Cultural Heritage", Evry, Oct. 2024.

11.1.5 Leadership within the scientific community

• Ferran Argelaguet is member of the ERCIM News board.
• Valérie Gouranton is a Member of the Consortium 3D of TGIR HumaNum.
• Valérie Gouranton is member of the scientific committee of the PEPR ICCARE and the EquipEx+ Continuum.
• Guillaume Moreau is member of Meta Reality Lab Advisory Council and of the PEPR Ensemble Valorisation board. He is also member of the IEEE ISMAR Steering Committee.
• Jean-Marie Normand is co-head of the “Groupe de Travail Réalités Virtuelles” (GT-RV) of the Groupement de Recherche Informatique Géométrique et Graphique, Réalité Virtuelle et visualisation (GdR IG-RV).
• Léa Pillette joined the board of the national BCI association (CORTICO).

11.1.6 Scientific expertise

• Valérie Gouranton is a member of the Conseil National des Universités 27th section (computer science)
• Guillaume Moreau is member of the scientific council of IBISC lab and ENSIEE.
• Rebecca Fribourg is member of the scientific council of Ecole Centrale de Nantes.
• Mélanie Cogné is a member of the Conseil National des Universités 49th section (medicine)

11.1.7 Research administration

• Ferran Argelaguet is member of the scientific committee of the EUR Digisport and the EquipEx+ Continuum.
• Valérie Gouranton is in charge of IRISA's Arts, Culture and Heritage cross-disciplinary unit.
• Valérie Gouranton is the referent for the PEPR Continuum project in the PEPR ICCARE project.
• Marc Macé is member of the competitivity cluster Images & networks.
• Guillaume Moreau is Deputy Dean for Research and Innovation of IMT Atlantique.
• Mélanie Cogné is member of the scientific board of INCR (Institute of Clinical Neurosciences of Rennes).

11.2.1 Teaching

In this section, only courses related to the main research field of Hybrid are listed.

Ferran Argelaguet :

• Master STS Informatique: “Techniques d'Interaction Avancées”, 26h, M2, ISTIC, University of Rennes 1, FR
• Master SIF: “Virtual Reality and Multi-Sensory Interaction”, 8h, M2, INSA Rennes, FR
• Master SIF: “Data Mining and Visualization”, 2h, M2, University of Rennes 1, FR
• Master AI-ViC: “Virtual Reality and 3D Interaction”, 3h, M2, École Polytechnique, FR

Rebecca Fribourg :

• Virtual Reality Major, “C++ Programming for VR”, 20h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Fundamentals of Virtual Reality”, 7h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Advanced Concepts in VR/AR”, 16h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Projects on Virtual Reality”, 15h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Projects in OpenGL C++”, 10h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Immersive Data Visualization”, 12h, M1/M2, École Centrale de Nantes, FR

Ronan Gaugne :

• INSA Rennes: Projects on “Virtual Reality”, 24h, L3, INSA Rennes, FR
• Master Digital Creation: “Virtual Reality”, 6h, M1, University of Rennes 2, FR

Valérie Gouranton :

• Licence: Project on “Virtual Reality”, 28h, L3, responsible of this lecture, INSA Rennes, FR
• Master INSA Rennes: “Virtual Reality”, 22h, M2, INSA Rennes, FR
• Master INSA Rennes: Projects on “Virtual Reality”, 60h, INSA Rennes, FR
• Responsible for international relations, INSA Rennes, Computer science department

Anatole Lécuyer :

• Master AI-ViC: “Haptic Interaction and Brain-Computer Interfaces”, 6h, M2, Ecole Polytechnique, FR
• Master MNRV: “Haptic Interaction”, 9h, M2, ENSAM, Laval, FR
• Master SIBM: “Haptic and Brain-Computer Interfaces”, 4.5h, M2, University of Rennes 1, FR
• Master SIF: “Pseudo-Haptics and Brain-Computer Interfaces”, 6h, M2, INSA Rennes, FR

Jean-Marie Normand :

• Virtual Reality Major, “Computer Graphics”, 24h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Fundamentals of Virtual Reality”, 20h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Computer Vision and Augmented Reality”, 25h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Advanced Concepts in VR/AR”, 24h, M1/M2, École Centrale de Nantes, FR
• Virtual Reality Major, “Projects on Virtual Reality”, 20h, M1/M2, École Centrale de Nantes, FR
• Master MTI3D: “Virtual Embodiment”, 3h, M2, ENSAM Laval, FR

Léa Pillette :

• Master SIBM: “Haptic and Brain-Computer Interfaces”, 4h, M2, University of Rennes 1, FR
• Master students: “Brain-Computer Interfaces”, 4h, M2, IMT Atlanique, Brest, FR
• Master students: “Brain-Computer Interfaces: From theory to practice”, 4h, M2, ESIR, Rennes, FR

Justine Saint-Aubert :

• Master students: “Haptic Interfaces”, 4h, M2, IMT Atlanique, Brest, FR

11.2.2 Supervision

• PhD: Gabriela Herrera Altamira, “Neurofeefdback based on VR and haptics”, Defended in January 2024. Supervised by Laurent Bougrain (LORIA), Stéphanie Fleck (Univ. Lorraine), and Anatole Lécuyer.
• PhD (CIFRE): Nicolas Fourrier “Collaborative and interactive ship outfitting in virtual reality”, Defended in July 2024, Supervised by Jean-Marie Normand (ECN), Guillaume Moreau (IMT Atlantique) and Mustapha Benaouicha (Segula Technologies), in collaboration with Segula Technologies.
• PhD: Emilie Hummel, “Rehabilitation post-Cancer based on VR”, Defended in November 2024, Supervised by Anatole Lécuyer, Valérie Gouranton and Mélanie Cogné.
• PhD: Yann Moullec, “Walking Sensations in VR”, Defended in December 2024, Supervised by Anatole Lécuyer, Justine Saint-Aubert and Mélanie Cogné.
• PhD: Antonin Cheymol, “Body-based Interfaces in Mixed Reality for Urban Applications”, Defended in December 2024, Supervised by Ferran Argelaguet, Jean-Marie Normand (ECN), Anatole Lécuyer and Rebecca Fribourg (ECN).
• PhD in progress: Jeanne Hecquard, “Affective Haptics in Virtual Reality”, Started in October 2022, Supervised by Marc Macé, Anatole Lécuyer, Ferran Argelaguet and Claudio Pacchierotti (Rainbow, Inria).
• PhD in progress: Julien Lomet, “Cocreation of a virtual reality artwork, from the artist to the viewer”, Started in October 2022, Supervised by Cédric Plessiet (Université Paris 8), Valérie Gouranton and Ronan Gaugne.
• PhD in progress: Mathieu Risy, “Pedagogical models in Virtual Reality training environments”, Started in October 2022, Supervised by Valérie Gouranton.
• PhD in progress: Emile Savalle, “Cybersickness assessment in Virtual Reality using Neurophysiology”, Started in October 2022, Supervised by Marc Macé, Anatole Lécuyer, Ferran Argelaguet and Léa Pillette.
• PhD in progress: Sony Saint-Auret, “Collaborative real tennis in virtual reality”, Started in November 2022, Supervised by Valérie Gouranton, Franck Multon and Richard Kulpa (Mimetic, Inria) and Ronan Gaugne.
• PhD in progress (CIFRE): Philippe de Clermont de Gallerande, “Deep-based semantic representation of avatars for virtual reality”, Started in March 2023, Supervised by Ferran Argelaguet, Ludovic Hoyet (Virtus) and in collaboration with InterDigital.
• PhD in progress: Maxime Dumonteil, “Perception of archaeological artefacts”, Started in October 2023, Supervised by Ronan Gaugne, Valérie Gouranton, Marc Macé and Théophane Nicolas (UMR Trajectoires).
• PhD in progress: Julien Manson, “Design of Haptic Interfaces for Supporting Social Interactions in Virtual Reality”, PhD started in October 2023, Supervised by Anatole Lécuyer and Justine Saint-Aubert.
• PhD in progress (CIFRE): Tom Roy, “Modeling Kinesthetic an tactile properties of virtual environments”, Started in October 2023, Supervised by Ferran Argelaguet and in collaboration with InterDigital.
• PhD in progress: Sabrina Toofany, “Study of haptic feedback to foster positive social interactions in virtual reality”, Started in October 2023, Supervised by Anatole Lécuyer, Ferran Argelaguet and Justine Saint-Aubert.
• PhD in progress: Tiffany Aires Da Cruz, “For a perception of monumentality in Eastern Arabia from the Neolithic to the Bronze Age: 3D reconstruction and multidimensional simulation of monuments and landscapes”, Started in October 2024, Supervised by François Giligny (Univ. Paris 1) and Valérie Gouranton.
• PhD in progress: Arthur Audrain, “Understanding and Improving Human Interactions in Social eXtended Reality”, Started in October 2024, Supervised by Ferran Argelaguet and Katja Zibrek (Virtus).
• PhD in progress: Adriana Galan Villamarin, “Designing and evaluating Avatar Embodiment and Proteus effect in Augmented Reality”, Started in October 2024, Supervised by Rebecca Fribourg (ECN), Anatole Lécuyer and Jean-Marie Normand (ECN).
• PhD in progress: Théo Lefeuvre, “Towards innovative neurotechnologies with tactile interfaces”, Started in October 2024, Supervised by Marc Macé, Léa Pillette and Anatole Lécuyer.
• PhD in progress: Nathan Salin, “Shared Immersive Environments for Artistic Co-Creation in Heterogeneous Modalities", Started in October 2024, Supervised by Valérie Gouranton, Florent Bertault (Univ. Lille) and Ronan Gaugne.
• PhD in progress: Juri Yoneyama, “Interacting with Avatars in Virtual and Augmented Reality”, Started in October 2024, Supervised by Ferran Argelaguet, Guillaume Moreau (IMT Atlantique) and Etienne Peillard (IMT Atlantique).
• PhD in progress: Chenyao Li, “Exploring the use of avatars in virtual urban environments”, Started in November 2024, Supervised by Rebecca Fribourg (ECN), Marco Boffi (Università degli Studi di Milano) and Jean-Marie Normand (ECN).
• PhD in progress: Guillaume Vallet, “ Collaborative Immersive Art Performances”, Started in November 2024, Supervised by Florent Bertault (Univ. Lille), Valérie Gouranton and Ronan Gaugne
• PhD in progress: Majd Bitar, “Keeping collaboration along transitions between places in VR”, Started in December 2024, Supervised by Rebecca Fribourg, Jean-Marie Normand, Jean-Phillipe Rivière and Yannick Prié.

11.2.3 Juries

• Ferran Argelaguet was examiner for the PhD thesis of Haoran Yun (Universitat Politècnica de Catalunya).
• Valérie Gouranton was reviewer for the PhD thesis of Florian Ramousse (Univ. Lyon, Clermont-Ferrand), Hugo Le Tarnec (ENIB), Léa Saunier (Univ. Evry) and examiner for the PhD thesis of Inoussa Ouedraogo (Univ. Paris-Saclay) and Ségolène Delamare (Univ. Paris 1, archeology).
• Anatole Lécuyer served in the PhD jury of Loën Boban (EPFL), Caroline Pinte (IRISA), and Tairan Yin (Inria) ; and HDR jury of Cédric Fleury (IMT-A).
• Jean-Marie Normand was reviewer for the PhD thesis of Camille Truong-Allié (Mines Paris-PSL) and jury president of the PhD juries of Louise Dupra (Univ. Savoie Mont-Blanc) and Julien Mercier (Univ. Bretagne Sud).
• Léa Pillette was reviewer for the PhD thesis of Florencia Garro (University of Genova).
• Mélanie Cogné was reviewer for the PhD thesis of Pauline Ali (University of Angers) and the medical PhD thesis of Charlotte Brun (Univ. Rennes), Alya Perthus (Univ. Rennes), Étienne Foussat (Univ. Rennes), and Paul-Emile Villette (Univ. Bordeaux).

International journals

• 20 articleE.Elodie Bouzbib, M.Marc Teyssier, T.Thomas Howard, C.Claudio Pacchierotti and A.Anatole Lécuyer. PalmEx: Adding Palmar Force-Feedback for 3D Manipulation with Haptic Exoskeleton Gloves.IEEE Transactions on Visualization and Computer Graphics307July 2024, 3973-3980HALDOIback to text
• 21 articleC.Claire Dussard, L.Léa Pillette, C.Cassandra Dumas, É.Émeline Pierrieau, L.Laurent Hugueville, B.Brian Lau, C.Camille Jeunet-Kelway and N.Nathalie George. Influence of feedback transparency on motor imagery neurofeedback performance: the contribution of agency.Journal of Neural Engineering21September 2024, 056029HALDOIback to text
• 22 articleB.Bastien Fraudet, E.Emilie Leblong, P.Patrice Piette, B.Benoit Nicolas, V.Valérie Gouranton, M.Marie Babel, L.Louise Devigne, F.François Pasteau and P.Philippe Gallien. Evaluation of power wheelchair driving performance in simulator compared to driving in real-life situations: the SIMADAPT (simulator ADAPT) project—a pilot study.Journal of NeuroEngineering and Rehabilitation2112024, 60HALDOIback to text
• 23 articleL.Lysa Gramoli, J.Julien Cumin, J.Jérémy Lacoche, A.Anthony Foulonneau, B.Bruno Arnaldi and V.Valérie Gouranton. Generating and Evaluating Data of Daily Activities with an Autonomous Agent in a Virtual Smart Home.ACM Transactions on Multimedia Computing, Communications and Applications21December 2024, 1-23HALDOIback to text
• 24 articleV. G.Valentina Gamboa von Groll, N.Nikki Leeuwis, S.Sébastien Rimbert, A.Aline Roc, L.Léa Pillette, F.Fabien Lotte and M.Maryam Alimardani. Large scale investigation of the effect of gender on mu rhythm suppression in motor imagery brain-computer interfaces.Brain-Computer InterfacesMay 2024, 1-11HALDOIback to text
• 25 articleA.Alexandre Kabil, R.Ronan Gaugne and M.Michel Beaudouin-Lafon. CONTINUUM, the French Research Infrastructure for Collaborative Interaction and Visualisation.ERCIM News137May 2024HALback to text
• 26 articleF.François Le Jeune, M.Marco D'Alonzo, V.Valeria Piombino, A.Alessia Noccaro, D.Domenico Formica and G. D.Giovanni Di Pino. Experiencing an elongated limb in virtual reality modifies the tactile distance perception of the corresponding real limb.eNeuro116April 2024HALback to text
• 27 articleJ.Julien Lomet, R.Ronan Gaugne and V.Valérie Gouranton. Collaboration in a virtual reality artwork: co-creation and relaxation beyond technology.ERCIM News137May 2024, 45-47HALback to text
• 28 articleY.Yann Moullec, J.Justine Saint-Aubert, M.Mélanie Cogné and A.Anatole Lécuyer. To use or not to use viewpoint oscillations when walking in VR ? State of the art and perspectives.IEEE Transactions on Visualization and Computer Graphics2024, 1-19HALDOIback to text
• 29 articleE.Emile Savalle, L.Léa Pillette, K.Kyungho Won, F.Ferran Argelaguet, A.Anatole Lécuyer and M.Marc J-M Macé. Towards electrophysiological measurement of presence in virtual reality through auditory oddball stimuli.Journal of Neural Engineering214July 2024, 046015HALDOIback to text

International peer-reviewed conferences

• 30 inproceedingsH.Hugo Brument, A.Arthur Chaminade and F.Ferran Argelaguet. Influence of rotation gains on unintended positional drift during virtual steering navigation in virtual reality.VRST2024 : 30th ACM Symposium on Virtual Reality Software and Technology30th ACM Symposium on Virtual Reality Software and Technology (VRST)8Trier, GermanyACMOctober 2024, 1 - 10HALDOIback to text
• 31 inproceedingsA.Antonin Cheymol, R.Rebecca Fribourg, A.Anatole Lécuyer, J.-M.Jean-Marie Normand and F.Ferran Argelaguet. Avatar-Centered Feedback: Dynamic Avatar Alterations Can Induce Avoidance Behaviors to Virtual Dangers.ISMAR 2024 - IEEE International Symposium on Mixed and Augmented RealitySeattle, WA, United States2024, 1-10HALback to text
• 32 inproceedingsZ.Zubin Datta Choudhary, L.Laur Battiste, R.Rai Syamil, H.Hiro Furuya, F.Ferran Argelaguet, G.Gerd Bruder and G.Greg Welch. Examining the Effects of Teleportation on Semantic Memory of a Virtual Museum Compared to Natural Walking.ICAT-EGVE 2024 - 34th International Conference on Artificial Reality and Telexistence & the 29th Eurographics Symposium on Virtual EnvironmentsTsukuba, Japan2024, 1-10HALback to text
• 33 inproceedingsM.Maxime Dumonteil, V.Valérie Gouranton, M.-M. J.Marc J-M Macé, T.Théophane Nicolas and R.Ronan Gaugne. Do we study an archaeological artifact differently in VR and in reality?ICAT-EGVE 2024 - joint 34th International Conference on Artificial Reality and Telexistence & the 29th Eurographics Symposium on Virtual EnvironmentsTsukuba, Japan2024, 1-9HALback to text
• 34 inproceedingsR.Ronan Gaugne, T.Théophane Nicolas, J.Jérémy Lacoche, F.Fabrice Guichard, O.Odile Hays and V.Valérie Gouranton. A dissemination experiment centered on the scientific analysis of a cat mummy.ISBN 978-1-80327-742-4InART 2024 - 6th International Conference on Innovation in Art Research and TechnologyOslo, Norway2024, 1-3HALback to text
• 35 inproceedingsA.Adélaïde Genay, E.Erika Kimura, M.Martin Hachet, A.Anatole Lécuyer, Y.Yutaro Hirao, M.Monica Perusquia-Hernandez, H.Hideaki Uchiyama and K.Kiyoshi Kiyokawa. Preparing Users to Embody their Avatars in VR: Insights on the Effects of Priming, Mental Imagery, and Acting on Embodiment Experiences.OzCHI 2024 - 36th Australian Conference on Human-Computer InteractionBrisbane, AustraliaOctober 2024HALback to text
• 36 inproceedingsJ.Jeanne Hecquard, J.Justine Saint-Aubert, F.Ferran Argelaguet, C.Claudio Pacchierotti, A.Anatole Lécuyer and M.-M. J.Marc J.-M. Macé. Warm regards: Influence of thermal haptic feedback during social interactions in VR.Proceedings of the 2024 23rd IEEE International Symposium on Mixed and Augmented RealityISMAR 2024 - IEEE International Symposium on Mixed and Augmented RealitySeattle (USA), United StatesIEEEOctober 2024, 1216-1225HALDOIback to text
• 37 inproceedingsD.Darragh Higgins, R.Rachel Mcdonnell and J.-M.Jean-Marie Normand. Priming and personality effects on the Sense of Embodiment for human and non-human avatars in Virtual Reality.ICAT-EGVE 2024 - International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments (2024)Tsukuba, JapanThe Eurographics Association2024, 1-11HALDOIback to text
• 38 inproceedingsG.Gaël van der Lee, F.Francois Cabestaing, A.Anatole Lécuyer, R.Reinhold Scherer and H.Hakim Si-Mohammed. EEG Markers of Acceleration Perception in Virtual Reality.Proceedings of the 9th Graz Brain-Computer Interface Conference 2024BCI 2024 - 9th Graz Brain-Computer Interface ConferenceGraz, AustriaVerlag der Technischen Universität Graz2024, 249-253HALDOIback to text
• 39 inproceedingsV.Vincent Philippe, J.Jeanne Hecquard, E.Emilie Hummel, F.Ferran Argelaguet, M.-M. J.Marc J.-M. Macé, V.Valérie Gouranton, C.Claudio Pacchierotti, A.Anatole Lécuyer and J.Justine Saint-Aubert. Cool Me Down: Effects of Thermal Feedback on Cognitive Stress in Virtual Reality.Lecture Notes in Computer Science (LNCS)Eurohaptics 2024 - 14th International Conference on Human Haptic Sensing and Touch Enabled Computer ApplicationsLecture Notes in Computer Science (LNCS)Lille, France2024, 433-439HALDOIback to text
• 40 inproceedingsM.Mathieu Risy, V.Valérie Gouranton and B.Bruno Arnaldi. Handing Pedagogical Scenarios Back Over To Domain Experts: A Scenario Authoring Model for VR with Pedagogical Objectives.VISIGRAPP 2024 - 19th International Conference on Computer Graphics Theory and Applications, GRAPPRome, Italy2024, 1-12HALback to text
• 41 inproceedingsT.Tom Roy, Y.Yann Glémarec, G.Gurvan Lécuyer, Q.Quentin Galvane, P.Philippe Guillotel and F.Ferran Argelaguet. Towards End-User Customization of Haptic Experiences.EuroHaptics 2024 - 14th International Conference on Human Haptic Sensing and Touch-Enabled Computer ApplicationsLille, France2024, 1-14HALback to text
• 42 inproceedingsE.Emile Savalle, L.Léa Pillette, F.Ferran Argelaguet, A.Anatole Lécuyer and M.-M. J.Marc J.-M. Macé. Measuring presence in a virtual environment using electroencephalography: A study of breaks in presence using an oddball paradigm.10th International BCI Meeting 2023Brussels, BelgiumOpen Access E-Book: Verlag der Technischen Universität GrazJuly 2024HALDOIback to text
• 43 inproceedingsL.Lucas Thomesse, J.Julien Cauquis, E.Etienne Peillard, L.Lionel Dominjon, T.Thierry Duval and G.Guillaume Moreau. The Influence of a Prop Mass on Task Performance in Virtual Reality.ICAT 2024 - 34th International Conference on Artificial Reality and TelexistenceTsukuba, Japan2024, 1-10HALback to text
• 44 inproceedingsD.Danilo Troisi, J.Jeanne Hecquard, F.Ferran Argelaguet, J.Justine Saint-Aubert, M.-M. J.Marc J.-M. Macé, A.Anatole Lécuyer, C.Claudio Pacchierotti and M.Monica Malvezzi. Studying the influence of contact force on thermal perception at the fingertip.Lecture Notes in Computer Science (LNCS)EUROHAPTICS 2024 - 14th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications14769Lille, FranceSpringer2024, 154-161HALDOIback to text

Conferences without proceedings

• 45 inproceedingsM.Margaux Izac, É.Éléa Rossignol, E.Emeline Pierrieau, N.N Grechukhin, E.E Coudroy, B.Bernard N'Kaoua, L.Léa Pillette and C.Camille Jeunet-Kelway. Alpha, Sensorimotor Rhythms and Beta Event-Related Desynchronisation during Kinesthetic Motor Imagery of experts and novices.CORTICO 2024 - Sixième édition des Journées scientifiques du COllectif pour la Recherche Transdisciplinaire sur les Interfaces Cerveau-OrdinateurNancy, FranceMay 2024, 1-1HALback to text
• 46 inproceedingsF.François Le Jeune, E.Emile Savalle, A.Anatole Lécuyer, M.-M. J.Marc J.-M. Macé, P.Pierre Maurel and L.Léa Pillette. Exploring Thermal Feedback in Brain-Computer Interface User Training.CORTICO 2024 - Journées du COllectif pour la Recherche Transdisciplinaire sur les Interfaces Cerveau-OrdinateurNancy, France2024, 1-3HALback to text
• 47 inproceedingsF.François Le Jeune, E.Emile Savalle, A.Anatole Lécuyer, M.-M. J.Marc J.-M. Macé, P.Pierre Maurel and L.Léa Pillette. Introducing the Use of Thermal Neurofeedback.BCI 2024 - 9th Graz Brain-Computer Interface ConferenceGraz, Austria2024, 1-6HALback to text
• 48 inproceedingsC. O.Camille O Muller, T.Thomas Prampart, E.Elise Bannier, I.Isabelle Corouge and P.Pierre Maurel. Evaluation of multimodal EEG-fNIRS neurofeedback for motor imagery.rtFIN 2024 - Real-Time Functional Imaging and Neurofeedback meetingHeidelberg, GermanyNovember 2024HALback to text
• 49 inproceedingsE.Emile Savalle, F.François Le Jeune, L.Léa Driessens, M.-M. J.Marc J.-M. Macé and L.Léa Pillette. Which imagined sensations mostly impact electrophysiological activity?BCI 2024 - 9th Graz Brain-Computer Interface ConferenceGraz, Austria2024, 1-6HALback to text
• 50 inproceedingsE.Emile Savalle, L.Léa Pillette, K.Kyungho Won, F.Ferran Argelaguet, A.Anatole Lécuyer and M.-M. J.Marc J.-M. Macé. Neuromarkers of real touch vs. illusory touch.CORTICO 2024 - Journées du COllectif pour la Recherche Transdisciplinaire sur les Interfaces Cerveau-OrdinateurNancy, France2024, 1-2HALback to text
• 51 inproceedingsK.Kyungho Won, L.Léa Pillette, M.-M. J.Marc J.-M. Macé and A.Anatole Lécuyer. Comparing EEG on interaction roles during a motor task.5th International Neuroergonomics ConferenceBordeaux, France2024, 1-4HALback to text
• 52 inproceedingsK.Kyungho Won, L.Léa Pillette, M.-M. J.Marc J.-M. Macé and A.Anatole Lécuyer. Real-Time Neurofeedback on Inter-Brain Synchrony: Current States and Perspectives.BCI 2024 - 9th Graz Brain-Computer Interface ConferenceGraz, Austria2024, 1-6HALback to text