EN FR
EN FR
RAINBOW - 2025

2025​‌Activity reportProject-TeamRAINBOW​​

RNSR: 201822637G
  • Research center​​​‌ Inria Centre at Rennes​ University
  • In partnership with:​‌CNRS, Institut national des​​ sciences appliquées de Rennes,​​​‌ Université de Rennes
  • Team​ name: Sensor-based Robotics and​‌ Human Interaction
  • In collaboration​​ with:Institut de recherche​​​‌ en informatique et systèmes​ aléatoires (IRISA)

Creation of​‌ the Project-Team: 2018 June​​ 01

Each year, Inria​​​‌ research teams publish an​ Activity Report presenting their​‌ work and results over​​ the reporting period. These​​​‌ reports follow a common​ structure, with some optional​‌ sections depending on the​​ specific team. They typically​​​‌ begin by outlining the​ overall objectives and research​‌ programme, including the main​​ research themes, goals, and​​​‌ methodological approaches. They also​ describe the application domains​‌ targeted by the team,​​ highlighting the scientific or​​​‌ societal contexts in which​ their work is situated.​‌

The reports then present​​ the highlights of the​​​‌ year, covering major scientific​ achievements, software developments, or​‌ teaching contributions. When relevant,​​ they include sections on​​​‌ software, platforms, and open​ data, detailing the tools​‌ developed and how they​​ are shared. A substantial​​​‌ part is dedicated to​ new results, where scientific​‌ contributions are described in​​ detail, often with subsections​​​‌ specifying participants and associated​ keywords.

Finally, the Activity​‌ Report addresses funding, contracts,​​ partnerships, and collaborations at​​​‌ various levels, from industrial​ agreements to international cooperations.​‌ It also covers dissemination​​ and teaching activities, such​​​‌ as participation in scientific​ events, outreach, and supervision.​‌ The document concludes with​​ a presentation of scientific​​​‌ production, including major publications​ and those produced during​‌ the year.

Keywords

Computer​​ Science and Digital Science​​​‌

  • A5.1.2. Evaluation of interactive​ systems
  • A5.1.3. Haptic interfaces​‌
  • A5.1.6. Tangible interfaces
  • A5.1.7.​​ Multimodal interfaces
  • A5.1.9. User​​​‌ and perceptual studies
  • A5.6.​ Virtual reality, augmented reality​‌
  • A5.6.1. Virtual reality
  • A5.6.2.​​ Augmented reality
  • A5.6.3. Avatar​​​‌ simulation and embodiment
  • A5.6.4.​ Multisensory feedback and interfaces​‌
  • A5.9.2. Estimation, modeling
  • A5.10.1.​​ Design
  • A5.10.2. Perception
  • A5.10.3.​​​‌ Planning
  • A5.10.4. Robot control​
  • A5.10.5. Robot interaction (with​‌ the environment, humans, other​​ robots)
  • A5.10.6. Swarm robotics​​​‌
  • A6.4.1. Deterministic control
  • A6.4.3.​ Observability and Controlability
  • A6.4.4.​‌ Stability and Stabilization
  • A6.4.5.​​ Control of distributed parameter​​​‌ systems
  • A6.4.6. Optimal control​
  • A8.2.3. Calculus of variations​‌
  • A9.2. Machine learning
  • A9.5.​​ Robotics and AI
  • A9.7.​​​‌ AI algorithmics
  • A9.9. Distributed​ AI, Multi-agent
  • A9.10. Hybrid​‌ approaches for AI
  • A9.12.4.​​ 3D and spatio-temporal reconstruction​​
  • A9.12.6. Object localization
  • A9.12.7.​​​‌ Visual servoing

Other Research‌ Topics and Application Domains‌​‌

  • B2.5. Handicap and personal​​ assistances
  • B2.5.1. Sensorimotor disabilities​​​‌
  • B2.5.2. Cognitive disabilities
  • B2.5.3.‌ Assistance for elderly
  • B5.1.‌​‌ Factory of the future​​
  • B5.6. Robotic systems
  • B8.1.2.​​​‌ Sensor networks for smart‌ buildings
  • B8.4. Security and‌​‌ personal assistance

1 Team​​ members, visitors, external collaborators​​​‌

Research Scientists

  • Paolo Robuffo‌ Giordano [Team leader‌​‌, CNRS, Senior​​ Researcher, HDR]​​​‌
  • François Chaumette [INRIA‌, Senior Researcher,‌​‌ HDR]
  • Alexandre Krupa​​ [INRIA, Senior​​​‌ Researcher, HDR]‌
  • Claudio Pacchierotti [CNRS‌​‌, Researcher, HDR​​]
  • Esteban Restrepo [​​​‌CNRS, Researcher]‌
  • Marco Tognon [INRIA‌​‌, ISFP, HDR​​]

Faculty Members

  • Marie​​​‌ Babel [INSA RENNES‌, Professor, HDR‌​‌]
  • Vincent Drevelle [​​UNIV RENNES, Associate​​​‌ Professor]
  • Maud Marchal‌ [INSA RENNES,‌​‌ Professor, HDR]​​
  • Éric Marchand [UNIV​​​‌ RENNES, Professor,‌ HDR]

Post-Doctoral Fellows‌​‌

  • Lisa Bachini [INSA​​ RENNES, Post-Doctoral Fellow​​​‌]
  • Tommaso Belvedere [‌CNRS, Post-Doctoral Fellow‌​‌]
  • Pierre-Antoine Cabaret [​​INSA RENNES, Post-Doctoral​​​‌ Fellow, from Sep‌ 2025]
  • Pierre-Antoine Cabaret‌​‌ [INRIA, until​​ Mar 2025]
  • Flavie​​​‌ Durand De Gevigney [‌INSA RENNES, Post-Doctoral‌​‌ Fellow]
  • Martin Jacquet​​ [INRIA, Post-Doctoral​​​‌ Fellow, from Sep‌ 2025]
  • Maxime Manzano‌​‌ [UNIV RENNES,​​ Post-Doctoral Fellow, from​​​‌ Sep 2025]

PhD‌ Students

  • Jose Eduardo Aguilar‌​‌ Segovia [INRIA]​​
  • Lorenzo Balandi [INRIA​​​‌]
  • Maxime Bernard [‌CNRS, until Apr‌​‌ 2025, now postdoc​​ at Inria Lyon]​​​‌
  • Johan Berrier-Gonzalez [IRT‌ JULES VERNE, from‌​‌ Oct 2025]
  • Szymon​​ Bielenin [INRIA]​​​‌
  • Valeria Braglia [CNRS‌, from Feb 2025‌​‌]
  • Grégory Brivady [​​INSA RENNES, from​​​‌ Dec 2025]
  • Jessé‌ De Oliveira Santana Alves‌​‌ [UNIV RENNES]​​
  • Mael Gallois [INRIA​​​‌]
  • Sylvain Jannin [‌CNRS, from Oct‌​‌ 2025]
  • Theo Le​​ Terrier [INSA RENNES​​​‌]
  • Emilie Leblong [‌POLE ST HELIER]‌​‌
  • Maxime Manzano [INSA​​ RENNES, until Aug​​​‌ 2025]
  • Antonio Marino‌ [UNIV RENNES,‌​‌ until Sep 2025]​​
  • Paul Mefflet [Haption​​​‌, CIFRE, until‌ Oct 2025]
  • Phillip‌​‌ Maximilian Mehl [INRIA​​]
  • Lendy Mulot [​​​‌INSA RENNES]
  • Mandela‌ Ouafo Fonkoua [INRIA‌​‌]
  • Jim Pavan [​​INSA RENNES, until​​​‌ Aug 2025]
  • Andrea‌ Perna [CNRS,‌​‌ from Nov 2025]​​
  • Lluis Prior Sancho [​​​‌INRIA]
  • Leon Raphalen‌ [CNRS]
  • Sara‌​‌ Rossi [INSA RENNES​​]
  • Simone Rotondi [​​​‌INRIA, from Nov‌ 2025]
  • Francesco Russo‌​‌ [CNRS, from​​ Dec 2025]

Technical​​​‌ Staff

  • Alessandro Colotti [‌INRIA, Engineer,‌​‌ until Aug 2025]​​
  • Gianluca Corsini [CNRS​​​‌, Engineer]
  • Nicola‌ De Carli [CNRS‌​‌, Engineer, until​​ Jan 2025]
  • Louise​​​‌ Devigne [INSA RENNES‌, Engineer]
  • Samuel‌​‌ Felton [INRIA,​​​‌ Engineer]
  • Marco Ferro​ [CNRS, Engineer​‌]
  • Guillaume Gicquel [​​INSA RENNES, Engineer​​​‌]
  • Fabien Grzeskowiak [​INSA RENNES, Engineer​‌, until Jun 2025​​]
  • Romain Lagneau [​​​‌INRIA, Engineer]​
  • François Pasteau [INSA​‌ RENNES, Engineer]​​
  • Olivier Roussel [INRIA​​​‌, Engineer]
  • Fabien​ Spindler [INRIA,​‌ Engineer]
  • Sebastien Thomas​​ [INRIA, Engineer​​​‌]
  • Thomas Voisin [​INRIA]

Interns and​‌ Apprentices

  • Igor Angelini [​​INRIA, Intern,​​​‌ from Mar 2025 until​ Jul 2025]
  • Alessandro​‌ Borgherini [INRIA,​​ Intern, from Apr​​​‌ 2025 until Sep 2025​]
  • Grégory Brivady [​‌INSA RENNES, until​​ Jul 2025]
  • Emanuele​​​‌ Bua Odetti [INRIA​, Intern, from​‌ Feb 2025 until Jul​​ 2025]
  • Louis Descamps​​​‌ [INRIA, Intern​, from May 2025​‌ until Jul 2025]​​
  • Amirath Fassassi [UNIV​​​‌ RENNES, Intern,​ from May 2025 until​‌ Aug 2025]
  • Giulio​​ Franchi [INRIA,​​​‌ Intern, until Apr​ 2025]
  • Luigi Graziosi​‌ [INRIA, Intern​​, from Apr 2025​​​‌ until Sep 2025]​
  • Francesco Levantino [CNRS​‌, Intern, from​​ May 2025 until Sep​​​‌ 2025]
  • Marco Maffeo​ [CNRS, Intern​‌, from Dec 2025​​]
  • Eileen Mathey [​​​‌INSA RENNES, Intern​, until Jul 2025​‌]
  • Ilaria Pasini [​​INRIA, Intern,​​​‌ until Jun 2025]​
  • Francesca Porro [INRIA​‌, Intern, until​​ Feb 2025]
  • Thomas​​​‌ Zamprogno [CNRS,​ Intern, from Nov​‌ 2025]
  • Jihen Zemzem​​ [UNIV RENNES,​​​‌ Intern, from May​ 2025 until Aug 2025​‌]

Administrative Assistant

  • Hélène​​ de La Ruée [​​​‌UNIV RENNES]

Visiting​ Scientists

  • Luca Cinus [​‌SCUOLA SUPERIORE SANT ANNA​​, from Mar 2025​​​‌ until Aug 2025]​
  • Marco Cognetti [Université​‌ de Toulouse, from​​ Jun 2025 until Jul​​​‌ 2025]
  • Olivier Gassies​ [GASSIES OLIVIER,​‌ from Dec 2025]​​
  • Ekrem Misimi [SINTEF​​​‌, from Feb 2025​ until Jul 2025]​‌
  • Hiroki Ota [NAIST​​, until Mar 2025​​​‌]
  • Unnikrishnan Radhakrishnan [​UNIV AARHUS]
  • Khaled​‌ Wahba [Technische Universität​​ Berlin, from Jul​​​‌ 2025 until Oct 2025​]

2 Overall objectives​‌

The long-term vision of​​ the Rainbow team is​​​‌ to develop the next​ generation of sensor-based robots​‌ able to navigate and/or​​ interact in complex unstructured​​​‌ environments together with human​ users. Clearly, the word​‌ “together”' can have very​​ different meanings depending on​​​‌ the particular context: for​ example, it can refer​‌ to mere co-existence (robots​​ and humans share some​​​‌ space while performing independent​ tasks), human-awareness (the robots​‌ need to be aware​​ of the human state​​​‌ and intentions for properly​ adjusting their actions), or​‌ actual cooperation (robots and​​ humans perform some shared​​​‌ task and need to​ coordinate their actions).

One​‌ could perhaps argue that​​ these two goals are​​​‌ somehow in conflict since​ higher robot autonomy should​‌ imply lower (or absence​​ of) human intervention. However,​​ we believe that our​​​‌ general research direction is‌ well motivated since: (‌​‌i) despite the​​ many advancements in robot​​​‌ autonomy, complex and high-level‌ cognitive-based decisions are still‌​‌ out of reach. In​​ most applications involving tasks​​​‌ in unstructured environments, uncertainty,‌ and interaction with the‌​‌ physical world, human assistance​​ is still necessary, and​​​‌ will most probably be‌ for the next decades.‌​‌ On the other hand,​​ robots are extremely capable​​​‌ of autonomously executing specific‌ and repetitive tasks, with‌​‌ great speed and precision,​​ and of operating in​​​‌ dangerous/remote environments, while humans‌ possess unmatched cognitive capabilities‌​‌ and world awareness which​​ allow them to take​​​‌ complex and quick decisions;‌ (ii)‌​‌ the cooperation between humans​​ and robots is often​​​‌ an implicit constraint of‌ the robotic task itself.‌​‌ Consider for instance the​​ case of assistive robots​​​‌ supporting injured patients during‌ their physical recovery, or‌​‌ human augmentation devices. It​​ is then important to​​​‌ study proper ways of‌ implementing this cooperation; (‌​‌iii)​​ finally, safety regulations can​​​‌ require the presence at‌ all times of a‌​‌ person in charge of​​ supervising and, if necessary,​​​‌ of taking direct control‌ of the robotic workers.‌​‌ For example, this is​​ a common requirement in​​​‌ all applications involving tasks‌ in public spaces, like‌​‌ autonomous vehicles in crowded​​ spaces, or even UAVs​​​‌ when flying in civil‌ airspace such as over‌​‌ urban or populated areas.​​

Within this general picture,​​​‌ the Rainbow activities will‌ be particularly focused on‌​‌ the case of (shared)​​ cooperation between robots and​​​‌ humans by pursuing the‌ following vision: on the‌​‌ one hand, empower robots​​ with a large degree​​​‌ of autonomy for allowing‌ them to effectively operate‌​‌ in non-trivial environments (e.g.,​​ outside completely defined factory​​​‌ settings). On the other‌ hand, include human users‌​‌ in the loop for​​ having them in (partial​​​‌ and bilateral) control of‌ some aspects of the‌​‌ overall robot behavior. We​​ plan to address these​​​‌ challenges from the methodological‌, algorithmic and application-oriented‌​‌ perspectives. The main research​​ axes along which the​​​‌ Rainbow activities will be‌ articulated are: three supporting‌​‌ axes (Optimal and​​ Uncertainty-Aware Sensing; Advanced​​​‌ Sensor-based Control; Haptics‌ for Robotics Applications)‌​‌ that are meant to​​ develop methods, algorithms and​​​‌ technologies for realizing the‌ central theme of Shared‌​‌ Control of Complex Robotic​​ Systems.

3 Research​​​‌ program

3.1 Main Vision‌

The vision of Rainbow‌​‌ (and foreseen applications) calls​​ for several general scientific​​​‌ challenges: (i)‌ high-level of autonomy for‌​‌ complex robots in complex​​ (unstructured) environments, (i​​​‌i) forward interfaces‌ for letting an operator‌​‌ giving high-level commands to​​ the robot, (i​​​‌ii) backward‌ interfaces for informing the‌​‌ operator about the robot​​ `status', (iv​​​‌) user studies for‌ assessing the best interfacing,‌​‌ which will clearly depend​​ on the particular task/situation.​​​‌ Within Rainbow we plan‌ to tackle these challenges‌​‌ at different levels of​​ depth:

  • the methodological and​​​‌ algorithmic side of the‌ sought human-robot interaction will‌​‌ be the main focus​​​‌ of Rainbow. Here, we​ will be interested in​‌ advancing the state-of-the-art in​​ sensor-based online planning, control​​​‌ and manipulation for mobile/fixed​ robots. For instance, while​‌ classically most control approaches​​ (especially those sensor-based) have​​​‌ been essentially reactive,​ we believe that less​‌ myopic strategies based on​​ online/reactive trajectory optimization will​​​‌ be needed for the​ future Rainbow activities. The​‌ core ideas of Model-Predictive​​ Control approaches (also known​​​‌ as Receding Horizon) or,​ in general, numerical optimal​‌ control methods will play​​ a role in the​​​‌ Rainbow activities, for allowing​ the robots to reason/plan​‌ over some future time​​ window and better cope​​​‌ with constraints. We will​ also consider extending classical​‌ sensor-based motion control/manipulation techniques​​ to more realistic scenarios,​​​‌ such as deformable/flexible objects​ (“Advanced Sensor-based Control​‌” axis). Finally, it​​ will also be important​​​‌ to spend research efforts​ into the field of​‌ Optimal Sensing, in​​ the sense of generating​​​‌ (again) trajectories that can​ optimize the state estimation​‌ problem in presence of​​ scarce sensory inputs and/or​​​‌ non-negligible measurement and process​ noises, especially true for​‌ the case of mobile​​ robots (“Optimal and​​​‌ Uncertainty-Aware Sensing” axis).​ We also aim at​‌ addressing the case of​​ coordination between a single​​​‌ human user and multiple​ robots where, clearly, as​‌ explained the autonomy part​​ plays even a more​​​‌ crucial role (no human​ can control multiple robots​‌ at once, thus a​​ high degree of autonomy​​​‌ will be required by​ the robot group for​‌ executing the human commands);​​
  • the interfacing side will​​​‌ also be a focus​ of the Rainbow activities.​‌ As explained above, we​​ will be interested in​​​‌ both the forward (human​ robot) and backward​‌ (robot human) interfaces.​​ The forward interface will​​​‌ be mainly addressed from​ the algorithmic point of​‌ view, i.e., how to​​ map the few degrees​​​‌ of freedom available to​ a human operator (usually​‌ in the order of​​ 3–4) into complex commands​​​‌ for the controlled robot(s).​ This mapping will typically​‌ be mediated by an​​ “AutoPilot” onboard the robot(s)​​​‌ for autonomously assessing if​ the commands are feasible​‌ and, if not, how​​ to least modify them​​​‌ (“Advanced Sensor-based Control​” axis).

    The backward​‌ interface will, instead, mainly​​ consist of a visual/haptic​​​‌ feedback for the operator.​ Here, we aim at​‌ exploiting our expertise in​​ using force cues for​​​‌ informing an operator about​ the status of the​‌ remote robot(s). However, the​​ sole use of classical​​​‌ grounded force feedback devices​ (e.g., the typical force-feedback​‌ joysticks) will not be​​ enough due to the​​​‌ different kinds of information​ that will have to​‌ be provided to the​​ operator. In this context,​​​‌ the recent interest in​ the use of wearable​‌ haptic interfaces is very​​ interesting and will be​​​‌ investigated in depth (these​ include, e.g., devices able​‌ to provide vibro-tactile information​​ to the fingertips, wrist,​​​‌ or other parts of​ the body). The main​‌ challenges in these activities​​ will be the mechanical​​​‌ conception (and construction) of​ suitable wearable interfaces for​‌ the tasks at hand,​​ and in the generation​​ of force cues for​​​‌ the operator: the force‌ cues will be a‌​‌ (complex) function of the​​ robot state, therefore motivating​​​‌ research in algorithms for‌ mapping the robot state‌​‌ into a few variables​​ (the force cues) (“​​​‌Haptics for Robotics Applications‌” axis);

  • the evaluation‌​‌ side that will assess​​ the proposed interfaces with​​​‌ some user studies, or‌ acceptability studies by human‌​‌ subjects. Although this activity​​ will not be a​​​‌ main focus of Rainbow‌ (complex user studies are‌​‌ beyond the scope of​​ our core expertise), we​​​‌ will nevertheless devote some‌ efforts into having some‌​‌ reasonable level of user​​ evaluations by applying standard​​​‌ statistical analysis based on‌ psychophysical procedures (e.g., randomized‌​‌ tests and Anova statistical​​ analysis). This will be​​​‌ particularly true for the‌ activities involving the use‌​‌ of smart wheelchairs, which​​ are intended to be​​​‌ used by human users‌ and operate inside human‌​‌ crowds. Therefore, we will​​ be interested in gaining​​​‌ some level of understanding‌ of how semi-autonomous robots‌​‌ (a wheelchair in this​​ example) can predict the​​​‌ human intention, and how‌ humans can react to‌​‌ a semi-autonomous mobile robot.​​
Figure 1

An illustration of the​​​‌ prototypical activities foreseen in‌ Rainbow in which a‌​‌ human operator is in​​ partial (and high-level) control​​​‌ of single/multiple complex robots‌ performing semi-autonomous tasks

Figure‌​‌ 1: An illustration​​ of the prototypical activities​​​‌ foreseen in Rainbow in‌ which a human operator‌​‌ is in partial (and​​ high-level) control of single/multiple​​​‌ complex robots performing semi-autonomous‌ tasks

Figure 1 depicts‌​‌ in an illustrative way​​ the prototypical activities foreseen​​​‌ in Rainbow. On the‌ righthand side, complex robots‌​‌ (dual manipulators, humanoid, single/multiple​​ mobile robots) need to​​​‌ perform some task with‌ high degree of autonomy.‌​‌ On the lefthand side,​​ a human operator gives​​​‌ some high-level commands and‌ receives a visual/haptic feedback‌​‌ aimed at informing her/him​​ at best of the​​​‌ robot status. Again, the‌ main challenges that Rainbow‌​‌ will tackle to address​​ these issues are (in​​​‌ order of relevance): (‌i) methods and‌​‌ algorithms, mostly based on​​ first-principle modeling and, when​​​‌ possible, on numerical methods‌ for online/reactive trajectory generation,‌​‌ for enabling the robots​​ with high autonomy; (​​​‌ii) design‌ and implementation of visual/haptic‌​‌ cues for interfacing the​​ human operator with the​​​‌ robots, with a special‌ attention to novel combinations‌​‌ of grounded/ungrounded (wearable) haptic​​ devices; (ii​​​‌i) user and‌ acceptability studies.

3.2 Main‌​‌ Components

Hereafter, a summary​​ description of the four​​​‌ axes of research in‌ Rainbow.

3.2.1 Optimal and‌​‌ Uncertainty-Aware Sensing

Future robots​​ will need to have​​​‌ a large degree of‌ autonomy for, e.g., interpreting‌​‌ the sensory data for​​ accurate estimation of the​​​‌ robot and world state‌ (which can possibly include‌​‌ the human users), and​​ for devising motion plans​​​‌ able to take into‌ account many constraints (actuation,‌​‌ sensor limitations, environment), including​​ also the state estimation​​​‌ accuracy (i.e., how well‌ the robot/environment state can‌​‌ be reconstructed from the​​ sensed data). In this​​​‌ context, we will be‌ particularly interested in (‌​‌i) devising trajectory​​​‌ optimization strategies able to​ maximize some norm of​‌ the information gain gathered​​ along the trajectory (and​​​‌ with the available sensors).​ This can be seen​‌ as an instance of​​ Active Sensing, with the​​​‌ main focus on online/reactive​ trajectory optimization strategies able​‌ to take into account​​ several requirements/constraints (sensing/actuation limitations,​​​‌ noise characteristics). We will​ also be interested in​‌ the coupling between optimal​​ sensing and concurrent execution​​​‌ of additional tasks (e.g.,​ navigation, manipulation). (i​‌i) Formal methods​​ for guaranteeing the accuracy​​​‌ of localization/state estimation in​ mobile robotics, mainly exploiting​‌ tools from interval analysis.​​ The interest of these​​​‌ methods is their ability​ to provide possibly conservative​‌ but guaranteed accuracy bounds​​ on the best accuracy​​​‌ one can obtain with​ the given robot/sensor pair,​‌ and can thus be​​ used for planning purposes​​​‌ or for system design​ (choice of the best​‌ sensors for a given​​ robot/task). (ii​​​‌i) Localization/tracking of​ objects with poor/unknown or​‌ deformable shape, which will​​ be of paramount importance​​​‌ for allowing robots to​ estimate the state of​‌ “complex objects” (e.g., human​​ tissues in medical robotics,​​​‌ elastic materials in manipulation)​ for controlling its pose/interaction​‌ with the objects of​​ interest.

3.2.2 Advanced Sensor-based​​​‌ Control

One of the​ main competences of the​‌ previous Lagadic team has​​ been, generally speaking, the​​​‌ topic of sensor-based control​, i.e., how to​‌ exploit (typically onboard) sensors​​ for controlling the motion​​​‌ of fixed/ground robots. The​ main emphasis has been​‌ in devising ways to​​ directly couple the robot​​​‌ motion with the sensor​ outputs in order to​‌ invert this mapping for​​ driving the robots towards​​​‌ a configuration specified as​ a desired sensor reading​‌ (thus, directly in sensor​​ space). This general idea​​​‌ has been applied to​ very different contexts: mainly​‌ standard vision (from which​​ the Visual Servoing keyword),​​​‌ but also audio, ultrasound​ imaging, and RGB-D.

Use​‌ of sensors for controlling​​ the robot motion will​​​‌ also clearly be a​ central topic of the​‌ Rainbow team too, since​​ the use of (especially​​​‌ onboard) sensing is a​ main characteristic of any​‌ future robotics application (which​​ should typically operate in​​​‌ unstructured environments, and thus​ mainly rely on its​‌ own ability to sense​​ the world). We then​​​‌ naturally aim at making​ the best out of​‌ the previous Lagadic experience​​ in sensor-based control to​​​‌ propose new advanced ways​ of exploiting sensed data​‌ for, roughly speaking, controlling​​ the motion of a​​​‌ robot. In this respect,​ we plan to work​‌ on the following topics:​​ (i) “direct/dense​​​‌ methods” which try to​ directly exploit the raw​‌ sensory data in computing​​ the control law for​​​‌ positioning/navigation tasks. The advantages​ of these methods is​‌ the little need for​​ data pre-processing which can​​​‌ minimize feature extraction errors​ and, in general, improve​‌ the overall robustness/accuracy (since​​ all the available data​​​‌ is used by the​ motion controller); (i​‌i) sensor-based interaction​​ with objects of unknown/deformable​​​‌ shapes, for gaining the​ ability to manipulate, e.g.,​‌ flexible objects from the​​ acquired sensed data (e.g.,​​ controlling online a needle​​​‌ being inserted in a‌ flexible tissue); (i‌​‌ii) sensor-based​​ model predictive control, by​​​‌ developing online/reactive trajectory optimization‌ methods able to plan‌​‌ feasible trajectories for robots​​ subject to sensing/actuation constraints​​​‌ with the possibility of‌ (onboard) sensing for continuously‌​‌ replanning (over some future​​ time horizon) the optimal​​​‌ trajectory. These methods will‌ play an important role‌​‌ when dealing with complex​​ robots affected by complex​​​‌ sensing/actuation constraints, for which‌ pure reactive strategies (as‌​‌ in most of the​​ previous Lagadic works) are​​​‌ not effective. Furthermore, the‌ coupling with the aforementioned‌​‌ optimal sensing will also​​ be considered; (i​​​‌v) multi-robot decentralised‌ estimation and control, with‌​‌ the aim of devising​​ again sensor-based strategies for​​​‌ groups of multiple robots‌ needing to maintain a‌​‌ formation or perform navigation/manipulation​​ tasks. Here, the challenges​​​‌ come from the need‌ of devising “simple” decentralized‌​‌ and scalable control strategies​​ under the presence of​​​‌ complex sensing constraints (e.g.,‌ when using onboard cameras,‌​‌ limited fov, occlusions). Also,​​ the need of locally​​​‌ estimating global quantities (e.g.,‌ common frame of reference,‌​‌ global property of the​​ formation such as connectivity​​​‌ or rigidity) will also‌ be a line of‌​‌ active research.

3.2.3 Haptics​​ for Robotics Applications

In​​​‌ the envisaged shared cooperation‌ between human users and‌​‌ robots, the typical sensory​​ channel (besides vision) exploited​​​‌ to inform the human‌ users is most often‌​‌ the force/kinesthetic one (in​​ general, the sense of​​​‌ touch and of applied‌ forces to the human‌​‌ hand or limbs). Therefore,​​ a part of our​​​‌ activities will be devoted‌ to study and advance‌​‌ the use of haptic​​ cueing algorithms and interfaces​​​‌ for providing a feedback‌ to the users during‌​‌ the execution of some​​ shared task. We will​​​‌ consider: (i)‌ multi-modal haptic cueing for‌​‌ general teleoperation applications, by​​ studying how to convey​​​‌ information through the kinesthetic‌ and cutaneous channels. Indeed,‌​‌ most haptic-enabled applications typically​​ only involve kinesthetic cues,​​​‌ e.g., the forces/torques that‌ can be felt by‌​‌ grasping a force-feedback joystick/device.​​ These cues are very​​​‌ informative about, e.g., preferred/forbidden‌ motion directions, but are‌​‌ also inherently limited in​​ their resolution since the​​​‌ kinesthetic channel can easily‌ become overloaded (when too‌​‌ much information is compressed​​ in a single cue).​​​‌ In recent years, the‌ arise of novel cutaneous‌​‌ devices able to, e.g.,​​ provide vibro-tactile feedback on​​​‌ the fingertips or skin,‌ has proven to be‌​‌ a viable solution to​​ complement the classical kinesthetic​​​‌ channel. We will then‌ study how to combine‌​‌ these two sensory modalities​​ for different prototypical application​​​‌ scenarios, e.g., 6-dof teleoperation‌ of manipulator arms, virtual‌​‌ fixtures approaches, and remote​​ manipulation of (possibly deformable)​​​‌ objects; (ii‌) in the particular‌​‌ context of medical robotics,​​ we plan to address​​​‌ the problem of providing‌ haptic cues for typical‌​‌ medical robotics tasks, such​​ as semi-autonomous needle insertion​​​‌ and robot surgery by‌ exploring the use of‌​‌ kinesthetic feedback for rendering​​ the mechanical properties of​​​‌ the tissues, and vibrotactile‌ feedback for providing with‌​‌ guiding information about pre-planned​​​‌ paths (with the aim​ of increasing the usability/acceptability​‌ of this technology in​​ the medical domain); (​​​‌iii)​ finally, in the context​‌ of multi-robot control we​​ would like to explore​​​‌ how to use the​ haptic channel for providing​‌ information about the status​​ of multiple robots executing​​​‌ a navigation or manipulation​ task. In this case,​‌ the problem is (even​​ more) how to map​​​‌ (or compress) information about​ many robots into a​‌ few haptic cues. We​​ plan to use specialized​​​‌ devices, such as actuated​ exoskeleton gloves able to​‌ provide cues to each​​ fingertip of a human​​​‌ hand, or to resort​ to “compression” methods inspired​‌ by the hand postural​​ synergies for providing coordinated​​​‌ cues representative of a​ few (but complex) motions​‌ of the multi-robot group,​​ e.g., coordinated motions (translations/expansions/rotations)​​​‌ or collective grasping/transporting.

3.2.4​ Shared Control of Complex​‌ Robotics Systems

This final​​ and main research axis​​​‌ will exploit the methods,​ algorithms and technologies developed​‌ in the previous axes​​ for realizing applications involving​​​‌ complex semi-autonomous robots operating​ in complex environments together​‌ with human users. The​​ leitmotiv is to realize​​​‌ advanced shared control paradigms,​ which essentially aim at​‌ blending robot autonomy and​​ user's intervention in an​​​‌ optimal way for exploiting​ the best of both​‌ worlds (robot accuracy/sensing/mobility/strength and​​ human's cognitive capabilities). A​​​‌ common theme will be​ the issue of where​‌ to “draw the line”​​ between robot autonomy and​​​‌ human intervention: obviously, there​ is no general answer,​‌ and any design choice​​ will depend on the​​​‌ particular task at hand​ and/or on the technological/algorithmic​‌ possibilities of the robotic​​ system under consideration.

A​​​‌ prototypical envisaged application, exploiting​ and combining the previous​‌ three research axes, is​​ as follows: a complex​​​‌ robot (e.g., a two-arm​ system, a humanoid robot,​‌ a multi-UAV group) needs​​ to operate in an​​​‌ environment exploiting its onboard​ sensors (in general, vision​‌ as the main exteroceptive​​ one) and deal with​​​‌ many constraints (limited actuation,​ limited sensing, complex kinematics/dynamics,​‌ obstacle avoidance, interaction with​​ difficult-to-model entities such as​​​‌ surrounding people, and so​ on). The robot must​‌ then possess a quite​​ large autonomy for interpreting​​​‌ and exploiting the sensed​ data in order to​‌ estimate its own state​​ and the environmental one​​​‌ (“Optimal and Uncertainty-Aware​ Sensing” axis), and​‌ for planning its motion​​ in order to fulfil​​​‌ the task (e.g., navigation,​ manipulation) by coping with​‌ all the robot/environment constraints.​​ Therefore, advanced control methods​​​‌ able to exploit the​ sensory data at its​‌ most, and able to​​ cope online with constraints​​​‌ in an optimal way​ (by, e.g., continuously replanning​‌ and predicting over a​​ future time horizon) will​​​‌ be needed (“Advanced​ Sensor-based Control” axis),​‌ with a possible (and​​ interesting) coupling with the​​​‌ sensing part for optimizing,​ at the same time,​‌ the state estimation process.​​ Finally, a human operator​​​‌ will typically be in​ charge of providing high-level​‌ commands (e.g., where to​​ go, what to look​​​‌ at, what to grasp​ and where) that will​‌ then be autonomously executed​​ by the robot, with​​ possible local modifications because​​​‌ of the various (local)‌ constraints. At the same‌​‌ time, the operator will​​ also receive online visual-force​​​‌ cues informative of, in‌ general, how well her/his‌​‌ commands are executed and​​ if the robot would​​​‌ prefer or suggest other‌ plans (because of the‌​‌ local constraints that are​​ not of the operator's​​​‌ concern). This information will‌ have to be visually‌​‌ and haptically rendered with​​ an optimal combination of​​​‌ cues that will depend‌ on the particular application‌​‌ (“Haptics for Robotics​​ Applications” axis).

4​​​‌ Application domains

The activities‌ of Rainbow fall within‌​‌ the scope of Robotics.​​ Broadly speaking, our main​​​‌ interest is in devising‌ novel/efficient algorithms (for estimation,‌​‌ planning, control, haptic cueing,​​ human interfacing, etc.) that​​​‌ can be general and‌ applicable to many different‌​‌ robotic systems of interest,​​ depending on the particular​​​‌ application/case study. For instance,‌ we plan to consider‌​‌

  • applications involving remote telemanipulation​​ with one or two​​​‌ robot arms, where the‌ arm(s) will need to‌​‌ coordinate their motion for​​ approaching/grasping objects of interest​​​‌ under the guidance of‌ a human operator;
  • applications‌​‌ involving single and multiple​​ mobile robots for spatial​​​‌ navigation tasks (e.g., exploration,‌ surveillance, mapping). In the‌​‌ multi-robot case, the high​​ redundancy of the multi-robot​​​‌ group will motivate research‌ in autonomously exploiting this‌​‌ redundancy for facilitating the​​ task (e.g., optimizing the​​​‌ self-localization of the environment‌ mapping) while following the‌​‌ human commands, and vice-versa​​ for informing the operator​​​‌ about the status of‌ a multi-robot group. In‌​‌ the single robot case,​​ the possible combination with​​​‌ some manipulation devices (e.g.,‌ arms on a wheeled‌​‌ robot) will motivate research​​ into remote tele-navigation and​​​‌ tele-manipulation;
  • applications involving medical‌ robotics, in which the‌​‌ “manipulators” are replaced by​​ the typical tools used​​​‌ in medical applications (ultrasound‌ probes, needles, cutting scalpels,‌​‌ and so on) for​​ semi-autonomous probing and intervention;​​​‌
  • applications involving a direct‌ physical “coupling” between human‌​‌ users and robots (rather​​ than a “remote” interfacing),​​​‌ such as the case‌ of assistive devices used‌​‌ for easing the life​​ of people with disabilities.​​​‌ Here, we will be‌ primarily interested in, e.g.,‌​‌ safety and usability issues,​​ and also touch some​​​‌ aspects of user acceptability.‌

These directions are, in‌​‌ our opinion, very promising​​ since nowadays and future​​​‌ robotics applications are expected‌ to address more and‌​‌ more complex tasks: for​​ instance, it is becoming​​​‌ mandatory to empower robots‌ with the ability to‌​‌ predict the future (to​​ some extent) by also​​​‌ explicitly dealing with uncertainties‌ from sensing or actuation;‌​‌ to safely and effectively​​ interact with human supervisors​​​‌ (or collaborators) for accomplishing‌ shared tasks; to learn‌​‌ or adapt to the​​ dynamic environments from small​​​‌ prior knowledge; to exploit‌ the environment (e.g., obstacles)‌​‌ rather than avoiding it​​ (a typical example is​​​‌ a humanoid robot in‌ a multi-contact scenario for‌​‌ facilitating walking on rough​​ terrains); to optimize the​​​‌ onboard resources for large-scale‌ monitoring tasks; to cooperate‌​‌ with other robots either​​ by direct sensing/communication, or​​​‌ via some shared database‌ (the “cloud”).

While no‌​‌ single lab can reasonably​​​‌ address all these theoretical/algorithmic/technological​ challenges, we believe that​‌ our research agenda can​​ give some concrete contributions​​​‌ to the next generation​ of robotics applications.

5​‌ Social and environmental responsibility​​

5.1 Footprint of research​​​‌ activities

Much of the​ team's work results in​‌ algorithms with low computational​​ costs, allowing them to​​​‌ be run onboard robots​ with limited computational and​‌ energy consumption.

The team​​ is also committed to​​​‌ reducing the carbon footprint​ of its professional travel.​‌ We prioritize low-CO2 transport,​​ such as trains, for​​​‌ attending conferences and meetings​ whenever feasible. This policy​‌ aims to minimize air​​ travel and promote more​​​‌ sustainable mobility within our​ research community.

5.2 Societal​‌ impact of research results​​

The Rainbow activities on​​​‌ assistive robotics are carried​ out in collaboration with​‌ a very wide range​​ of users with a​​​‌ focus on promoting autonomy​ and creating more inclusive​‌ spaces. The work is​​ carried out in conjunction​​​‌ with the social sciences​ using a user-centered design​‌ approach that addresses needs,​​ expectations, barriers to technology​​​‌ use, acceptability, and so​ forth. Evaluations are carried​‌ out with target users​​ in clinical settings, but​​​‌ also in ecological settings​ that can be cultural​‌ sites. For example, we​​ carried out experiments of​​​‌ our shared control wheelchair​ navigation assistance in museums​‌ in Rennes, which allowed​​ to assess the acceptability​​​‌ of the solution among​ users, caregivers, and museum​‌ staff.

All doctoral students​​ systematically undergo training in​​​‌ ethics and scientific integrity.​ In addition, when human​‌ participants are involved in​​ laboratory experiments or clinical​​​‌ trials, we systematically assess​ the risk/benefit balance and​‌ establish risk management measures​​ in the protocol. The​​​‌ team is accustomed to​ working with clinicians to​‌ obtain ethical approvals for​​ clinical trials. Out of​​​‌ the clinical trial scope,​ each protocol is designed​‌ in compliance with the​​ GDPR and with good​​​‌ practices for obtaining ethical​ approvals as well as​‌ recruiting, informing, and obtaining​​ informed consent from participants.​​​‌

6 Highlights of the​ year

  • Marco Tognon :​‌ publication in Science Robotics​​ 41
  • Paolo Robuffo Giordano​​​‌ has been appointed President​ of the “Georges Giralt”'​‌ PhD award committee
  • Paolo​​ Robuffo Giordano co-organized the​​​‌ JNRR 2025 (Journées Nationales​ de la Recherche en​‌ Robotique) at IRISA, Rennes​​
  • Claudio Pacchierotti has been​​​‌ appointed Distinguished Lecturer of​ the IEEE Robotics &​‌ Automation Society for the​​ field of haptics (Region​​​‌ 8: Europe, Middle East​ and Africa, 2025 onwards).​‌
  • Starting of ANR AAPG​​ 2024 PRC project “MATES:​​​‌ Multi-drone-human collaboration teams for​ high-risk assembling and handling​‌ tasks”, coordinated by Claudio​​ Pacchierotti .
  • Maud Marchal​​​‌ has been appointed as​ a Board Member of​‌ the Virtual Worlds Association,​​ representing CNRS and in​​​‌ charge of the Strategic​ Research and Innovation Agenda​‌ document.

6.1 Awards

  • P.-A.​​ Cabaret, co-supervised by M.​​​‌ Babel, M. Marchal and​ C. Pacchierotti, received the​‌ Best PhD award (2025)​​ of IFRATH (Federative Research​​​‌ Institute for Assistive Technologies)​ 80
  • Fabien Grzeskowiak, Emilie​‌ Leblong, Sébastien Thomas, Francois​​ Pasteau, Louise Devigne, Marie​​​‌ Babel, Anne-Hélène Olivier received​ the Best Demo Award​‌ (honorable mention) of IEEE​​ VR Conference 2025, "Power​​ wheelchair driving: a multisensory​​​‌ simulator using VR to‌ learn inrehabilitation centers"
  • Marco‌​‌ Tognon and Phillip Maximilian​​ Mehl obtained the Best​​​‌ Paper Award (AI in‌ Robotics) at the 2025‌​‌ European Robotic Forums 65​​.
  • Maud Marchal obtained​​​‌ Best Presentation Award at‌ ACM Siggraph Motion, Interaction‌​‌ and Games 2025, Zurich,​​ Switzerland 30

7 Latest​​​‌ software developments, platforms, open‌ data

7.1 Latest software‌​‌ developments

7.1.1 HandiViz

  • Name:​​
    Driving assistance of a​​​‌ wheelchair
  • Keywords:
    Health, Persons‌ attendant, Handicap
  • Functional Description:‌​‌

    Preserving the autonomy and​​ the mobility is essential​​​‌ for disabled people well-being.‌ The HandiViz software proposes‌​‌ a semi-autonomous navigation framework​​ of a wheelchair relying​​​‌ on visual servoing along‌ corridors. This control system‌​‌ relies on the combination​​ of two tasks: first​​​‌ the manual steering and‌ second wall avoidance task‌​‌ obtained by a dedicated​​ visual based servoing approach.​​​‌ The idea is then‌ to correct the trajectory‌​‌ indicated by the patient​​ by servoing only the​​​‌ necessary degrees of freedom.‌ This visual servoing process‌​‌ is based on both​​ the vanishing point and​​​‌ wall plane detection. A‌ smooth transition from manual‌​‌ driving to assisted naviga-​​ tion is obtained thanks​​​‌ to an adapted weighting‌ function, thus avoiding discontinuities‌​‌ that can lead to​​ unpleasant experience.

    It has​​​‌ been registered to the‌ APP (“Agence de Protection‌​‌ des Programmes”) as an​​ INSA software (IDDN.FR.001.440021.000.S.P.2013.000.10000) and​​​‌ is under GPL license.‌

  • Contact:
    Marie Babel
  • Participants:‌​‌
    François Pasteau, Marie Babel​​
  • Partner:
    INSA Rennes

7.1.2​​​‌ ViSP

  • Name:
    Visual servoing‌ platform
  • Keywords:
    Computer vision,‌​‌ Robotics, Visual servoing (VS),​​ Visual tracking
  • Scientific Description:​​​‌

    Since 2004, we develop‌ and release ViSP [1],‌​‌ an open source library​​ available from https://­visp.­inria.­fr.​​​‌ ViSP standing for Visual‌ Servoing Platform allows prototyping‌​‌ and developing applications using​​ visual tracking and visual​​​‌ servoing techniques at the‌ heart of the Rainbow‌​‌ research. ViSP was designed​​ to be independent from​​​‌ the hardware, to be‌ simple to use, expandable‌​‌ and cross-platform. ViSP allows​​ designing vision-based tasks for​​​‌ eye-in-hand and eye-to-hand systems‌ from the most classical‌​‌ visual features that are​​ used in practice. It​​​‌ involves a large set‌ of elementary positioning tasks‌​‌ with respect to various​​ visual features (points, segments,​​​‌ straight lines, circles, spheres,‌ cylinders, image moments, pose...)‌​‌ that can be combined​​ together, and image processing​​​‌ algorithms that allow tracking‌ of visual cues (dots,‌​‌ segments, ellipses...), or 3D​​ model-based tracking of known​​​‌ objects or template tracking.‌ Simulation capabilities are also‌​‌ available.

    ViSP also provides​​ an open-source dynamic simulator​​​‌ called FrankaSim based on‌ CoppeliaSim and ROS for‌​‌ the Panda robot from​​ Franka Robotics [2]. The​​​‌ simulator fully integrated in‌ the ViSP ecosystem features‌​‌ a dynamic model that​​ has been accurately identified​​​‌ from a real robot,‌ leading to more realistic‌​‌ simulations. Conceived as a​​ multipurpose research simulation platform,​​​‌ it is well suited‌ for visual servoing applications‌​‌ as well as, in​​ general, for any pedagogical​​​‌ purpose in robotics. All‌ the software, models and‌​‌ CoppeliaSim scenes presented in​​ this work are publicly​​​‌ available under free GPL-2.0‌ license.

    A module dedicated‌​‌ to deep neural networks​​​‌ (DNN) is also available​ to facilitate image classification​‌ and object detection. This​​ module can infer the​​​‌ convolutional networks Faster-RCNN, SSD-MobileNet,​ ResNet 10, Yolo v3,​‌ Yolo v4, Yolo v5,​​ Yolo v7, Yolo v8​​​‌ and Yolo v11, which​ simultaneously predict object boundaries​‌ and prediction scores at​​ each position.

    A new​​​‌ module dedicated to the​ visual tracking of an​‌ object using its model​​ has been introduced. Called​​​‌ RBT for Render-Based-Tracker, it​ enables complex objects to​‌ be localized in real​​ time by robustly combining​​​‌ geometric features, colour-based features​ and depth map features​‌ in the minimisation process.​​ We also introduced Python​​​‌ bindings to populate ViSP​ into the vision and​‌ robotics community.

    [1] E.​​ Marchand, F. Spindler, F.​​​‌ Chaumette. ViSP for visual​ servoing: a generic software​‌ platform with a wide​​ class of robot control​​​‌ skills. IEEE Robotics and​ Automation Magazine, Special Issue​‌ on "Software Packages for​​ Vision-Based Control of Motion",​​​‌ P. Oh, D. Burschka​ (Eds.), 12(4):40-52, December 2005.​‌ URL: https://hal.inria.fr/inria-00351899v1

    [2] A.​​ A. Oliva, F. Spindler,​​​‌ P. Robuffo Giordano and​ F. Chaumette. ‘FrankaSim: A​‌ Dynamic Simulator for the​​ Franka Emika Robot with​​​‌ Visual-Servoing Enabled Capabilities’. In:​ ICARCV 2022 - 17th​‌ International Conference on Control,​​ Automation, Robotics and Vision.​​​‌ Singapore, Singapore, 11th Dec.​ 2022, pp. 1–7. URL:​‌ https://hal.inria.fr/hal-03794415.

  • Functional Description:
    ViSP​​ provides simple ways to​​​‌ integrate and validate new​ algorithms with already existing​‌ tools. It follows a​​ module-based software engineering design​​​‌ where data types, algorithms,​ sensors, viewers and user​‌ interaction are made available.​​ Written in C++, ViSP​​​‌ is based on open-source​ cross-platform libraries (such as​‌ OpenCV) and builds with​​ CMake. Several platforms are​​​‌ supported, including OSX, iOS,​ Windows and Linux. ViSP​‌ online documentation allows to​​ ease learning. More than​​​‌ 307 fully documented classes​ organized in 18 different​‌ modules, with more than​​ 475 examples and 114​​​‌ tutorials are proposed to​ the user. ViSP is​‌ released under a dual​​ licensing model. It is​​​‌ open-source with a GNU​ GPLv2 or GPLv3 license.​‌ A professional edition license​​ that replaces GNU GPL​​​‌ is also available.
  • URL:​
  • Contact:
    Fabien Spindler​‌
  • Participant:
    5 anonymous participants​​

7.1.3 DIARBENN

  • Name:
    Obstacle​​​‌ avoidance through sensor-based servoing​
  • Keywords:
    Servoing, Shared control,​‌ Navigation
  • Functional Description:

    Diarbenn​​ is a semi-autonomous robotic​​​‌ assistance module for elec-​ tric wheelchairs (EW), i.e.,​‌ a control system shared​​ with the user. This​​​‌ module is designed to​ accessorize Powered wheelchair (PWC)​‌ to improve safety conditions​​ when driving. The device​​​‌ consists of several sensor​ boxes and a control​‌ box. The sensor boxes​​ measure the distances around​​​‌ the PWC. The measurements​ from the sensor boxes​‌ are then processed by​​ the control box to​​​‌ ensure safe operation of​ the PWC.

    Speed Constraint​‌ of the PWC are​​ calculated based on distances​​​‌ measured around the wheelchair.​ These constraints, derived from​‌ the environment, are then​​ merged with the user’s​​​‌ command (data from the​ control box) in order​‌ to recalculate the speed​​ to be applied to​​​‌ the wheelchair to gradually​ modify its trajectory and​‌ avoid collisions with the​​ environment, while respecting the​​ user’s intention as closely​​​‌ as possible. With the‌ module activated, the PWC‌​‌ will stop when it​​ approaches an obstacle at​​​‌ a desired distance. In‌ the event of an‌​‌ oblique approach, the PWC​​ will autonomously bypass the​​​‌ obstacle by running alongside‌ it. At any time,‌​‌ the user can interrupt​​ the assisted maneuver by​​​‌ releasing the control, as‌ with a traditional PWC.‌​‌ In addition, these sensors​​ have been designed and​​​‌ positioned to be protected‌ or resistant to collisions‌​‌ with the environment. Their​​ robustness has been proven​​​‌ in laboratory tests.

  • Contact:‌
    Marie Babel
  • Participant:
    3‌​‌ anonymous participants
  • Partner:
    INSA​​ Rennes

7.1.4 telekyb3

  • Name:​​​‌
    Free and open source‌ collection of software for‌​‌ Unmanned Aerial Vehicles (UAVs)​​
  • Keyword:
    Robot system
  • Functional​​​‌ Description:

    The main features‌ of telekyb3 include access‌​‌ to all low-level components​​ and closed-loop control of​​​‌ each robot actuator—critical elements‌ for research in aerial‌​‌ physical interaction and manipulation.​​

    Moreover, it is designed​​​‌ with a strong focus‌ on modularity and code‌​‌ reusability. Components use and​​ provide common interfaces, which​​​‌ makes it possible to‌ easily swap between interface-compatible‌​‌ modules. Additionally, the framework​​ is designed to be​​​‌ middleware-independent: users need only‌ focus on writing the‌​‌ code related to their​​ chosen algorithm, while the​​​‌ remaining boilerplate required to‌ run it is automatically‌​‌ generated for the target​​ middleware (e.g., ROS, YARP,​​​‌ pocolibs).

    Lastly, it can‌ support a wide variety‌​‌ of aerial robots: it​​ allows controlling not only​​​‌ one or multiple platforms,‌ but also robots with‌​‌ different actuator configurations.

    The​​ project originally started at​​​‌ LAAS–CNRS in Toulouse in‌ 2015. Over the years,‌​‌ the framework has been​​ extensively used within the​​​‌ laboratory, and several researchers‌ who moved to other‌​‌ institutions chose to continue​​ using it for its​​​‌ features, strong modularity, and‌ its ability to adapt‌​‌ easily to evolving research​​ needs.

    Today, IRISA–Inria counts​​​‌ roughly a dozen users‌ and contributors. Since 2023,‌​‌ it has been supporting​​ LAAS in maintaining the​​​‌ software, developing new modules,‌ and adding new features.‌​‌ The framework is now​​ also used by international​​​‌ partners, including the University‌ of Twente and Saxion‌​‌ University of Applied Sciences​​ in the Netherlands, and​​​‌ University College London in‌ the United Kingdom.

  • URL:‌​‌
  • Contact:
    Gianluca Corsini​​
  • Partner:
    CNRS

7.2 New​​​‌ platforms

The platforms described‌ in the next sections‌​‌ are labeled by the​​ University of Rennes and​​​‌ are parts of the‌ French Research Infrastructure ROBOTEX‌​‌ 2.0 labeled by the​​ French Ministry of Research.​​​‌

7.2.1 Robot Vision Platform‌

Participants: François Chaumette,‌​‌ Eric Marchand, Fabien​​ Spindler [contact].

We​​​‌ are using an industrial‌ robot built by Afma‌​‌ Robots in the nineties​​ to validate our research​​​‌ in visual servoing and‌ active vision. This robot‌​‌ is a 6 DoF​​ Gantry on which it​​​‌ is possible to mount‌ a gripper and an‌​‌ RGB-D camera on its​​ end effector (see Fig.​​​‌ 2). This equipment‌ is mainly used to‌​‌ validate vision-based visual servoing​​ and real-time tracking algorithms.​​​‌

In 2025, this platform‌ has been used to‌​‌ validate experimental results in​​​‌ 1 accepted publication 23​.

Figure 2

In this image​‌ we can see our​​ Gantry robot.

Figure 2​​​‌: Rainbow robotics platform​ for vision-based manipulation

7.2.2​‌ Mobile Robots

Participants: Marie​​ Babel, François Pasteau​​​‌, Fabien Spindler [contact]​.

To validate our​‌ research in personally assisted​​ living topic (see Sect.​​​‌ 8.3.2), we have​ now five electric wheelchairs​‌ (see Fig. 3.a).​​ The control of the​​​‌ wheelchair is performed using​ a plug and play​‌ system between the joystick​​ and the low level​​​‌ control of the wheelchair.​ Such a system lets​‌ us acquire the user​​ intention through the joystick​​​‌ position and control the​ wheelchair by applying corrections​‌ to its motion. The​​ wheelchairs have been fitted​​​‌ with cameras, ultrasound and​ time of flight sensors​‌ to perform the required​​ servoing for assisting handicapped​​​‌ people. A wheelchair haptic​ simulator completes this platform​‌ to develop new human​​ interaction strategies in a​​​‌ virtual reality environment (see​ Fig. 3.b). Moreover,​‌ for fast prototyping of​​ multi-robot control algorithms, since​​​‌ end of 2025 the​ platform provides about ten​‌ DJI RoboMaster S1 mobile​​ ground robots (see Fig.​​​‌ 3.c).

In 2025,​ these robots were used​‌ to obtain experimental results​​ presented in 1 PhD​​​‌ thesis 75 and in​ multiple papers 17,​‌ 19, 31,​​ 59, 62,​​​‌ 63.

In the left​‌ image, our wheelchairs from​​ Permobil, Sunrise and YouQ.​​​‌ In the middle image​ our wheelchair simulator. In​‌ the next image, one​​ of our DJI RoboMaster​​​‌ S1 ground mobile robot.​

Figure 3: Mobile​‌ Robot Platform. a) wheelchairs​​ from Permobil, Sunrise and​​​‌ YouQ, b) Wheelchair haptic​ simulator, c) DJI RoboMaster​‌ mobile robot

7.2.3 Advanced​​ Manipulation Platform

Participants: Alexandre​​​‌ Krupa, Claudio Pacchierotti​, Paolo Robuffo Giordano​‌, François Chaumette,​​ Fabien Spindler [contact].​​​‌

This platform consists of​ by 2 Panda lightweight​‌ 7 DoF arms from​​ Franka Emika and 1​​​‌ from Franka Robotics acquired​ end of 2025. They​‌ are equipped with torque​​ sensors in all seven​​​‌ axes. The following end​ effectors can be mounted​‌ on the robot: an​​ electric gripper, a camera,​​​‌ a soft hand from​ qbrobotics (see Fig. 4​‌.a) and a Reflex​​ TakkTile 2 gripper from​​​‌ RightHand Labs. A​ force-torque sensor from Alberobotics​‌ is also attached to​​ one of the robots​​​‌ end effector to provide​ greater accuracy in torque-controlled​‌ tasks.

Two Adept 6-DoFs​​ arms (one Viper 650​​​‌ robot and one Viper​ 850 robot) and a​‌ 6-DoFs Universal Robots UR5​​ complete this platform category.​​​‌

Moreover, since June 2025,​ the platform has been​‌ supplemented by the acquisition​​ of a new TRIAGo​​​‌ robot from the company​ PAL Robotics (see Fig.​‌ 4.b). This robot​​ is unique in the​​​‌ world. It was funded​ by the TIRREX Equipex​‌ and by Inria. It​​ consists of a holonomic​​​‌ mobile base, on top​ of which sits a​‌ motorized torso, to which​​ three 7-degree-of-freedom arms are​​​‌ attached. The end-effectors of​ these arms are modular​‌ and can be equipped​​ with ATI force sensors​​ and Allegro hands whose​​​‌ phalanges are fitted with‌ Xela tactile sensors. This‌​‌ platform category is mainly​​ used to validate our​​​‌ research in coupling force‌ and vision control when‌​‌ attempting to manipulate deformable​​ and soft objects. Other​​​‌ haptic devices can also‌ be paired to any‌​‌ robot in this category.​​

This platform (see Fig.​​​‌ 4.c) is mainly‌ used to manipulate deformable‌​‌ objects and to validate​​ our activities in coupling​​​‌ force and vision for‌ controlling robot manipulators (see‌​‌ Section 8.3.1) and​​ in controlling the deformation​​​‌ of soft objects (Sect.‌ 8.1.8). Other haptic‌​‌ devices (see Section 8.2​​) can also be​​​‌ coupled to this platform.‌

In 2025, 1 paper‌​‌ 58 and 1 PhD​​ thesis 71 were published​​​‌ including experimental results obtained‌ with this platform.

In the​​ left image our Franka​​​‌ robot equipped with the‌ Pisa SoftHand grasping a‌​‌ box. In the middle​​ image the TRIAGo robot​​​‌ from PAL Robotics. In‌ the right image the‌​‌ 5 arms composing the​​ platform with in the​​​‌ foreground a Franka, in‌ the second plan our‌​‌ two Viper robots, then​​ in the background, a​​​‌ UR 5 arm and‌ our second Franka robot.‌​‌

Figure 4: Rainbow​​ advanced manipulation platform. a)​​​‌ One of the two‌ Panda lightweight arms from‌​‌ Franka Emika, with mounted​​ the Pisa SoftHand, b)​​​‌ the TRIAGo robot from‌ PAL Robotics, c) The‌​‌ 5 arms composing the​​ platform with in the​​​‌ foreground a Franka, in‌ the second plan our‌​‌ two Viper robots, then​​ in the background, a​​​‌ UR 5 arm and‌ our second Franka robot.‌​‌

7.2.4 Unmanned Aerial Vehicles​​ (UAVs)

Participants: Gianluca Corsini​​​‌ [contact], Paolo Robuffo‌ Giordano, Marco Tognon‌​‌, Claudio Pacchierotti,​​ Fabien Spindler, Esteban​​​‌ Restrepo.

Rainbow is‌ involved in several activities‌​‌ concerning conception, modelling, control​​ and perception for single​​​‌ and multiple aerial robots‌ (ARs). Two indoor flying‌​‌ arenas are used to​​ carry out the related​​​‌ experimental activities. The first‌ arena is relatively small‌​‌ (3m x 5m x​​ H1.8m) and is equipped​​​‌ with 11 Vicon cameras‌ for motion capture. The‌​‌ second one, spanning a​​ larger volume (about 9m​​​‌ x 9m x H2.5m),‌ is equipped with 14‌​‌ Qualisys cameras. However, the​​ latter room is only​​​‌ available within the period‌ from January to August.‌​‌ Compared to the former,​​ the larger arena grants​​​‌ us with the possibility‌ to fly multiple drones‌​‌ at the same time​​ thanks to the larger​​​‌ volume and the great‌ coverage offered by the‌​‌ larger number of cameras.​​

In these flying arenas,​​​‌ we operate several customized‌ ARs which have been‌​‌ heavily customised by: reprogramming​​ from scratch the low-level​​​‌ firmwares running on the‌ onboard electronics (comprising flight‌​‌ and motor controllers), equipping​​ each robot with an​​​‌ onboard computer (for instance‌ a Jetson or a‌​‌ NUC board) running Linux​​ Ubuntu and the telekyb3​​​‌ software framework, and adding‌ Realsense RGB-D cameras for‌​‌ onboard visual odometry and​​ visual servoing.

The framework​​​‌ telekyb3 is an open-source‌ architecture based on the‌​‌ Genom3 software tool which​​​‌ has been developed at​ LAAS in Toulouse. It​‌ features a modular and​​ formal structure tailored to​​​‌ code reusability, high performance​ and middleware abstraction. It​‌ comprises a set of​​ algorithms dedicated to localization,​​​‌ navigation and low-level control​ of aerial robots in​‌ maneuvering and physical-interaction-based tasks.​​

The aerial robotic platform​​​‌ of the team includes​ quadrotors and hexarotors (see​‌ Fig. 5.a and​​ 5.b, respectively) which​​​‌ have been internally designed​ both at the mechanical​‌ and the electronic level.​​ While the quadrotors have​​​‌ a standard (in jargon,​ collinear) propeller orientation, the​‌ hexarotors have the motors​​ tilted w.r.t. the main​​​‌ body. This property grants​ them with maneuvering capabilities​‌ that cannot be replicated​​ by conventional and commercial​​​‌ drones with collinear rotors.​

For most of the​‌ mechanical components, we rely​​ on custom parts which​​​‌ are then realized by​ exploiting 3D printing technology​‌ and water-jet and milling​​ processes of carbon-fiber material.​​​‌ From the electronic standpoint,​ our robots feature a​‌ Mikrokopter-based flight controller running​​ custom firmware. However, due​​​‌ to the unavailability and​ aging of the latter​‌ board, a newer flight​​ controller named Paparazzi, has​​​‌ been adopted and consequently​ the firmware adapted to​‌ the new board. The​​ Paparazzi flight controller is​​​‌ part of an open-source​ and open-hardware project started​‌ at ENAC in Toulouse.​​ This board has been​​​‌ chosen as it fits​ well our needs: it​‌ comprises more precise onboard​​ sensors and sufficient programmable​​​‌ peripherals used to communicate​ with the other electronic​‌ modules and sensors.

Smaller​​ commercial drones, namely the​​​‌ BitCraze Crazyflie, have been​ added to this robotic​‌ platform. Thanks to the​​ tiny dimensions of these​​​‌ drones and considering the​ limited available space for​‌ experiments, these robots are​​ perfect candidates to carry​​​‌ out research related to​ the control and perception​‌ of a team of​​ multiple robots.

Among the​​​‌ different successful experiments, we​ can annoverate a visual​‌ servoing using ViSP to​​ position the drone w.r.t.​​​‌ a target and to​ manipulate deformable objects (e.g.​‌ a cable), accurate positioning​​ of a swarm of​​​‌ (more than 5) robots,​ contact-based interaction with flat​‌ surfaces (for instance, drawing​​ on a whiteboard) by​​​‌ means of a hexarotor​ equipped with a rigid​‌ end-effector.

In 2025, multiple​​ papers 33, 37​​​‌, 43, 44​, 18, 65​‌, 22, 34​​, 20 contain experimental​​​‌ results obtained with this​ platform.

In​‌ the left image, one​​ of our quadrotors. In​​​‌ the right image, our​ hexarotor with tilted propellers.​‌

Figure 5: Unmanned​​ Aerial Vehicles Platform. a)​​​‌ one of our customized​ quadrotors, b) our hexarotor​‌ with tilted propellers.

7.2.5​​ Interactive interfaces and systems​​​‌

Participants: Claudio Pacchierotti,​ Paolo Robuffo Giordano,​‌ Maud Marchal, Marie​​ Babel, Fabien Spindler​​​‌ [contact].

Interactive technologies​ enables the communication between​‌ artificial systems and human​​ users. Examples of such​​​‌ technologies are haptic interfaces​ and virtual reality headsets.​‌

Various haptic devices are​​ used to validate our​​​‌ research in, e.g., shared​ control and extended reality.​‌ We design some wearable​​ haptics devices to enhance​​ the user robotic interaction​​​‌ with sensorial feedback, while‌ some other devices are‌​‌ bought from off-the-shelf products,​​ such as a Virtuose​​​‌ 6D device and Desktop‌ 6D device acquired fall‌​‌ 2025 from Haption (see​​ Fig. 6.a). For​​​‌ instance, the latter equipment‌ is used as the‌​‌ master device in many​​ of our shared control​​​‌ activities. An Omega 6‌ (see Fig. 6.b)‌​‌ from Force Dimension and​​ devices from Ultrahaptics (see​​​‌ Fig. 6.c) complete‌ this platform that could‌​‌ be coupled to the​​ other robotic systems.

Similarly,​​​‌ in order to augment‌ the immersiveness of virtual‌​‌ scenarios, we make use​​ of virtual and augmented​​​‌ reality headsets, namely HTC‌ Vive headsets for VR‌​‌ tasks and Microsoft Hololens​​ for Augmented Reality interactions.​​​‌ (see Fig. 6.d).‌

In 2025, this platform‌​‌ was used to obtain​​ experimental results presented in​​​‌ multiple papers 24,‌ 34, 46,‌​‌ 47, 64,​​ 53, 66,​​​‌ 56, 57,‌ 54, 55.‌​‌

Left image, our Virtuose​​​‌ 6D haptic device, in‌ the middle-left our Omega6‌​‌ haptic device, in the​​ middle-right image the Ultraleap​​​‌ STRATOS device, and in‌ the right our Microsoft‌​‌ Hololens 2 AR headset​​

Figure 6: Haptics​​​‌ and Shared Control Platform.‌ a) Virtuose 6D, b)‌​‌ Omega 6 haptic devices,​​ c) Ultraleap STRATOS, d)​​​‌ Hololens 2.

8 New‌ results

8.1 Advanced Sensor-Based‌​‌ Control

We contributed a​​ chapter on visual servoing​​​‌ to the book “Robotics‌ Goes MOOC: Knowledge" edited‌​‌ by Bruno Siciliano 68​​.

8.1.1 Integrated Robust​​​‌ Planning and Control for‌ Uncertain Robots

Participants: Tommaso‌​‌ Belvedere, Paolo Robuffo​​ Giordano.

The goal​​​‌ of this research activity‌ is to propose an‌​‌ integrated approach for robust​​ planning and control of​​​‌ robots whose models are‌ affected by uncertainty in‌​‌ some of their parameters.​​ The results are based​​​‌ on the notion of‌ closed-loop state sensitivity developed‌​‌ in our group since​​ several years, and are​​​‌ also related to the‌ ANR project CAMP (Sect.‌​‌ 10.4.8) and of​​ the recent Cluster SequoIA​​​‌ HARMONY (Sect. 10.4.16).‌

Over the past years,‌​‌ we have developed several​​ trajectory optimization algorithms leveraging​​​‌ the notion of closed-loop‌ “state sensitivity”, “input sensitivity”‌​‌ and derived quantities. In​​ particular, exploiting these metrics​​​‌ we were able to‌ construct tubes enveloping the‌​‌ bundle of perturbed trajectories​​ given an uncertainty model​​​‌ (a range of variation‌ for the parameters around‌​‌ a nominal value). During​​ this year we have​​​‌ continued working on this‌ subject with the following‌​‌ contributions:

  • in 40,​​ we experimentally validated the​​​‌ sensitivity framework in the‌ context of robust manipulation‌​‌ control for a robot​​ manipulator. Our objective was​​​‌ to assess how to‌ enhance the closed-loop robustness‌​‌ against payload variations during​​ precise manipulation tasks. We​​​‌ conducted a series of‌ experiments to validate our‌​‌ optimization approach across different​​ trajectories, focusing primarily on​​​‌ evaluating the precision of‌ the manipulator’s end-effector at‌​‌ critical moments where high​​ accuracy is essential like,​​​‌ for example, while tossing‌ objects. The experimental campaign‌​‌ confirmed the validity of​​​‌ the approach.
  • in 38​, we performed a​‌ principled study on the​​ “sensitivity tubes”. Indeed, these​​​‌ tubes are traditionally built​ from ellipsoidal uncertainty sets​‌ and used to robustify​​ system constraints. These ellipsoids,​​​‌ however, are themselves smooth​ approximations of underlying hyperboxes​‌ in the parameter space,​​ leading to an inaccurate​​​‌ estimation of the parameter​ set. We then extended​‌ our framework by proposing​​ two new formulations that​​​‌ more precisely represent the​ real closed-loop behavior of​‌ the system through improved​​ computation of the sensitivity​​​‌ tubes. The first constructs​ tubes directly from hyperboxes,​‌ exactly preserving the original​​ parameter bounds but producing​​​‌ a non-differentiable description. The​ second employs superquadrics, which​‌ smoothly approximate the hyperbox​​ with user-tunable fidelity while​​​‌ preserving differentiability, as in​ the ellipsoidal case. Both​‌ methods were extensively validated​​ in a simulation campaign.​​​‌
  • in 20, 50​ we proposed an `online'​‌ reactive trajectory optimization based​​ on sensitivity metrics for​​​‌ increasing the robustness against​ model uncertainties. In particular,​‌ in 20 we developed​​ a MPC scheme leveraging​​​‌ the sensitivity formulation: one​ key contribution lied in​‌ the introduction of a​​ computationally efficient robust MPC​​​‌ formulation with a comparable​ computational complexityto a standard​‌ MPC (i.e., an MPC​​ not explicitly dealing with​​​‌ parametric uncertainty). An extensive​ simulation campaign was presented​‌ to demonstrate the effectiveness​​ of the proposed approach​​​‌ in handling parametric uncertainties​ and enhancing task performance,​‌ safety, and overall robustness,​​ complemented by an experimental​​​‌ validation of the approach​ in real-world conditions. In​‌ 50, we instead​​ proposed a MPPI scheme​​​‌ based on sensitivity for​ generating online robust trajectory​‌ by exploiting the parallelizability​​ of the MPPI scheme​​​‌ on a GPU hardware​
  • in 45 we proposed​‌ a review paper where​​ we summarized the various​​​‌ main contributions of sensitivity-based​ robust planning achieved over​‌ the last years
  • in​​ 21, we developed​​​‌ Feedback-MPPI (F-MPPI), a framework​ that augments standard MPPI​‌ by computing local linear​​ feedback gains, enabling high-frequency​​​‌ closed-loop corrections without full​ re-optimization at each timestep.​‌ The key innovation lies​​ in recognizing that MPPI,​​​‌ despite being sampling-based, implicitly​ defines a smooth policy​‌ through the weighted average​​ in parameter space. Compared​​​‌ to prior work on​ Feedback MPC (which extracts​‌ Riccati gains from Differential​​ Dynamic Programming or NLP​​​‌ solvers), the key contribution​ is the extension of​‌ this concept to gradient-free,​​ sampling-based controllers. The gain​​​‌ computation leverages automatic differentiation​ to evaluate cost gradients​‌ for each rollout in​​ parallel alongside trajectory evaluation,​​​‌ maintaining GPU-accelerated efficiency. The​ method was validated on​‌ multiple robotic platforms in​​ simulation and experiments on​​​‌ a quadcopter, involving GPU-accelerated​ onboard computation. The code​‌ was released as an​​ open-source Python library
  • To​​​‌ handle generic constraints in​ the sampling-based MPPI setting,​‌ in 49 we developed​​ BC-MPPI (Bayesian-Constraints MPPI), which​​​‌ uses probabilistic surrogates to​ reshape the MPPI sampling​‌ distribution toward constraint satisfaction.​​ The fundamental limitation of​​​‌ penalty-based constraint handling is​ that if no feasible​‌ samples are drawn, violations​​ become inevitable. Inspired by​​​‌ Constrained Bayesian Optimization, BC-MPPI​ attaches a Bayesian Neural​‌ Network (BNN) surrogate to​​ each constraint, predicting both​​ the mean constraint value​​​‌ and its variance for‌ the sampled inputs. The‌​‌ feasibility probability is then​​ multiplied across constraints and​​​‌ incorporated into the MPPI‌ weights. This automatically down-weights‌​‌ unsafe rollouts without explicit​​ rejection, pushing the sampling​​​‌ distribution toward the safe‌ subset while preserving useful‌​‌ exploration. The approach was​​ validated in simulation with​​​‌ an aerial robot navigating‌ around obstacles. Compared to‌​‌ classic MPPI with hard​​ rejection, BC-MPPI achieved larger​​​‌ obstacle clearances, closer target‌ tracking, fewer collisions in‌​‌ complex scenarios, and lower​​ rejection rates (indicating more​​​‌ efficient sample use).

8.1.2‌ UWB navigation of assisted‌​‌ power wheelchair

Participants: Vincent​​ Drevelle, Marie Babel​​​‌, François Pasteau,‌ Theo Le Terrier.‌​‌

Ultra-wideband (UWB) radio technology​​ is a promising solution​​​‌ for indoor localization and‌ object tracking. Unlike vision-based‌​‌ systems, UWB provides a​​ low-cost, non-intrusive, and easy-to-install​​​‌ alternative for wheelchairs. By‌ measuring time-of-flight between fixed‌​‌ beacons and a mobile​​ tag, UWB yields accurate​​​‌ distance estimates. However, in‌ cluttered indoor environments, multipath‌​‌ or non-line-of-sight (NLOS) propagation​​ can introduce large positive​​​‌ errors in these measurements.‌

To address this, we‌​‌ developed a robust set-membership​​ positioning approach for a​​​‌ smart wheelchair equipped with‌ UWB beacons 31.‌​‌ The method employs interval​​ constraint propagation to explicitly​​​‌ account for multipath and‌ NLOS effects, which may‌​‌ cause measured ranges to​​ exceed the true distance​​​‌ 62. This produces‌ a reliable feasible pose‌​‌ set for the wheelchair​​ at each measurement epoch,​​​‌ ensuring conservative but trustworthy‌ localization.

We also investigate‌​‌ Model Predictive Control (MPC)​​ for autonomous navigation of​​​‌ the wheelchair toward a‌ learned target pose using‌​‌ UWB range measurements 63​​, 59. The​​​‌ MPC framework incorporates nonholonomic‌ and user-comfort constraints and‌​‌ can ensure obstacle avoidance​​ via time-of-flight infrared sensors.​​​‌ This integrated approach enables‌ safe and efficient navigation,‌​‌ paving the way for​​ enhanced user mobility and​​​‌ independence.

8.1.3 Visual field‌ for parts assembly

Participant:‌​‌ François Chaumette.

This​​ study was done in​​​‌ collaboration with IRT Jules‌ Verne in Nantes (see‌​‌ Section 9.1.1). Its​​ goal was to accurately​​​‌ control the complete trajectory‌ of a robot during‌​‌ the assembly of two​​ parts 48.

8.1.4​​​‌ Visual servoing with respect‌ to a cylinder

Participants:‌​‌ Alessandro Colotti, François​​ Chaumette.

We developed​​​‌ a new method able‌ to position an eye-in‌​‌ hand camera with respect​​ to a cylinder. We​​​‌ proposed new visual features‌ and a new control‌​‌ scheme enabling to demonstrate​​ the global stability of​​​‌ the system even in‌ the presence of a‌​‌ very bad estimation or​​ approximation of the cylinder​​​‌ radius: the value injected‌ in the control scheme‌​‌ has just to be​​ positive 23.

8.1.5​​​‌ Proximetry-based control with respect‌ to a cylinder

Participants:‌​‌ François Chaumette.

This​​ study was done in​​​‌ the scope of the‌ BPI Lichie project (see‌​‌ 10.4.7) as part​​ of John Thomas's PhD,​​​‌ which was defended last‌ year. Its goal was‌​‌ to design sensor-based control​​ strategies based on proximetry​​​‌ data for positioning a‌ robot inside or outside‌​‌ of a cylinder 58​​​‌

8.1.6 Visual Exploration of​ an Indoor Environment

Participants:​‌ Eric Marchand, François​​ Chaumette.

This study​​​‌ was done in collaboration​ with the Creative company​‌ in Rennes (see Section​​ 8.1.6). It was​​​‌ devoted to the exploration​ of indoor environments by​‌ a mobile robot for​​ a complete and accurate​​​‌ reconstruction of the environment​ through Thibault Noël's PhD​‌ 75.

8.1.7 Active​​ vision for 3D object​​​‌ reconstruction

Participant: François Chaumette​.

This study takes​‌ place in the context​​ of the BIFROST project​​​‌ (see Section 10.1.2).​ Its goal was to​‌ design an active vision​​ system based on visual​​​‌ servoing for enabling the​ complete reconstruction of an​‌ object observed by an​​ RGB-D camera 35.​​​‌

8.1.8 Shape servoing of​ soft objects using Finite​‌ Element Model

Participants: Mandela​​ Ouafo Fonkoua, Alexandre​​​‌ Krupa, François Chaumette​.

This study takes​‌ also place in the​​ context of the BIFROST​​​‌ project (see Section 10.1.2​). We proposed a​‌ fast visual servoing approach​​ using a RGB-D camera​​​‌ that relies on a​ coarse Finite Element Model​‌ (FEM) to autonomously guide​​ a volumetric soft object​​​‌ towards a target shape​ represented by its projection​‌ in a reduced latent​​ space. This latent space​​​‌ is defined by a​ mapping which can be​‌ obtained through various techniques,​​ including learning-based methods (e.g.,​​​‌ PCA or auto-encoders) or​ non-learning approaches (Laplacian spectral​‌ descriptors) 71. This​​ framework considers the dynamic​​​‌ behavior of the object​ deformation without assuming that​‌ the object is in​​ static equilibrium during the​​​‌ manipulation. We have successfully​ formulated the analytical relationship​‌ expressing the variation of​​ the reduced representation of​​​‌ the object shape to​ the 6 degrees of​‌ freedom motion of a​​ robot gripper. Experimental results​​​‌ have demonstrated that our​ approach can deform the​‌ soft object to a​​ desired shape very rapidly.​​​‌

8.1.9 Multi-Robot Control Localization​ and Estimation

Participant: Paolo​‌ Robuffo Giordano, Claudio​​ Pacchierotti, Esteban Restrepo​​​‌, Antonio Marino.​

Systems composed by multiple​‌ robots are useful in​​ several applications where complex​​​‌ tasks need to be​ performed. Examples range from​‌ target tracking, to search​​ and rescue operations and​​​‌ to load transportation. We​ have been very active​‌ over the last years​​ on the topics of​​​‌ coordination, estimation, localization and​ control of multiple robots​‌ under the possible guidance​​ of a human operator​​​‌ (see, e.g., Sect. 10.4.9​ and Sect. 10.4.16),​‌ and we recently started​​ to explore the use​​​‌ of machine learning for​ replicating, or replacing, more​‌ analytical control/estimation strategies (with​​ benefits in terms of​​​‌ reduced computational power and​ communication load).

During this​‌ year we have produced​​ the the following contributions:​​​‌

  • in 39 we address​ the problem of managing​‌ the arbitrary addition and​​ removal of agents in​​​‌ open multi-robot systems in​ an autonomous energy-aware and​‌ passive way. For this​​ purpose we propose a​​​‌ passivity-preserving energy-tank-based framework for​ the analysis and control​‌ design of multi-mode multidimensional​​ switched systems. A new​​​‌ design of hybrid energy​ tank is proposed, modeled​‌ as an impulsive switched​​ system and that allows​​ to account for the​​​‌ sudden (and possibly non-passive)‌ jumps in energy of‌​‌ the system due to​​ the change of dimension​​​‌ of the state at‌ the switching instants. Under‌​‌ this framework we establish​​ passivity of the plant-plus-tank​​​‌ system via an energy-based‌ condition for the switching‌​‌ signal.
  • In 33,​​ we address the challenge​​​‌ of allocating heterogeneous resources‌ among multiple agents using‌​‌ a decentralized method called​​ Liquid-Graph-Time Clustering-IPPO. This approach​​​‌ integrates dynamic cluster consensus‌ with Independent Proximal Policy‌​‌ Optimization, allowing agents to​​ form local sub-teams based​​​‌ on resource demands. We‌ demonstrate that this strategy‌​‌ improves coordination and scalability​​ compared to standard baselines​​​‌ and a centralized expert‌ solution, enabling efficient resource‌​‌ reallocation even with dynamic​​ resources. Extensive experiments demonstrate​​​‌ that this proposed approach‌ achieves more stable rewards,‌​‌ better coordination, and robust​​ performance in a scalable​​​‌ way. Additionally, the experimental‌ campaign illustrates how dynamic‌​‌ clustering enables agents to​​ reallocate resources efficiently in​​​‌ dynamic scenarios.
  • in 32‌ we considered the problem‌​‌ of “dynamic average estimation”:​​ this is a critical​​​‌ problem in multi-agent systems,‌ enabling agents to collaboratively‌​‌ estimate time-varying signals using​​ only local information exchange.​​​‌ Traditional model-based approaches often‌ face challenges related to‌​‌ convergence speed and sensitivity​​ to network topology changes.​​​‌ In this work we‌ introduced a novel learning-based‌​‌ solution leveraging Gated Graph​​ Neural Networks (GGNNs) for​​​‌ fast convergent dynamic average‌ estimation in a fully‌​‌ distributed manner. Taking advantage​​ of the inherent structure​​​‌ of GGNNs, the proposed‌ method models the estimation‌​‌ process as a distributed​​ autoregressor, ensuring rapid convergence​​​‌ while maintaining stability. Extensive‌ numerical experiments demonstrate that‌​‌ our approach significantly outperforms​​ conventional model-based estimators in​​​‌ terms of both convergence‌ speed and precision, making‌​‌ it a promising alternative​​ for multi-agent applications that​​​‌ require dynamic average estimation.‌
  • in 37 we considered‌​‌ the problem of coordinating​​ a group of mobile​​​‌ robots for distributedly estimating‌ the parameters of a‌​‌ diffusion model that generates​​ a time-varying spatial field.​​​‌ To this end, we‌ developed a decentralized online‌​‌ motion strategy aimed at​​ minimizing a Gramian-based information​​​‌ metric that improves the‌ estimation convergence. Additional constraints,‌​‌ among which collision avoidance,​​ are integrated as Control​​​‌ Barrier Functions (CBFs) in‌ a Quadratic Program (QP).‌​‌ A set of statistical​​ comparisons against three baselines​​​‌ showed the improved performance‌ of the proposed method‌​‌ in a range of​​ simulated scenarios, and we​​​‌ also performed experiments carried‌ out with the drones‌​‌ in our group to​​ demonstrate the actual implementability​​​‌ of the approach and‌ its effectiveness in generating‌​‌ online, collision-free, and informative​​ motions.

8.2 Haptic Cueing​​​‌ for Robotic Applications and‌ Virtual Reality (VR)

We‌​‌ contributed a chapter on​​ Virtual Reality and Haptics​​​‌ to the book “Robotics‌ Goes MOOC" 69.‌​‌ This work introduces the​​ main concepts of VR​​​‌ and haptic interaction. It‌ describes the hardware and‌​‌ software components necessary to​​ create immersive experiences, with​​​‌ a specific focus on‌ their application in robotics.‌​‌

8.2.1 Wearable haptics for​​ human-centered robotics, Virtual Reality​​​‌ (VR), and Augmented Reality‌ (AR)

Participants: Claudio Pacchierotti‌​‌, Maud Marchal,​​​‌ Eric Marchand, Lisheng​ Kuang.

We have​‌ been working on wearable​​ haptics since few years​​​‌ now, both from the​ hardware (design of interfaces)​‌ and software (rendering and​​ interaction techniques) points of​​​‌ view. This line of​ research has continued also​‌ in this year.

In​​ 25, we review​​​‌ the state of the​ art in wearable multi-sensory​‌ haptic devices. These devices​​ communicate complex information by​​​‌ delivering multiple types of​ haptic stimuli simultaneously, such​‌ as vibration, skin stretch,​​ and pressure. We discuss​​​‌ the engineering challenges in​ packaging these mechanisms and​‌ the perceptual issues related​​ to cue masking and​​​‌ human acuity. We provide​ guidelines for designing future​‌ multi-sensory devices to enhance​​ human-machine interaction.

In 36​​​‌, we discuss recent​ advancements in wearable haptics,​‌ highlighting a new 18-gram​​ haptic ring capable of​​​‌ delivering strong force feedback​ while detecting multi-directional touch​‌ inputs. This device addresses​​ the common trade-off between​​​‌ portability and performance in​ haptic technology, offering potential​‌ applications in interacting with​​ virtual environments.

In 46​​​‌, we propose "Flexible​ Reality," a concept to​‌ enhance haptic feedback intensity​​ in co-located Augmented Reality​​​‌ (AR) using pseudo-haptics. We​ conducted a user study​‌ comparing vibration intensity perception​​ in AR versus VR.​​​‌ The results show that​ pseudo-haptics can effectively modulate​‌ perceived intensity. We also​​ found that user agency​​​‌ and self-causality significantly increase​ interaction believability.

In 47​‌, as part of​​ the DORNELL project (see​​​‌ Sect. 10.4.6), we​ propose a multi-actuator haptic​‌ handle that acts as​​ a physical representation of​​​‌ the user's surroundings in​ VR. The device displays​‌ directional haptic patterns to​​ inform the user about​​​‌ obstacles. Our user studies​ demonstrate that this in-hand​‌ feedback enables users to​​ avoid dynamic obstacles effectively​​​‌ and intuitively understand the​ spatial location of threats​‌ relative to their avatar.​​

In 77, we​​​‌ investigate the use of​ passive finger movements for​‌ calibrating Brain-Computer Interfaces (BCIs)​​ as an alternative to​​​‌ motor imagery. We recorded​ EEG activity from participants​‌ performing both tasks. We​​ observed significantly stronger brain​​​‌ activity in the α​ and β bands during​‌ passive movements. These findings​​ suggest passive movements could​​​‌ improve BCI accessibility for​ applications like extended reality.​‌

In 53, 78​​, we study whether​​​‌ vibrations applied to the​ hands can support the​‌ sensation of walking in​​ VR, serving as an​​​‌ alternative to foot vibrations.​ We compared hand vibrations,​‌ foot vibrations, and no​​ vibrations during a passive​​​‌ walking simulation. Results indicate​ that hand vibrations significantly​‌ increase the walking sensation​​ and embodiment compared to​​​‌ no vibrations, offering a​ cost-effective solution for immersive​‌ VR locomotion.

In 57​​, we investigate vibrotactile​​​‌ perception on the arm​ using a modular wearable​‌ sleeve. We examined localization,​​ apparent haptic motion, and​​​‌ two-point discrimination across the​ wrist, forearm, upper arm,​‌ and shoulder. Users could​​ identify stimulus locations with​​​‌ high accuracy. We found​ that spatial acuity decreases​‌ from the wrist to​​ the upper arm, though​​​‌ the shoulder shows better​ discrimination than expected.

In​‌ 54, we investigate​​ the manipulation of fingertip​​ contact plane tilt to​​​‌ enhance the visuo-haptic coherency‌ of virtual objects. We‌​‌ designed a compact device​​ capable of adjusting the​​​‌ tilt of the contact‌ plane to simulate diverse‌​‌ 3D shapes. User studies​​ demonstrated that this approach​​​‌ yields significant improvements in‌ haptic realism, enjoyment, and‌​‌ operability compared to conventional​​ methods.

In 55,​​​‌ we present FresnelDeformable, a‌ technique conveying the softness‌​‌ of virtual objects by​​ combining pseudo-stiffness with dynamic​​​‌ fingertip plane tilt manipulation.‌ The method uses a‌​‌ custom device that tilts​​ the fingertip contact surface​​​‌ according to the applied‌ force to align tactile‌​‌ feedback with visual deformation.​​ Results from a user​​​‌ study indicated that tilt‌ manipulation significantly increases the‌​‌ coherence between visual and​​ tactile cues and expands​​​‌ the range of perceived‌ softness in virtual environments.‌​‌

8.2.2 Encounter-Type Haptic Devices​​

Participants: Claudio Pacchierotti,​​​‌ Lisheng Kuang, Elodie‌ Bouzbib.

Encounter-Type Haptic‌​‌ Displays (ETHDs) provide haptic​​ feedback by positioning a​​​‌ tangible surface for the‌ user to encounter. This‌​‌ allows users to freely​​ elicit haptic feedback with​​​‌ a surface during a‌ virtual simulation. ETHDs differ‌​‌ from most of current​​ haptic devices which rely​​​‌ on an actuator always‌ in contact with the‌​‌ user.

In 64,​​ we analyze an origami-inspired​​​‌ wearable haptic device designed‌ for cutaneous interaction with‌​‌ the palm. The device​​ uses a structured mechanism​​​‌ to render edges, tips,‌ and surfaces by adjusting‌​‌ force and velocity. We​​ evaluate the device's reachable​​​‌ configurations and trajectory execution‌ through inverse kinematics analysis,‌​‌ contributing to the design​​ of adaptable wearable haptic​​​‌ systems.

8.3 Shared Control‌ Architectures

8.3.1 Shared Control‌​‌ for Remote Manipulation

Participants:​​ Paolo Robuffo Giordano,​​​‌ Claudio Pacchierotti, Marco‌ Ferro, Leon Raphalen‌​‌, Paul Mefflet.​​

As teleoperation systems become​​​‌ more sophisticated and flexible,‌ the environments and applications‌​‌ where they can be​​ employed become less structured​​​‌ and predictable. This desirable‌ evolution toward more challenging‌​‌ robotic tasks requires an​​ increasing degree of training,​​​‌ skills, and concentration from‌ the human operator. In‌​‌ this respect, shared control​​ algorithms have been investigated​​​‌ as one of the‌ main tools to design‌​‌ complex but intuitive robotic​​ teleoperation systems, helping operators​​​‌ in carrying out several‌ increasingly difficult robotic applications‌​‌ such as assisted vehicle​​ navigation, surgical robotics, brain-computer​​​‌ interface manipulation, rehabilitation. Indeed,‌ this approach makes it‌​‌ possible to share the​​ available degrees of freedom​​​‌ of the robotic system‌ between the operator and‌​‌ an autonomous controller.

Along​​ this line of research,​​​‌ in the context of‌ the Horizon Europe Rego‌​‌ project (Sect. 10.3.1),​​ we are starting to​​​‌ investigate how to employ‌ shared control strategies for‌​‌ allowing a human operator​​ to control a group​​​‌ of micro-robots for drug‌ delivery and micro-assembly.

In‌​‌ 24, we presented​​ the experimental evaluation of​​​‌ a haptic shared control‌ teleoperation framework for the‌​‌ locomotion of multiple microrobots,​​ relying on a kinesthetic​​​‌ haptic interface and a‌ custom electromagnetic system. Six‌​‌ combinations of haptic and​​ shared control strategies are​​​‌ evaluated during a safe‌ 3D navigation scenario in‌​‌ a cluttered environment. 18​​​‌ participants are asked to​ steer two spherical magnetic​‌ microrobots among obstacles to​​ reach a predefined goal,​​​‌ under different conditions. For​ each condition, participants are​‌ provided with different obstacle​​ avoidance and navigation guidance​​​‌ cues. Results show that​ providing assistance in avoiding​‌ obstacles guarantees safer performance,​​ regardless if the assistance​​​‌ is autonomous or delivered​ through a haptic repulsive​‌ force.

In 52,​​ we introduce a “Stiffness​​​‌ Regulation Co-pilot" to assist​ operators in bilateral teleimpedance​‌ control. This virtual agent​​ infers optimal stiffness actions​​​‌ based on task performance​ and communicates them to​‌ the operator via feedback.​​ A preliminary study suggests​​​‌ that cutaneous feedback, possibly​ combined with other modalities,​‌ improves task performance and​​ reduces the cognitive load​​​‌ required to regulate stiffness​ manually.

In 66,​‌ we present a haptic​​ shared control system for​​​‌ teleoperating a pair of​ magnetic microrobots. We formulate​‌ a Quadratic Programming approach​​ with Control Lyapunov and​​​‌ Barrier Functions to ensure​ safe navigation. We combine​‌ this with a shared​​ control architecture that provides​​​‌ visuo-haptic cues. The system​ improves navigation accuracy and​‌ stability compared to unassisted​​ teleoperation.

In 56,​​​‌ we address the problem​ of occlusions in vision-constrained​‌ teleoperation. We propose an​​ occlusion-safe shared control framework​​​‌ using High-Order Control Barrier​ Functions to prevent robots​‌ from entering unobserved regions.​​ The system provides haptic​​​‌ feedback to signal proximity​ to occlusion zones, helping​‌ the operator maintain visibility​​ and control safety.

8.3.2​​​‌ Shared Control of a​ Wheelchair for Navigation Assistance​‌

Participants: Louise Devigne,​​ François Pasteau, Emilie​​​‌ Leblong, Marie Babel​.

Power wheelchairs allow​‌ people with motor disabilities​​ to have more mobility​​​‌ and independence. In order​ to improve the access​‌ to mobility for people​​ with disabilities, we carefully​​​‌ designed a semi-autonomous assistive​ wheelchair system which progressively​‌ corrects the trajectory as​​ the user manually drives​​​‌ the wheelchair and smoothly​ avoids obstacles. During the​‌ past 5 years, we​​ successfully conducted several clinical​​​‌ trials with more than​ 300 users 17.​‌

The Cirris laboratory at​​ Univeristy of Laval (Canada)​​​‌ has acquired and set​ up our collision avoidance​‌ wheelchair kit composed of​​ 48 sensors and a​​​‌ control board running the​ shared control algorithm. With​‌ the help of the​​ Fondation Saint Hélier (Emilie​​​‌ Leblong), we designed an​ experimental protocol to conduct​‌ international multicentric clinical trials​​ and find new use​​​‌ cases for this solution​ inside the rehabilitation process.​‌

A cooperation with Clinatec​​ / CEA Leti led​​​‌ us to defined assist-as-needed​ sensor-based shared control (SC)​‌ methods relying on the​​ blending of BCI and​​​‌ depth-sensor-based control. The proposed​ assistance targets the BCI-teleoperation​‌ of effectors for tasks​​ that answer mobility and​​​‌ manipulation needs in a​ at-home context. We demonstrated​‌ the ability of the​​ proposed method to provide​​​‌ effective assistance for wheelchair​ mobility and reach-and-grasp tasks​‌ through a clinical trial​​ with a quadriplegic patient​​​‌ implanted with a wireless​ 64-channel ElectroCorticoGram recording implant​‌ named WIMAGINE. The time​​ to perform the tasks​​​‌ and the number of​ changes of mental tasks​‌ were reduced. Unwanted actions,​​ such as wheelchair collisions​​ with the environment, and​​​‌ gripper opening that could‌ result in the fall‌​‌ of the object were​​ avoided 19.

8.3.3​​​‌ Integrating social interaction in‌ a VR power wheelchair‌​‌ driving simulator

Participants: Emilie​​ Leblong, Fabien Grzeskowiak​​​‌, Sebastien Thomas,‌ François Pasteau, Anne-Hélène‌​‌ Olivier, Marie Babel​​.

Navigating in the​​​‌ city while driving a‌ powered wheelchair, in a‌​‌ complex and dynamic environment​​ made of various interactions​​​‌ with other humans, can‌ be challenging for a‌​‌ person with disabilities. Learning​​ how to drive a​​​‌ powered wheelchair remains then‌ a major issue. Immersive‌​‌ environments provide solutions to​​ learn and transfer skills​​​‌ to real life. This‌ opens up new areas‌​‌ of application, such as​​ rehabilitation, where people with​​​‌ neurological disabilities can learn‌ to drive a power‌​‌ wheelchair through immersive simulators.​​ In this context, we​​​‌ collaborated with clinicians to‌ design a Virtual Reality‌​‌ based power wheelchair simulator.​​ We received in 2025​​​‌ an award for the‌ best research demo (honorable‌​‌ mention). This multisensory power​​ wheelchair simulator has been​​​‌ duplicated and set up‌ at the Cirris Laboratory‌​‌ at University of Laval​​ (Canada) to develop new​​​‌ usage scenarios and perform‌ multicentric clinical studies (SocNav‌​‌ project 10.1.1). To​​ promote the transfer of​​​‌ skills from virtual to‌ real, the use of‌​‌ such a platform requires​​ the deployment of environmentally​​​‌ friendly interactive populated virtual‌ environments. However, these are‌​‌ currently empty of any​​ pedestrians, even though the​​​‌ question of social interaction‌ in the framework of‌​‌ an inclusive urban mobility​​ is fundamental. Hence, to​​​‌ expose these users to‌ daily-life study interaction situations,‌​‌ it is important to​​ ensure realistic interactions with​​​‌ the virtual humans that‌ populate the simulated environment.‌​‌ We then investigate the​​ regulation of interpersonal distance​​​‌ (i.e., proxemics) between a‌ pedestrian and a PWC‌​‌ user in real and​​ virtual situations, and proposed​​​‌ a model to regulate‌ the virtual agent behavior‌​‌ while sharing the same​​ virtual environment. We conducted​​​‌ clinical trials (March to‌ June 2025) to evaluate‌​‌ the performances of our​​ system. Results indicated high​​​‌ potential for learning and‌ safety, with users feeling‌​‌ secure and better understanding​​ urban risks. Professionals saw​​​‌ it as a tool‌ for progressive training and‌​‌ detailed observation. Further studies​​ are required to validate​​​‌ its clinical efficacy and‌ integration into care pathways.‌​‌

8.3.4 Upper-limb exoskeleton for​​ reach-to-grasp assistance for power​​​‌ wheelchair users

Participants: Marie‌ Babel, Maxime Manzano‌​‌, Mael Gallois,​​ Sylvain Guégan, Elise​​​‌ Larribeau, Charles Pontonnier‌.

Wearable Upper-Limb (UL)‌​‌ assistive robots are designed​​ to increase autonomy and​​​‌ social participation for people‌ with UL impairments as‌​‌ they assist tasks involved​​ in Activities of Daily​​​‌ Living (ADLs). When an‌ active device is coupled‌​‌ with a power wheelchair,​​ it is usually controlled​​​‌ through push-buttons located near‌ the wheelchair joystick, thus‌​‌ preventing bimanual tasks and​​ requiring a large mental​​​‌ load to perform complex‌ UL trajectories. Therefore, there‌​‌ is a need for​​ strategies to detect user​​​‌ intent and get rid‌ of manual control, allowing‌​‌ a distinctive, intuitive control​​​‌ of devices with multiple​ active degrees of freedom.​‌

Assistive devices are then​​ to be designed with​​​‌ the objective of use​ in daily-life as well​‌ as broad adoption by​​ end users. In this​​​‌ context, it is necessary​ to tackle usability challenges​‌ by properly detecting and​​ acting in accordance to​​​‌ user intents while minimizing​ the device installation complexity​‌ as well.

We designed​​ an exoskeleton prototype with​​​‌ a control interface leveraging​ human–exoskeleton interaction forces relying​‌ on intent detection methods.​​ We then developed a​​​‌ shared control strategy exploiting​ user force impulses to​‌ mitigate physical effort required​​ to use the exoskeleton​​​‌ through a variable admittance​ controller with adjustable parameters​‌ 60, allowing to​​ avoid instabilities or overly​​​‌ conservative settings that compromises​ user experience. This work​‌ is supported by models​​ of users' force generation​​​‌ capabilities to personalize the​ assistance 61, 51​‌, 26. Indeed,​​ exoskeletons are challenging to​​​‌ use because of the​ multiple degrees of freedom​‌ one needs to control,​​ in addition to their​​​‌ exposure to misalignments which​ cause discomfort due to​‌ kinematic incompatibilities with the​​ human upper-limb. We then​​​‌ explored the possibility to​ assess joint torque capacities​‌ of patients presenting post-stroke​​ sequels or multiple sclerosis​​​‌ impairment to use it​ as guidance in a​‌ shared control scheme 67​​.

8.4 Aerial Physical​​​‌ Interaction

8.4.1 Controlled Shaking​ of Trees With an​‌ Aerial Manipulator

Participants: Marco​​ Tognon.

Aerial shaking​​​‌ of flexible structures, and​ in particular trees, has​‌ recently emerged as a​​ promising application of aerial​​​‌ manipulators for agriculture and​ environmental monitoring. By inducing​‌ controlled vibrations, UAVs can​​ enable tasks such as​​​‌ fruit detachment or structural​ assessment while avoiding heavy,​‌ ground-based machinery. The main​​ challenge lies in understanding​​​‌ and exploiting the coupled​ dynamics between the aerial​‌ platform and the flexible​​ structure to achieve effective​​​‌ vibration generation in a​ controlled and robust manner.​‌

In 28, the​​ authors take a first​​​‌ step in this direction​ by proposing a self-excited​‌ oscillation strategy for shaking​​ flexible systems with an​​​‌ aerial manipulator. The method​ exploits the natural dynamics​‌ of the coupled UAV–tree​​ system to automatically excite​​​‌ vibrations at the structure’s​ resonant frequency, without requiring​‌ prior knowledge of the​​ tree parameters. A simplified​​​‌ one-degree-of-freedom model, derived using​ the Rayleigh–Ritz method, is​‌ used to analyze the​​ interaction dynamics and predict​​​‌ vibration characteristics. Indoor experiments​ validate the approach, showing​‌ accurate prediction of oscillation​​ frequency and amplitude, and​​​‌ demonstrating the feasibility of​ autonomous vibration-based interaction with​‌ flexible structures.

Building on​​ this modeling foundation, the​​​‌ more recent work 27​ extends the problem formulation​‌ by explicitly exploiting the​​ full actuation capabilities of​​​‌ aerial manipulators. Instead of​ limiting interaction to translational​‌ push–pull motions, the paper​​ introduces two complementary shaking​​​‌ strategies: a translation strategy​ based on force-induced linear​‌ motions, and a rotation​​ strategy based on torque-induced​​​‌ rotational motions. By integrating​ both strategies into a​‌ Rayleigh–Ritz model of the​​ tree, the closed-loop dynamics​​​‌ of the coupled system​ are derived and analyzed.​‌ This analysis addresses a​​ previously unexplored question: which​​ interaction strategy is more​​​‌ effective for a given‌ contact point on the‌​‌ tree. The results show​​ that the optimal choice​​​‌ depends solely on the‌ aerial platform’s physical properties,‌​‌ such as mass and​​ inertia, rather than on​​​‌ the tree itself. Indoor‌ experiments with a fully‌​‌ actuated platform and a​​ hand-made bamboo tree validate​​​‌ the theoretical findings.

Together,‌ these two works establish‌​‌ a coherent research direction​​ on aerial shaking of​​​‌ flexible structures: from exploiting‌ self-excited oscillations to induce‌​‌ vibrations without prior knowledge,​​ to systematically comparing force-​​​‌ and torque-based interaction strategies‌ through unified modeling and‌​‌ experimental validation.

8.4.2 Design​​ and Control of Aerial​​​‌ Manipulators for Physical Interaction‌ Tasks

Participants: Marco Tognon‌​‌, Paolo Robuffo Giordano​​, Lorenzo Balandi,​​​‌ Phillip Maximilian Mehl,‌ Lluis Prior, Giulio‌​‌ Franchi, Igor Angelini​​, Alessandro Borgherini,​​​‌ Emanuele Bua Odetti,‌ Luigi Graziosi.

The‌​‌ design and control of​​ novel aerial manipulators aim​​​‌ to improve precision, stability,‌ and efficiency in mobile‌​‌ robotic applications, particularly for​​ aerial manipulation tasks. Aerial​​​‌ manipulators often face challenges‌ due to reaction forces‌​‌ and torques induced by​​ motion, impacting performance and​​​‌ control complexity.

The work‌ in 42 presents a‌​‌ design methodology for the​​ high-level analysis of inherently​​​‌ force-balanced robotic manipulators and‌ applies it to three‌​‌ closed-chain, two-degree-of-freedom planar concepts​​ based on four-bar and​​​‌ five-bar linkages. The manipulators‌ are modeled at an‌​‌ abstract component level, explicitly​​ accounting for link mass​​​‌ distribution, counter-masses, and attachment‌ constraints.

An optimization-based approach‌​‌ is used to determine​​ suitable counter-mass configurations while​​​‌ exploring tradeoffs between workspace,‌ total mass, and balancing‌​‌ effectiveness. Multibody simulations comparing​​ balanced and unbalanced designs​​​‌ along representative trajectories quantify‌ reaction forces, moments, and‌​‌ joint torques. The results​​ highlight how inherent force​​​‌ balancing can substantially reduce‌ dynamic reactions, while also‌​‌ exposing key design tradeoffs​​ that influence manipulator performance.​​​‌

A series of works‌ have progressively addressed the‌​‌ challenge of achieving accurate​​ and robust control of​​​‌ aerial robots in the‌ presence of model uncertainties,‌​‌ disturbances, and hardware limitations,​​ all converging toward architectures​​​‌ that tightly couple high-level‌ optimal control with robust,‌​‌ high-rate inner-loop strategies.

In​​ 43, the authors​​​‌ investigate the combination of‌ Nonlinear Model Predictive Control‌​‌ (NMPC) with a fast​​ acceleration-based inner loop to​​​‌ improve trajectory tracking under‌ disturbances and modeling errors.‌​‌ By studying Incremental Nonlinear​​ Dynamic Inversion (INDI) and​​​‌ Time Delay Control (TDC),‌ the paper clarifies their‌​‌ close relationship and proposes​​ a TDC-based inner loop​​​‌ running at 1 kHz.‌ Extensive simulations on a‌​‌ fully actuated hexarotor show​​ significant performance improvements, while​​​‌ also highlighting fundamental limitations‌ arising from input saturation,‌​‌ thereby motivating more constraint-aware​​ inner-loop designs.

Complementing the​​​‌ control-side robustness, 44 focuses‌ on improving the quality‌​‌ of inertial feedback by​​ addressing mechanical vibrations affecting​​​‌ IMUs on multirotor aerial‌ vehicles. Through analysis of‌​‌ real flight data and​​ vibration theory, the work​​​‌ identifies motor–propeller units as‌ the dominant vibration source‌​‌ and develops theoretical models​​ to guide effective damping​​​‌ strategies. A redesigned, low-cost‌ damping configuration significantly reduces‌​‌ vibration levels in both​​​‌ acceleration and angular velocity​ measurements, directly benefiting high-bandwidth​‌ control architectures that rely​​ on accurate inertial sensing.​​​‌

Building on these insights,​ 18 proposes a constraint-aware,​‌ optimization-based inner-loop controller inspired​​ by TDC and formulated​​​‌ as a Quadratic Program​ (QP). Unlike classical feedback​‌ inner loops, this approach​​ explicitly handles actuation limits​​​‌ and preserves stability under​ saturation and model mismatches.​‌ The controller uses acceleration​​ feedback and does not​​​‌ require precise inertial parameters,​ further enhancing robustness. Experiments​‌ on a fully actuated​​ hexarotor demonstrate that the​​​‌ proposed QP-based inner loop​ substantially improves NMPC tracking​‌ performance in aggressive scenarios​​ where traditional inner-loop strategies​​​‌ fail.

Finally, 65 extends​ the pursuit of robustness​‌ beyond classical control by​​ introducing a model-based reinforcement​​​‌ learning framework for end-to-end​ UAV control. To overcome​‌ the sim-to-real gap and​​ the impracticality of unsafe​​​‌ real-world training, the authors​ encapsulate a high-fidelity simulator​‌ into a Gaussian Process​​ model, enabling efficient policy​​​‌ learning with reduced computational​ cost. The learned policies​‌ are successfully transferred to​​ a real quadrotor, with​​​‌ experimental results showing close​ agreement between simulation, learned​‌ models, and real flight​​ data. This work demonstrates​​​‌ the feasibility of combining​ model-based learning and optimal​‌ control principles to achieve​​ robust performance on real​​​‌ aerial platforms.

Together, these​ contributions outline a coherent​‌ research direction toward robust,​​ high-performance aerial robot control,​​​‌ combining accurate sensing, fast​ and constraint-aware inner loops,​‌ optimal outer-loop control, and​​ learning-based methods to bridge​​​‌ modeling gaps between simulation​ and reality.

8.4.3 Cooperative​‌ Multi-Aerial Robot Manipulation

Participants:​​ Marco Tognon, Paolo​​​‌ Robuffo Giordano, Szymon​ Bielenin, Nicola De​‌ Carli, Valeria Braglia​​.

Cooperative transportation of​​​‌ cable-suspended loads with UAVs​ is a key problem​‌ in cooperative aerial manipulation,​​ motivated by applications such​​​‌ as search and rescue,​ construction, and logistics in​‌ cluttered or hard-to-reach environments.​​ By distributing the payload​​​‌ across multiple aerial robots,​ these systems can overcome​‌ the payload and actuation​​ limits of a single​​​‌ UAV while enabling full-pose​ control of large or​‌ heavy objects. However, the​​ strong dynamic coupling introduced​​​‌ by the cables and​ the load makes control​‌ particularly challenging, often forcing​​ existing approaches to operate​​​‌ at low speeds and​ accelerations or to rely​‌ on centralized solutions that​​ limit scalability.

In 41​​​‌, the focus is​ placed on agility. The​‌ paper proposes a centralized,​​ trajectory-based Model Predictive Control​​​‌ framework that explicitly accounts​ for the coupled quadrotor–cable–load​‌ dynamics and constraints in​​ a whole-body kinodynamic planning​​​‌ problem solved online. The​ resulting trajectories are tracked​‌ in a receding-horizon fashion​​ by onboard controllers that​​​‌ estimate and compensate for​ cable tension, without requiring​‌ sensors on the load.​​ Real-world experiments show dramatic​​​‌ performance gains, achieving accelerations​ up to eight times​‌ higher than state-of-the-art methods​​ and enabling aggressive maneuvers​​​‌ such as high-speed flight​ through narrow passages, while​‌ remaining robust to load​​ uncertainty and wind disturbances.​​​‌

Complementarily, 22 addresses the​ challenge of scalability in​‌ cooperative aerial manipulation. Instead​​ of a centralized controller,​​​‌ the authors introduce a​ Distributed Nonlinear Model Predictive​‌ Control (DNMPC) architecture in​​ which each UAV solves​​ a local optimization problem​​​‌ and exchanges only a‌ reduced set of variables‌​‌ with its neighbors over​​ a peer-to-peer network. This​​​‌ distributed scheme preserves the‌ benefits of NMPC while‌​‌ significantly reducing computational and​​ communication burdens. The approach​​​‌ is validated in simulation‌ and through real-world experiments‌​‌ on the Fly-Crane platform,​​ demonstrating effective cooperative manipulation​​​‌ of a cable-suspended load‌ with improved scalability and‌​‌ robustness.

Together, these two​​ works advance cooperative aerial​​​‌ transportation by tackling complementary‌ aspects of the same‌​‌ problem: one pushing the​​ limits of agility through​​​‌ centralized, whole-body MPC, and‌ the other enabling scalable‌​‌ deployment through distributed predictive​​ control.

8.4.4 Physical Human–Aerial​​​‌ Robot Interaction and Shared‌ Control

Participants: Marco Tognon‌​‌, Marco Cognetti.​​

Physical interaction between humans​​​‌ and aerial robots represents‌ a critical step toward‌​‌ deploying UAVs in collaborative​​ and assistive tasks, where​​​‌ safety, intuitiveness, and robustness‌ are paramount. Unlike ground‌​‌ robots, aerial platforms are​​ inherently underactuated, dynamically unstable,​​​‌ and subject to strict‌ safety constraints, making direct‌​‌ physical human–robot interaction particularly​​ challenging. Recent works have​​​‌ begun to address these‌ challenges by combining predictive‌​‌ control, compliance, and human-centered​​ interface design to enable​​​‌ effective collaboration between humans‌ and aerial robots.

In‌​‌ 29, the authors​​ propose a control framework​​​‌ that enables an aerial‌ robot to physically collaborate‌​‌ with a human in​​ a shared transportation task.​​​‌ The approach is based‌ on a nonlinear Model‌​‌ Predictive Control (NMPC) formulation​​ that explicitly incorporates the​​​‌ coupled dynamics of the‌ human, the aerial robot,‌​‌ and the manipulated object.​​ To ensure safe interaction,​​​‌ the NMPC is complemented‌ with a compliant control‌​‌ layer and a motion​​ preference strategy that favors​​​‌ forward motion, aligning the‌ robot’s behavior with the‌​‌ human’s natural movement. Indoor​​ experiments with a fully​​​‌ actuated hexarotor demonstrate stable‌ and effective human–robot cooperation,‌​‌ highlighting the aerial robot’s​​ ability to assist the​​​‌ human while improving comfort‌ and efficiency during physical‌​‌ manipulation.

Complementing physical collaboration,​​ 34 addresses the human-in-the-loop​​​‌ aspect of aerial manipulation‌ through teleoperation. The paper‌​‌ investigates how richer feedback​​ modalities can enhance operator​​​‌ awareness and task performance‌ compared to conventional 2D‌​‌ visual interfaces. A human–robot​​ interface providing immersive 3D​​​‌ mixed-reality visual feedback and‌ 3D haptic feedback is‌​‌ developed and evaluated. Through​​ real-world manipulation experiments and​​​‌ a controlled human-subjects study,‌ the results show that‌​‌ both mixed-reality vision and​​ haptic feedback significantly improve​​​‌ dexterity and reduce cognitive‌ workload in teleoperated aerial‌​‌ manipulation tasks, while also​​ revealing that operator experience​​​‌ remains a dominant factor.‌

Together, these works advance‌​‌ human–aerial robot interaction from​​ both physical collaboration and​​​‌ interface design perspectives, contributing‌ toward safer, more intuitive,‌​‌ and more effective shared-control​​ paradigms for aerial robots​​​‌ operating in close proximity‌ to humans.

8.5 Sensor‌​‌ design for physical interaction​​ and shared control

8.5.1​​​‌ Capacitive and pressure sensor‌ through one-shot 3D printing‌​‌

Participants: Marie Babel,​​ José Eduardo Aguilar-Segovia,​​​‌ Sylvain Lefebvre.

Measuring‌ interaction forces between robots‌​‌ and humans is a​​ major challenge in physical​​​‌ human-robot interactions. Nowadays, conventional‌ force/torque sensors suffer from‌​‌ bulkiness, high cost, and​​​‌ stiffness, which limit their​ use in soft robotics.​‌

Additive manufacturing (AM) enables​​ the fabrication of multi-material​​​‌ 3D structures with sensing​ capabilities by integrating conductive​‌ materials alongside flexible or​​ rigid parts. Recent research​​​‌ focuses on embedding sensing​ elements into 3D structures​‌ using complex algorithms or​​ intricate design approaches to​​​‌ create interactive or monitoring​ devices. A challenge in​‌ manufacturing bespoke devices is​​ performing user-specific ergonomic and​​​‌ anthropomorphic adjustments to multi-material​ 3D models. We proposed​‌ a novel computational fabrication​​ method that operates directly​​​‌ within the layered fabrication​ space. The method transforms​‌ simple sensing structures into​​ complex designs through layer​​​‌ transformations – rotation, translation,​ and scaling – while​‌ addressing constraints from design​​ for additive manufacturing (DfAM).​​​‌ These constraints include ensuring​ electrical conductivity in conductive​‌ parts and preventing unintended​​ electrical connections during fabrication.​​​‌ A custom-fit handle with​ embedded capacitive sensors is​‌ manufactured as a one-shot​​ multi-material print and forces​​​‌ applied to the embedded​ sensors by the user's​‌ fingertips and palm are​​ measured. A user study​​​‌ validates that our method​ successfully adjusts the handle​‌ to a set of​​ users, ensuring ergonomic comfort.​​​‌ Our results demonstrate the​ potential of our method​‌ for fabricating personalized sensing​​ devices, enabling designers to​​​‌ explore diverse structures by​ transforming a single template​‌ design 1516.​​

9 Bilateral contracts and​​​‌ grants with industry

9.1​ Bilateral contracts with industry​‌

9.1.1 IRT JV Happy2​​

Participant: Romain Lagneau,​​​‌ Fabien Spindler, François​ Chaumette.

No Inria​‌ Rennes 13521, duration: 72​​ months.

F. Chaumette is​​​‌ in secondment (at 20%)​ at IRT Jules Verne​‌ in Nantes since 2018.​​ This year, he was​​​‌ involved the Happy 2​ project with Airbus &​‌ Naval Group to give​​ his expertise in visual​​​‌ servoing. Based on ViSP,​ a model-based tracking algorithm​‌ was transfered and integrated​​ in a demonstrator at​​​‌ IRT to assemble two​ airplane parts.

 

9.1.2 Trasys/NRB​‌

Participants: Romain Lagneau,​​ Fabien Spindler, François​​​‌ Chaumette.

No Inria​ Rennes 2023000390, duration: 19​‌ months.

This project started​​ in May 2023. It​​​‌ was in collaboration with​ the Trasys/NRB company in​‌ Belgium. Its goal was​​ to develop an embedded​​​‌ vision-based localization system with​ respect to satellite parts.​‌

 

9.1.3 Sopra-Steria

Participants: François​​ Pasteau, Marie Babel​​​‌, Sylvain Guegan,​ Fabien Grzeskowiak.

INSA​‌ Rennes, duration: 72 months.​​

This project funded by​​​‌ Sopra Steria aimed to​ design new assistive robotics​‌ and to support clinical​​ trials activities.

9.2 Bilateral​​​‌ grants with industry

9.2.1​ IRT JV Perform

Participant:​‌ François Chaumette.

No​​ Inria Rennes 16107, duration:​​​‌ 42 months.

This project​ funded by IRT Jules​‌ Verne started in November​​ 2021. It was achieved​​​‌ in cooperation with Stéphane​ Caro from LS2N in​‌ Nantes to support Sophie​​ Rousseau's PhD at IRT​​​‌ Jules Verne about sensor-based​ control and vibration reduction​‌ of cable-driven parallel robots.​​ Sophie Rousseau defended her​​​‌ PhD entitled "Sensor-Based Control​ and Vibration Reduction of​‌ Cable-Driven Parallel Robots" in​​ May 2025 at Ecole​​​‌ Centrale de Nantes.

9.2.2​ Commande partagée centrée sur​‌ l'humain pour la télémanipulation​​ robotique à différentes échelles​​

Participant: Claudio Pacchierotti,​​​‌ Paolo Robuffo Giordano.‌

Convention cifre 2023/1119. Duration:‌​‌ 36 months.

This project​​ is funded by Haption,​​​‌ Laval, and funds the‌ PhD of Paul Mefflet‌​‌ on shared control for​​ tele-manipulation

10 Partnerships and​​​‌ cooperations

10.1 International initiatives‌

10.1.1 Inria associate team‌​‌ not involved in an​​ IIL or an international​​​‌ program

SocNav

Participants: Anne-Hélène‌ Olivier, Julien Pettré‌​‌, Marie Babel,​​ François Pasteau, Louise​​​‌ Devigne, Fabien Grzeskowiak‌, Sebastien Thomas.‌​‌

  • Title:
    Studying complex social​​ navigation with an innovative,​​​‌ co-developed immersive platform
  • Duration:‌
    January 2024 - December‌​‌ 2026
  • Coordinator:
    Anne-Hélène Olivier​​ (Virtus team) O
  • Partners:​​​‌
    Université Laval Quebec (Canada)‌ - Fondation Saint Hélier‌​‌
  • Inria contact:
    Anne-Hélène Olivier​​
  • Summary:
    The objective is​​​‌ to the study of‌ locomotor navigation in more‌​‌ socially complex environments representative​​ of daily life, while​​​‌ considering the confounding effects‌ of one’s physical limitations‌​‌ for different modes of​​ transport (i.e., biped vs​​​‌ wheeled). We aim to‌ not only improve our‌​‌ understanding of the trade-offs​​ in anticipatory and reactive​​​‌ control for locomotor navigation‌ of complex social environments,‌​‌ but also significantly contribute​​ to improving assessment and​​​‌ training tools, and the‌ development of intelligent mobility‌​‌ aids (smart wheelchairs).

10.1.2​​ Participation in other International​​​‌ Programs

BIFROST

Participants: Mandela‌ Ouafo Fonkoua, Alexandre‌​‌ Krupa, François Chaumette​​, Fabien Spindler.​​​‌

  • Title:
    A Visual-Tactile Perception‌ and Control Framework for‌​‌ Advanced Manipulation of 3D​​ Compliant Objects
  • Duration:
    July​​​‌ 2021 - December 2025‌
  • Coordinator:
    Sintef Ocean (Norway)‌​‌
  • Partners:
    • Sintef Ocean (Norway)​​
    • MIT (USA)
  • Inria contact:​​​‌
    Alexandre Krupa
  • Summary:
    This‌ project is granted by‌​‌ The Research Council of​​ Norway. Its main objective​​​‌ is to develop a‌ visual-tactile perception and Control‌​‌ framework for advanced manipulation​​ of 3D compliant objects.​​​‌ The Rainbow group is‌ in charge of elaborating‌​‌ novel visual servoing approaches​​ for dexterous manipulation of​​​‌ soft objects.

10.2 International‌ research visitors

10.2.1 Visits‌​‌ of international scientists

Other​​ international visits to the​​​‌ team
Ekrem Misimi
  • Status:‌
    researcher
  • Institution of origin:‌​‌
    Sintef Ocean
  • Country:
    Norway​​
  • Dates:
    February 17 to​​​‌ July 18, 2025
  • Context‌ of the visit:
    partner‌​‌ in the BIFROST project​​
  • Mobility program/type of mobility:​​​‌
    research stay

10.3 European‌ initiatives

10.3.1 Horizon Europe‌​‌

REGO project on cordis.europa.eu​​

  • Title:
    Cognitive robotic tools​​​‌ for human-centered small-scale multi-robot‌ operations
  • Duration:
    From October‌​‌ 1, 2022 to September​​ 30, 2026
  • Partners:
    • INSTITUT​​​‌ NATIONAL DE RECHERCHE EN‌ INFORMATIQUE ET AUTOMATIQUE (INRIA),‌​‌ France
    • CENTRE HOSPITALIER UNIVERSITAIRE​​ DE RENNES (CHU RENNES),​​​‌ France
    • UNIVERSITEIT TWENTE (UNIVERSITEIT‌ TWENTE), Netherlands
    • SCUOLA SUPERIORE‌​‌ DI STUDI UNIVERSITARI E​​ DI PERFEZIONAMENTO S ANNA​​​‌ (SSSA), Italy
    • FONDAZIONE ISTITUTO‌ ITALIANO DI TECNOLOGIA (IIT),‌​‌ Italy
    • HAPTION SA (HAPTION),​​ France
    • CENTRE NATIONAL DE​​​‌ LA RECHERCHE SCIENTIFIQUE CNRS‌ (CNRS), France
    • HELMHOLTZ-ZENTRUM DRESDEN-ROSSENDORF‌​‌ EV (HZDR), Germany
  • Inria​​ contact:
    Claudio Pacchierotti
  • Coordinator:​​​‌
    Claudio Pacchierotti
  • Summary:
    Robots‌ are still often regarded‌​‌ as large machines with​​ links, gears, and electric​​​‌ motors, autonomously interacting with‌ the surrounding environment. Despite‌​‌ the great research efforts​​ in robotics and human-robot​​​‌ interaction (HRI), the way‌ we design, use, and‌​‌ control robots has not​​​‌ fundamentally changed in the​ past 20 years. We​‌ see in small-scale wireless​​ multi-robot systems and cognitive​​​‌ HRI a revolutionary answer​ to nowadays robots limitations.​‌ Instead of large, tethered​​ machines, that are difficult​​​‌ for the human user​ to control, REGO proposes​‌ an innovative set of​​ AI-powered, modular, microsized swarms​​​‌ of robots. They are​ wirelessly steered by electromagnetic​‌ fields as well as​​ able to react to​​​‌ other external stimuli, and​ then naturally controlled by​‌ humans through intuitive dexterous​​ interfaces and interaction techniques.​​​‌ Taking advantage of AI​ multi-robot control strategies, these​‌ robots can team up​​ and collaborate to fulfill​​​‌ complex tasks in a​ robust and unprecedented flexible​‌ way. By exploiting multisensory​​ interaction techniques and cognitive​​​‌ shared control, the operator​ will achieve an unparalleled​‌ level of seamless interaction​​ and continuous collaboration with​​​‌ the robotic team. According​ to the application at​‌ hand, the robotic team​​ will feature different task-specific​​​‌ characteristics (e.g., biocompatibility for​ medical procedures, biodenitrification for​‌ cleaning water, ability to​​ carry drugs to fight​​​‌ infections) and be dispatched​ through various delivery systems,​‌ including a stimuli-responsive milli-scale​​ wireless robotic carrier developed​​​‌ within the project. To​ achieve this revolution, REGO​‌ will develop magnetic multi-robot​​ motion control systems, autonomous​​​‌ swarm control techniques for​ micro-sized robots, human-robot haptic-centered​‌ interfaces, and cognitive shared-control​​ techniques. REGO enables the​​​‌ next generation of AI-powered​ interactive small-size multi-robots systems,​‌ with increased capabilities to​​ work with each other​​​‌ and their human operators.​
euROBIN

euROBIN project on​‌ cordis.europa.eu

  • Title:
    European ROBotics​​ and AI Network
  • Duration:​​​‌
    From July 1, 2022​ to June 30, 2026​‌
  • Partners:
    • INSTITUT NATIONAL DE​​ RECHERCHE EN INFORMATIQUE ET​​​‌ AUTOMATIQUE (INRIA), France
    • C.R.E.A.T.E.​ CONSORZIO DI RICERCA PER​‌ L'ENERGIA L AUTOMAZIONE E​​ LE TECNOLOGIE DELL'ELETTROMAGNETISMO (C.R.E.A.T.E.),​​​‌ Italy
    • PAL ROBOTICS SLU​ (PAL ROBOTICS), Spain
    • KUNGLIGA​‌ TEKNISKA HOEGSKOLAN (KTH), Sweden​​
    • INSTITUT JOZEF STEFAN (JSI),​​​‌ Slovenia
    • FRAUNHOFER GESELLSCHAFT ZUR​ FORDERUNG DER ANGEWANDTEN FORSCHUNG​‌ EV (Fraunhofer), Germany
    • FUNDACION​​ TECNALIA RESEARCH & INNOVATION​​​‌ (TECNALIA), Spain
    • TECHNISCHE UNIVERSITAET​ MUENCHEN (TUM), Germany
    • DHL​‌ EXPRESS SPAIN SL, Spain​​
    • COMMISSARIAT A L ENERGIE​​​‌ ATOMIQUE ET AUX ENERGIES​ ALTERNATIVES (CEA), France
    • INTERUNIVERSITAIR​‌ MICRO-ELECTRONICA CENTRUM (IMEC), Belgium​​
    • TEKNOLOGISK INSTITUT (DANISH TECHNOLOGICAL​​​‌ INSTITUTE), Denmark
    • UNIVERSITEIT TWENTE​ (UNIVERSITEIT TWENTE), Netherlands
    • ASEA​‌ BROWN BOVERI SA (ABB),​​ Spain
    • ECOLE POLYTECHNIQUE FEDERALE​​​‌ DE LAUSANNE (EPFL), Switzerland​
    • STV MACHINERY AS, Slovakia​‌
    • DEUTSCHES ZENTRUM FUR LUFT​​ - UND RAUMFAHRT EV​​​‌ (DLR), Germany
    • IST-ID ASSOCIACAO​ DO INSTITUTO SUPERIOR TECNICO​‌ PARA A INVESTIGACAO E​​ O DESENVOLVIMENTO (IST ID),​​​‌ Portugal
    • UNIVERSITA DI PISA​ (UNIPI), Italy
    • FUNDINGBOX ACCELERATOR​‌ SP ZOO (FBA), Poland​​
    • UNIVERSITAET BREMEN (UBREMEN), Germany​​​‌
    • FONDAZIONE ISTITUTO ITALIANO DI​ TECNOLOGIA (IIT), Italy
    • KARLSRUHER​‌ INSTITUT FUER TECHNOLOGIE (KIT),​​ Germany
    • EIDGENOESSISCHE TECHNISCHE HOCHSCHULE​​​‌ ZUERICH (ETH Zürich), Switzerland​
    • CESKE VYSOKE UCENI TECHNICKE​‌ V PRAZE (CVUT), Czechia​​
    • OREBRO UNIVERSITY (ORU), Sweden​​​‌
    • CENTRE NATIONAL DE LA​ RECHERCHE SCIENTIFIQUE CNRS (CNRS),​‌ France
    • VOLKSWAGEN AKTIENGESELLSCHAFT (VW​​ AG), Germany
    • SIEMENS AKTIENGESELLSCHAFT,​​​‌ Germany
    • SORBONNE UNIVERSITE, France​
    • UNIVERSIDAD DE SEVILLA, Spain​‌
  • Inria contact:
    Serena Ivaldi​​
  • Coordinator:
  • Summary:

    As robots​​​‌ are entering unstructured environments​ with a large variety​‌ of tasks, they will​​ need to quickly acquire​​ new abilities to solve​​​‌ them. Humans do so‌ very effectively through a‌​‌ variety of methods of​​ knowledge transfer – demonstration,​​​‌ verbal explanation, writing, the‌ Internet. In robotics, enabling‌​‌ the transfer of skills​​ and software between robots,​​​‌ tasks, research groups, and‌ application domains will be‌​‌ a game changer for​​ scaling up the robot​​​‌ abilities.

    euROBIN therefore proposes‌ a threefold strategy: First,‌​‌ leading experts from the​​ European robotics and AI​​​‌ research community will tackle‌ the questions of transferability‌​‌ in four main scientific​​ areas: 1) boosting physical​​​‌ interaction capabilities, to increase‌ safety and reliability, as‌​‌ well as energy efficiency​​ 2) using machine learning​​​‌ to acquire new behaviors‌ and knowledge about the‌​‌ environment and the robot​​ and to adapt to​​​‌ novel situations 3) enabling‌ robots to represent, exchange,‌​‌ query, and reason about​​ abstract knowledge 4) ensuring​​​‌ a human-centric design paradigm,‌ that takes the needs‌​‌ and expectations of humans​​ into account, making AI-enabled​​​‌ robots accessible, usable and‌ trustworthy.

    Second, the relevance‌​‌ of the scientific outcomes​​ will be demonstrated in​​​‌ three application domains that‌ promise to have substantial‌​‌ impact on industry, innovation,​​ and civil society in​​​‌ Europe. 1) robotic manufacturing‌ for a circular economy‌​‌ 2) personal robots for​​ enhanced quality of life​​​‌ 3) outdoor robots for‌ sustainable communities. Advances are‌​‌ made measurable by collaborative​​ competitions.

    Finally, euROBIN will​​​‌ create a sustainable network‌ of excellence to foster‌​‌ exchange and inclusion. Software,​​ data and knowledge will​​​‌ be exchanged over the‌ EuroCore repository, designed to‌​‌ become a central platform​​ for robotics in Europe.​​​‌

    The vision of euROBIN‌ is a European ecosystem‌​‌ of robots that share​​ their data and knowledge​​​‌ and exploit their diversity‌ to jointly learn to‌​‌ perform the endless variety​​ of tasks in human​​​‌ environments.

10.3.2 H2020 projects‌

GuestXR

GuestXR project on‌​‌ cordis.europa.eu

  • Title:
    GuestXR: A​​ Machine Learning Agent for​​​‌ Social Harmony in eXtended‌ Reality
  • Duration:
    From January‌​‌ 1, 2022 to December​​ 31, 2025
  • Partners:
    • INSTITUT​​​‌ NATIONAL DE RECHERCHE EN‌ INFORMATIQUE ET AUTOMATIQUE (INRIA),‌​‌ France
    • UNIWERSYTET WARSZAWSKI (UNIWARSAW),​​ Poland
    • VIRTUAL BODYWORKS SL​​​‌ (Virtual Bodyworks S.L.), Spain‌
    • UNIVERSITEIT MAASTRICHT, Netherlands
    • UNIVERSITAT‌​‌ DE BARCELONA (UB), Spain​​
    • FUNDACIO EURECAT (EURECAT), Spain​​​‌
    • REICHMAN UNIVERSITY (REICHMAN UNIVERSITY),‌ Israel
    • CENTRE NATIONAL DE‌​‌ LA RECHERCHE SCIENTIFIQUE CNRS​​ (CNRS), France
    • G.TEC MEDICAL​​​‌ ENGINEERING GMBH (G.TEC MEDICAL‌ ENGINEERING GMBH), Austria
  • Inria‌​‌ contact:
    Anatole LECUYER
  • Coordinator:​​
    Mel Slater
  • Summary:

    Immersive​​​‌ online social spaces will‌ soon become ubiquitous. However,‌​‌ there is also a​​ warning that we need​​​‌ to heed from social‌ media.

    User content is‌​‌ the ‘lifeblood of social​​ media’. However, it often​​​‌ stimulates antisocial interaction and‌ abuse, ultimately posing a‌​‌ danger to vulnerable adults,​​ teenagers, and children.

    In​​​‌ the VR space this‌ is backed up by‌​‌ the experience of current​​ virtual shared spaces. While​​​‌ they have many positive‌ aspects, they have also‌​‌ become a space full​​ of abuse.

    Our vision​​​‌ is to develop GuestXR,‌ a socially interactive multisensory‌​‌ platform system that uses​​ eXtended Reality (virtual and​​​‌ augmented reality) as the‌ medium to bring people‌​‌ together for immersive, synchronous​​​‌ face-to-face interaction with positive​ social outcomes.

    The critical​‌ innovation is the intervention​​ of artificial agents that​​​‌ learn over time to​ help the virtual social​‌ gathering realise its aims.​​ This is an agent​​​‌ that we refer to​ as “The Guest” that​‌ exploits Machine Learning to​​ learn how to facilitate​​​‌ the meeting towards specific​ outcomes.

    Underpinning this is​‌ neuroscience and social psychology​​ research on group behaviour,​​​‌ which will deliver rules​ to Agent Based Models​‌ (ABM).

    The combination of​​ AI with immersive systems​​​‌ (including haptics and immersive​ audio), virtual and augmented​‌ reality will be a​​ hugely challenging research task,​​​‌ given the vagaries of​ social meetings and individual​‌ behaviour. Several proof of​​ concept applications will be​​​‌ developed during the project,​ including a conflict resolution​‌ application in collaboration with​​ the UN. A strong​​​‌ User Group made up​ of a diverse range​‌ of stakeholders from industry,​​ academia, government and broader​​​‌ society will provide continuous​ feedback. An Open Call​‌ will be held to​​ bring in artistic support​​​‌ and additional use cases​ from wider society. Significant​‌ work is dedicated to​​ ethics “by design”, to​​​‌ identify problems and look​ eventually towards an appropriate​‌ regulatory framework for such​​ socially interactive systems.

10.4​​​‌ National initiatives

10.4.1 Equipex+​ Tirrex

Participants: Fabien Spindler​‌, François Chaumette,​​ Alexandre Krupa.

no​​​‌ Inria Rennes OIP 03-22-01,​ duration: 8 years.

This​‌ large national project devoted​​ to open robotics platforms​​​‌ started in December 2021.​ Rainbow is responsible of​‌ the manipulation axis for​​ which a new TRIAGo​​​‌ platform (Multi-arm Multi-sensor Mobile​ Manipulator) was designed by​‌ PAL Robotics and installed​​ in our lab in​​​‌ April 2025.

10.4.2 PEPR​ O2R

Participants: Maud Marchal​‌, Marie Babel.​​

duration: 8 years.

The​​​‌ Organic Robotics program proposes​ to implement a responsible​‌ and socially acceptable robotics.​​ This PEPR will intensify​​​‌ the multidisciplinary approach of​ the community (digital, life​‌ sciences, engineering, environmental, social​​ sciences) in a strategy​​​‌ that radically differs from​ the current vision of​‌ robotics and its limitations.​​ The Organic Robotics program​​​‌ therefore aims to initiate​ a shift in robotics​‌ allowing to create a​​ new generation of robots​​​‌ capable of interacting and​ working in symbiosis with​‌ humans. We propose to​​ consider the robot, no​​​‌ longer as an automation​ machine, but as a​‌ tool, in line with​​ those that humans have​​​‌ created, used and optimized​ in order to explore​‌ and act on their​​ environment. More efficient, modular,​​​‌ reconfigurable and adaptive, organic​ robots will become an​‌ extension of humans. The​​ PEPR O2R started in​​​‌ September 2023. M. Marchal​ has contributed to the​‌ proposal writing and is​​ a member of the​​​‌ executive committee.

Marie Babel​ participates to the ASSISTMOV​‌ project that aims to​​ design innovative robotic assistance​​​‌ through upper-limb exoskeleton. She​ is a member of​‌ the steering committee of​​ ASSISTMOV project.

Maud Marchal​​​‌ participates to the REINVENT​ and AS4 projects.  

10.4.3​‌ PEPR O2R - AS2​​ structuring action

Participants: Alexandre​​​‌ Krupa, Fabien Spindler​.

  • Title:
    PEPR O2R​‌ - AS2 structuring action​​ “Robot motion with physical​​ interactions and social adaptation”​​​‌
  • Duration:
    January 2024 -‌ December 2031
  • Coordinator:
    LASS-CNRS‌​‌ (Toulouse)
  • Partners:
    • Gepeto (LAAS),​​ IDH (LIRMM), Willow (Inria),​​​‌ Auctus (Inria), Rainbow (Inria),‌ Robioss (PPRIME), CERCA (CNRS),‌​‌ ICNA (ONERA), Habiter le​​ Monde (UPJV)
  • Summary:
    In​​​‌ the context of the‌ national PEPR O2R robotic‌​‌ exploration program, Alexandre Krupa​​ is involved in the​​​‌ AS2 structuring action. This‌ structuring action aims to‌​‌ rethink the problem of​​ motion generation in robotic​​​‌ systems, taking a global‌ approach and redefining research‌​‌ objectives in conjunction with​​ the Human and Social​​​‌ Sciences. Within this AS2‌ action, the Rainbow group‌​‌ is involved on the​​ development of multi-sensor control​​​‌ strategies for the control‌ of physically interacting robotic‌​‌ systems. Since January 2024,​​ Alexandre Krupa has been​​​‌ co-supervising a PhD student‌ based at LIRMM with‌​‌ Philippe Fraisse (LIRMM) and​​ Andrea Cherubini (LS2N), whose​​​‌ thesis focuses on the‌ robotic manipulation of deformable‌​‌ objects using the LIRMM​​ dual-arm robot BAZAR.

 

10.4.4​​​‌ PEPR eNSEMBLE

Participant: Maud‌ Marchal.

duration: 8‌​‌ years.

The purpose of​​ eNSEMBLE (Future of Digital​​​‌ Collaboration) is to fundamentally‌ redefine digital tools for‌​‌ collaboration. To address this​​ challenge, a paradigm shift​​​‌ in the design of‌ collaborative systems is needed,‌​‌ comparable to the one​​ that saw the advent​​​‌ of personal computing. To‌ collaborate in a fluid‌​‌ and natural way while​​ taking advantage of computer​​​‌ capabilities, collaboration and sharing‌ must become native features‌​‌ of computer systems, in​​ the same way that​​​‌ files or applications are‌ today. To achieve this‌​‌ goal, we need to​​ invent mixed (i.e. physical​​​‌ and digital) collaboration spaces‌ that do not simply‌​‌ replicate the physical world​​ in virtual environments, enabling​​​‌ co-located and/or geographically distributed‌ teams to work together‌​‌ smoothly and efficiently. The​​ PEPR eNSEMBLE started in​​​‌ September 2023. M. Marchal‌ has contributed to the‌​‌ writing of the proposal​​ and is one of​​​‌ PC1 project leaders.

 

10.4.5‌ ANR Marsurg

Participants: Eric‌​‌ Marchand, François Chaumette​​, Fabien Spindler.​​​‌

no Inria 16162, duration:‌ 48 months.

This project‌​‌ started in September 2021.​​ It involves a consortium​​​‌ managed by ISIR (Paris)‌ with Pixee Medical and‌​‌ Rainbow group. It aims​​ at researching markerless augmented​​​‌ reality solution for orthopedic‌ surgery

 

10.4.6 Inria Challenge‌​‌ DORNELL

Participants: Marie Babel​​, Claudio Pacchierotti,​​​‌ Maud Marchal, François‌ Pasteau, Sylvain Guegan‌​‌, Louise Devigne,​​ Marco Aggravi, Inès​​​‌ Lacôte, Pierre-Antoine Cabaret‌, Lisheng Kuang.‌​‌

  • Title:
    DORNELL: A multimodal,​​ shapeable haptic handle for​​​‌ mobility assistance of people‌ with disabilities
  • Duration:
    November‌​‌ 2020 - December 2024​​
  • Coordinators:
    Marie Babel, Claudio​​​‌ Pacchierotti
  • Partners:
    • Potioc Inria‌ team
    • MFX Inria team‌​‌
    • LGCGM (Rennes)
    • Centre de​​ rééducation Pôle Saint Hélier​​​‌ (Rennes)
    • ISIR (Paris)
    • Institut‌ des jeunes aveugles (Yzeure)‌​‌
  • Inria contact:
    Marie Babel,​​ Claudio Pacchierotti
  • Summary:
    While​​​‌ technology helps people to‌ compensate for a broad‌​‌ set of mobility impairments,​​ visual perception and/or cognitive​​​‌ deficiencies still significantly affect‌ their ability to move‌​‌ safely and easily. We​​ propose an innovative multisensory,​​​‌ multimodal, smart haptic handle‌ that can be easily‌​‌ plugged onto a wide​​​‌ range of mobility aids,​ including white canes, precanes,​‌ walkers, and power wheelchairs.​​ Specifically fabricated to fit​​​‌ the needs of a​ person, it provides a​‌ wide set of ungrounded​​ tactile sensations (e.g., pressure,​​​‌ skin stretch, vibrations) in​ a portable and plug-and-play​‌ format – bringing haptics​​ in assistive technologies all​​​‌ at once. The project​ will address important scientific​‌ and technological challenges, including​​ the study of multisensory​​​‌ perception, the use of​ new materials for multimodal​‌ haptic feedback, and the​​ development of a haptic​​​‌ rendering API to adapt​ the feedback to different​‌ assistive scenarios and user’s​​ wishes. We will co-design​​​‌ DORNELL with users and​ therapists, driving our development​‌ by their expectations and​​ needs.

 

10.4.7 BPI Lichie​​​‌

Participants: François Chaumette.​

no Inria 14876, duration:​‌ 72 months.

This project​​ started in March 2020.​​​‌ It involves a consortium​ managed by Airbus Defense​‌ and Space (Toulouse) with​​ many companies, Onera and​​​‌ Inria. It aims at​ designing a new constellation​‌ of satellites with on-board​​ imaging facilities. Robotics for​​​‌ the assembly of the​ satellites is also studied.​‌ François Chaumette is the​​ Inria scientific coordinator of​​​‌ this project who funded​ 9 PhD and 9​‌ post-doc for the Rainbow,​​ Sairpico, and Sirocco groups​​​‌ in Rennes, Auctus in​ Bordeaux and Ayana in​‌ Sophia-Antipolis.

 

10.4.8 ANR CAMP​​

Participants: Paolo Robuffo Giordano​​​‌, Fabien Spindler,​ Ali Srour, Tommaso​‌ Belvedere, Salvatore Marcellini​​.

  • Title:
    Intrinsically-Robust and​​​‌ Control-Aware Motion Planning for​ Robots in Real-World Conditions​‌
  • Duration:
    October 2020 -​​ June 2026
  • Coordinator:
    P.​​​‌ Robuffo Giordano
  • Partners:
    • LAAS​ (Toulouse)
    • Univ. Twente (Netherlands)​‌
  • Inria contact:
    P. Robuffo​​ Giordano
  • Summary:
    An effective​​​‌ way of dealing with​ the complexity of robots​‌ operating in real (uncertain)​​ environments is the paradigm​​​‌ of “feedforward/feedback” or “planning/control”:​ in a first step​‌ a suitable nominal trajectory​​ (feedforward) for the robot​​​‌ states/controls is planned exploiting​ the available information (e.g.,​‌ a model of the​​ robot and of the​​​‌ environment). While there has​ been an effort in​‌ proposing “robust planners” or​​ more “global controllers” (e.g.,​​​‌ Model Predictive Control (MPC)),​ a truly unified approach​‌ that fully exploits the​​ techniques of the motion​​​‌ planning and control/estimation communities​ is still missing and​‌ the existing state-of-the-art has​​ several important limitations, namely​​​‌ (1) lack of generality,​ (2) lack of computational​‌ efficiency, and (3) poor​​ robustness. In this respect,​​​‌ the ambition of CAMP​ is to (1) develop​‌ a general and unified​​ “intrinsically-robust and control-aware motion​​​‌ planning framework” able to​ address all the above-mentioned​‌ issues, and to (2)​​ demonstrate the applicability of​​​‌ this new framework to​ real robots in real-world​‌ challenging tasks. In particular​​ we envisage two robotics​​​‌ demonstrators for showing at​ best the effectiveness and​‌ generality of our methodology:​​ (1) an indoor pick-​​​‌ and-place/assembly task involving a​ 7-dof torque-controlled arm for​‌ a first validation in​​ “controlled conditions” and (2)​​​‌ an outdoor cooperative mobile​ manipulation task involving an​‌ aerial manipulator (a quadrotor​​ UAV equipped with an​​​‌ onboard arm) and a​ skid-steering mobile robot with​‌ an onboard arm for​​ a final validation in​​ much less favorable experimental​​​‌ conditions (see Sect. 8.1.1‌)

10.4.9 ANR MULTISHARED‌​‌

Participants: Paolo Robuffo Giordano​​, Claudio Pacchierotti,​​​‌ Vincent Drevelle, Nicola‌ De Carli, Maxime‌​‌ Bernard, Esteban Restrepo​​.

  • Title:
    Shared-Control Algorithms​​​‌ for Human/Multi-Robot Cooperation
  • Duration:‌
    September 2020 - October‌​‌ 2025
  • Coordinator:
    P. Robuffo​​ Giordano
  • Inria contact:
    P.​​​‌ Robuffo Giordano
  • Summary:
    The‌ goal of the Chaire‌​‌ AI MULTISHARED is to​​ significantly advance the state-of-the-art​​​‌ in multi-robot autonomy and‌ human-multi-robot interaction for allowing‌​‌ a human operator to​​ intuitively control the coordinated​​​‌ motion of a multi-UAV‌ group navigating in remote‌​‌ environments, with a strong​​ emphasis on the division​​​‌ of roles between multi-robot‌ autonomy (in controlling its‌​‌ motion/configuration and online decision-making)​​ and human intervention/guidance for​​​‌ providing high-level commands to‌ the group while being‌​‌ most aware of the​​ group status via VR​​​‌ and haptics technology (see‌ Sect. 8.1.9).

10.4.10‌​‌ ANR MATES

Participants: Claudio​​ Pacchierotti, Paolo Robuffo​​​‌ Giordano, Marco Tognon‌, Valeria Braglia,‌​‌ Francesco Russo, Esteban​​ Restrepo.

  • Title:
    Multi-drone-human​​​‌ collaboration teams for high-risk‌ assembling and handling tasks‌​‌
  • Duration:
    March 2025 -​​ February 2029
  • Coordinator:
    Claudio​​​‌ Pacchierotti
  • Partners:
    • LAAS (Toulouse)‌
  • Inria contact:
    Claudio Pacchierotti‌​‌
  • Summary:
    Despite the great​​ recent progress in automation,​​​‌ computer science, and machine‌ learning, robots still have‌​‌ many limitations (e.g., limited​​ cognitive/manipulation capabilities) and they​​​‌ cannot fulfill alone the‌ wide range of tasks‌​‌ that humans can perform.​​ Achieving an effective collaboration​​​‌ between robots and humans‌ could clearly enlarge the‌​‌ nature of tasks that​​ can be addressed together.​​​‌ The aim of this‌ project is to propose‌​‌ a multi-robot system that​​ allows humans to remotely​​​‌ perform tasks at high‌ locations eliminating any potential‌​‌ risk for the operator.​​ Since ground robots cannot​​​‌ be employed in such‌ conditions, we propose a‌​‌ human-multi-drone team in which​​ a human user remotely​​​‌ controls a group of‌ drones in completing a‌​‌ complex task that requires​​ advanced coordination and manipulation​​​‌ capabilities. To achieve such‌ an ambitious goal, it‌​‌ is essential that drones​​ acquire manipulation capabilities as​​​‌ well as improve their‌ interaction and coordination with‌​‌ humans. Moreover, several advancements​​ in the theory, control,​​​‌ and interaction of coordinated‌ human-drone teams should be‌​‌ accomplished. As a representative​​ example of a high-impact​​​‌ scenario, we plan to‌ carry out a peg-in-hole‌​‌ task at a high​​ location: A group of​​​‌ drones collaboratively transports an‌ object, i.e., a peg,‌​‌ to a target location,​​ i.e., a hole. Once​​​‌ it has been reached,‌ an aerial manipulator grasps‌​‌ the lower part of​​ the peg and inserts​​​‌ it into the hole,‌ coordinating its motion with‌​‌ the one of the​​ transport team. These actions​​​‌ are remotely imparted by‌ a human operator, who‌​‌ controls the synergistic motion​​ of the aerial team​​​‌ using a grounded haptic‌ interface and shared-control techniques.‌​‌ At the same time,​​ the operator receives information​​​‌ about the task, the‌ team, and the interaction‌​‌ with the environment, through​​ a combination of grounded​​​‌ and wearable haptic feedback.‌ A view of the‌​‌ remote environment is provided​​​‌ to the operator through​ a VR headset thanks​‌ to a group of​​ supporting drones equipped with​​​‌ cameras.

10.4.11 ANR JCJC​ AirHandyBot

Participants: Marco Tognon​‌, Paolo Robuffo Giordano​​, Lorenzo Balandi,​​​‌ Maximilian Mehl, Gianluca​ Corsini, Fabien Spindler​‌.

  • Title:
    Aerial Robots​​ for True Manipulation of​​​‌ Dynamic and Uncertain Environments​
  • Duration:
    November 2023 -​‌ October 2026
  • Coordinator:
    Marco​​ Tognon
  • Inria contact:
    Marco​​​‌ Tognon
  • Summary:
    One of​ the main goals of​‌ robotics is to realize​​ autonomous systems that can​​​‌ help human operators in​ tasks that are hard​‌ and dangerous (e.g., in​​ elevated areas). It is​​​‌ therefore important to conceive​ robots that can perform​‌ physical work executing complex​​ tasks requiring the interaction​​​‌ with the environment and​ the manipulation of objects.​‌ In particular, having aerial​​ robots able to interact​​​‌ with the environment, would​ open the door new​‌ applications in dangerous and​​ hardly accessible area, like​​​‌ manipulation of objects, contact-based​ inspection, and construction. Aiming​‌ to show the feasibility​​ of Aerial Physical Interaction​​​‌ (APhI), previous works focused​ on the design and​‌ control of aerial manipulators.​​ However, current investigations and​​​‌ applications are still limited​ to simple interaction tasks,​‌ involving limited contact behaviors​​ with static and rigid​​​‌ surfaces, moreover performed in​ known and structured environments.​‌ To deploy aerial manipulators​​ in real scenarios, they​​​‌ must be able to​ perform more complex manipulation​‌ tasks in less structured​​ situations. Because of the​​​‌ application, scientific interest, and​ possible future impact of​‌ APhI, FlyHandyBot aims to​​ enhance APhI capabilities of​​​‌ highly dynamical aerial manipulators​ by considering: - manipulations​‌ tasks of movable and​​ articulated objects, relying on​​​‌ onboard sensors only; -​ real scenarios characterized by​‌ disturbances and uncertainties due​​ to system modeling errors,​​​‌ noisy and imprecise measurements​ coming from lightweight onboard​‌ sensors, imprecise actuation models​​ due to complex aerodynamic​​​‌ effects, and partially unknown​ environments. The investigation, including​‌ fundamental theoretical results, real​​ experiments and practical demonstrations,​​​‌ will focus on the​ design of new conception,​‌ modeling and control methods​​ to make aerial robots​​​‌ much more precise, robust​ and safe while performing​‌ physical interaction tasks in​​ real environments. This will​​​‌ allow aerial robots to​ be in the future​‌ valid companions of human​​ operators.

10.4.12 ANR DyNNAMo​​​‌

Participants: Marie Babel,​ François Pasteau, Louise​‌ Devigne.

  • Title:
    Shared-Control​​ Algorithms for Human/Multi-Robot Cooperation​​​‌
  • Duration:
    April 2025 -​ October 2029
  • Coordinator:
    S.​‌ Le Nours
  • Inria contact:​​
    Marie Babel
  • Summary:
    The​​​‌ DyNNAMO project aims to​ define and validate a​‌ modeling and analysis workflow​​ for the design and​​​‌ optimization of an innovative​ hardware-software architecture, specifically tailored​‌ to enhance detection capabilities​​ in power wheelchairs. The​​​‌ proposed architecture leverages dynamic​ neural networks (DNNs), which​‌ autonomously adjust their computational​​ workload in response to​​​‌ real-time operating conditions.

10.4.13​ AeX AEROTouch

Participants: Marco​‌ Tognon, Tommaso Belvedere​​, Lluis Prior,​​​‌ Gianluca Corsini, Fabien​ Spindler.

  • Title:
    Aerial​‌ Robots with the Sense​​ of Touch
  • Duration:
    November​​​‌ 2023 - October 2029​
  • Coordinator:
    Marco Tognon
  • Inria​‌ contact:
    Marco Tognon
  • Summary:​​
    Researchers are trying to​​ make aerial robots perform​​​‌ physical work. Current methodologies‌ show promising results, but‌​‌ they fail in real​​ scenarios, mostly because of​​​‌ inaccurate visual perception. Inspired‌ by nature, this project‌​‌ investigates how to also​​ provide aerial robots with​​​‌ the sense of touch‌ and how to use‌​‌ it for improving their​​ manipulation capabilities.

10.4.14 AeX​​​‌ RobotiCore

Participants: Marco Tognon‌, Tommaso Belvedere,‌​‌ Gianluca Corsini.

  • Title:​​
    Integrated Hardware Acceleration: the​​​‌ Brain and Heart Behind‌ Next-Generation Robots
  • Duration:
    November‌​‌ 2025 - October 2028​​
  • Coordinator:
    Marco Tognon and​​​‌ Marcello Traiola (team TARAN)‌
  • Inria contact:
    Marco Tognon‌​‌ and Marcello Traiola (team​​ TARAN)
  • Summary:
    RobotiCore proposes​​​‌ a methodology to accelerate‌ robotic algorithms on a‌​‌ unified hardware accelerator, to​​ improve performance and energy​​​‌ efficiency for small-scale robotic‌ systems. By efficiently accelerating‌​‌ fundamental robotic operations, RobotiCore​​ addresses the limitations of​​​‌ traditional power-hungry hardware platforms,‌ which currently limit scalability‌​‌ and affordability in robotics.​​

10.4.15 Inria AeX MusMaps​​​‌

Participants: Marie Babel,‌ Mael Gallois, Louise‌​‌ Devigne.

  • Title:
    Muscle​​ Mapping for Shared-Control assistance​​​‌ of people with disabilities‌
  • Duration:
    2024 - 2028‌​‌
  • Coordinator:
    Charles Pontonnier (Combo​​ team) and Marie Babel​​​‌
  • Inria contact:
    Charles Pontonnier‌ and Marie Babel
  • Partner:‌​‌
    Fondation Saint Hélier
  • Summary:​​
    The Inria Exploratory Action​​​‌ MusMapS uses effort measurements‌ (mapping of physical capacities)‌​‌ from disabled patients to​​ personalize the assistance of​​​‌ an upper-limb exoskeleton using‌ shared control to help‌​‌ these patients with their​​ everyday movements. The coupling​​​‌ of a musculoskeletal model‌ representative of the patient's‌​‌ physical capabilities with a​​ shared control system for​​​‌ pathologies such as multiple‌ sclerosis or the after-effects‌​‌ of a stroke is​​ innovative and forms the​​​‌ core of the approach.‌

10.4.16 SequoIA Chair HARMONY‌​‌

Participants: Paolo Robuffo Giordano​​, Esteban Restrepo,​​​‌ Claudio Pacchierotti, Andrea‌ Perna.

  • Title:
    Human-AI‌​‌ Robotic Merging for Optimal​​ cooperatioN and efficiency
  • Duration:​​​‌
    September 2025 - August‌ 2029
  • Coordinator:
    Paolo Robuffo‌​‌ Giordano
  • Inria contact:
    Paolo​​ Robuffo Giordano
  • Summary:
    Robots​​​‌ embody Artificial Intelligence (AI)‌ through physical interaction with‌​‌ the environment, yet achieving​​ full autonomy in unstructured​​​‌ settings remains challenging due‌ to limitations in perception,‌​‌ decision-making, and actuation. Human–robot​​ cooperation, and in particular​​​‌ shared control, offers a‌ promising way to enhance‌​‌ autonomy by combining robotic​​ precision with human cognitive​​​‌ capabilities. While shared control‌ has shown success in‌​‌ domains such as telemanipulation,​​ navigation, and medical robotics,​​​‌ current approaches rely on‌ static role allocation between‌​‌ AI and human operators,​​ lack robustness to uncertainty,​​​‌ and often increase human‌ cognitive load. Moreover, the‌​‌ design of intuitive multi-sensory​​ interfaces remains an open​​​‌ challenge. The HARMONY project‌ addresses these limitations through‌​‌ three research axes: (A1)​​ real-time adaptive role allocation​​​‌ based on confidence metrics,‌ (A2) robust AI algorithms‌​‌ resilient to perception uncertainty​​ and dynamic environments, and​​​‌ (A3) advanced multi-sensory and‌ VR-based interfaces to improve‌​‌ human situational awareness. These​​ contributions will be validated​​​‌ on two demonstrators: (D1)‌ shared control of heterogeneous‌​‌ aerial–ground robot teams for​​ cooperative manipulation in a​​​‌ Phygital Twin environment with‌ haptic feedback, and (D2)‌​‌ shared control of an​​​‌ anthropomorphic mobile manipulator for​ human–robot collaborative object transport​‌ with dynamic role adaptation.​​

10.5 Regional initiatives

10.5.1​​​‌ Academic Chair IH2A

Participants:​ Marie Babel, François​‌ Pasteau, Louise Devigne​​, Vincent Drevelle,​​​‌ Maud Marchal, Emilie​ Leblong, Anne-Hélène Olivier​‌, Charles Pontonnier,​​ Thomas Voisin, Sebastien​​​‌ Thomas, Fabien Grzeskowiak​, Claudio Pacchierotti,​‌ Maxime Manzano, Mael​​ Gallois, Theo Le​​​‌ Terrier, Elyse Larribau​.

  • Title:
    Academic Chair​‌ on Innovations, Handicap, Autonomy​​ and Accessibility (IH2A)
  • Duration:​​​‌
    2020-...
  • Coordinator:
    Marie Babel​
  • Inria contact:
    Marie Babel​‌
  • Partners:
    INSA Rennes, Université​​ Rennes, Université Rennes 2,​​​‌ Centre de médecine physique​ et de réadaptation Fondation​‌ Saint Hélier (Rennes), CHU​​ Pontchaillou Rennes, M2S
  • Summary:​​​‌
    This research chair (Innovations,​ Handicap, Autonomy and Accessibility​‌ - IH2A) aims to​​ propose the most appropriate​​​‌ technological solutions to compensate​ for sensorimotor impairments that​‌ limit people's mobility and​​ autonomy in everyday tasks​​​‌ and leisure activities. The​ IH2A Chair aims to​‌ structure these activities from​​ a social, scientific and​​​‌ clinical point of view​ and to be an​‌ effective and innovative tool​​ for the development of​​​‌ large-scale research in this​ field. This multidisciplinary research​‌ and innovative collaborative experiments​​ allow the clinical and​​​‌ scientific validation of the​ technical assistance offered, while​‌ ensuring the accessibility of​​ the solutions deployed.

10.5.2​​​‌ AAP PME HUBERT

Participants:​ Marie Babel, François​‌ Pasteau, Vincent Drevelle​​, Emilie Leblong,​​​‌ Fabien Grzeskowiak.

  • Title:​
    HUBERT
  • Duration:
    January 2023​‌ - June 2026
  • Coordinator:​​
    BA Healthcare
  • Inria contact:​​​‌
    Marie Babel
  • Partners:
    INSA​ Rennes, BA Healthcare, Centre​‌ de médecine physique et​​ de réadaptation Fondation Saint​​​‌ Hélier (Rennes)
  • Summary:
    The​ aim of this project​‌ is to create a​​ range of robotized walkers​​​‌ for geriatric use in​ health and social care​‌ establishments, to give residents​​ or patients greater independence.​​​‌

10.5.3 AAP PME ARDEB​

Participants: Marie Babel,​‌ François Pasteau, Fabien​​ Grzeskowiak.

  • Title:
    ARDEB​​​‌
  • Duration:
    January 2024 -​ December 2027
  • Coordinator:
    BA​‌ Healthcare
  • Inria contact:
    Marie​​ Babel
  • Partners:
    INSA Rennes,​​​‌ BA Healthcare, DK Innovation​
  • Summary:
    The ARDEB project​‌ aims to develop an​​ innovative inclusive mobility solution​​​‌ based on a combination​ of a Segway and​‌ a robotic system that​​ is verticalized, stabilized, and​​​‌ secure. This alternative to​ wheelchairs is designed to​‌ be both compact and​​ versatile, promoting independence and​​​‌ social interaction while minimizing​ the physiological risks associated​‌ with sitting.

11 Dissemination​​

11.1 Promoting scientific activities​​​‌

11.1.1 Scientific events: organisation​

General chair, scientific chair​‌
Member​​ of the organizing committees​​​‌

11.1.2 Scientific events:​​​‌ selection

Chair of conference​ program committees
Member‌​‌ of the conference program​​ committees
Workshop Organization
Reviewer
  • Marco‌​‌ Tognon : IEEE ICRA​​ (1)
  • Claudio Pacchierotti :​​​‌ IEEE ICRA (7), IEEE‌ Conference on Telepresence (2),‌​‌ IEEE IROS (1)
  • Paolo​​ Robuffo Giordano : IEEE​​​‌ ICRA (2)
  • Esteban Restrepo‌ : ECC (2)
  • Eric‌​‌ Marchand : ICCV (3)​​

11.1.3 Journal

Member of​​​‌ the editorial boards
  • Marco‌ Tognon is Associate Editor‌​‌ of the IEEE Transactions​​ on Robotics
  • Claudio Pacchierotti​​​‌ is Associate Editor of‌ the International Journal of‌​‌ Robotics Research (IJRR).
  • Claudio​​ Pacchierotti is Associate Editor​​​‌ of the IEEE Transactions‌ on Haptics.
  • Paolo Robuffo‌​‌ Giordano is Senior Editor​​ of the IEEE Transactions​​​‌ on Robotics
  • Marie Babel‌ is Associate Editor of‌​‌ the IEEE Robotics and​​ Automation Letters
  • Maud Marchal​​​‌ is Associate Editor in‌ Chief of IEEE Transactions‌​‌ on Visualization and Computer​​ Graphics.
  • Maud Marchal is​​​‌ Associate Editor of IEEE‌ Transactions on Haptics.
  • Maud‌​‌ Marchal is Associate Editor​​ of Computers & Graphics.​​​‌
  • Maud Marchal is Associate‌ Editor of ACM Transactions‌​‌ on Applied Perception.
Reviewer​​ - reviewing activities
  • Marco​​​‌ Tognon : Autonomous Robots‌ (1), IEEE TRO (1),‌​‌ Nature Communications (1), IEEE​​ RAL (2), Npj Robotics​​​‌ (1)
  • Claudio Pacchierotti :‌ IEEE Trans. Haptics (2),‌​‌ Philosophical Transactions of the​​ Royal Society B: Biological​​​‌ Sciences (1), International Journal‌ of Human-Computer Interaction (1),‌​‌ Virtual Reality (2), Nature​​ Electronics (1), Multisensory Research​​​‌ (1), IEEE Transactions on‌ Human-Machine Systems (1), IEEE‌​‌ Transactions on Visualization and​​ Computer Graphics (1), IEEE​​​‌ Robotics and Automation Letters‌ (1)
  • Paolo Robuffo Giordano‌​‌ : IEEE CSS-L (2)​​
  • Alexandre Krupa : IEEE​​​‌ RAL (1)
  • Esteban Restrepo‌ : IEEE RAL (1),‌​‌ IEEE TRO (2), IEEE​​ L-CSS (6), IEEE TAC​​​‌ (3), IEEE TCST (1),‌ IEEE IoT (1), Automatica‌​‌ (1)
  • Eric Marchand :​​​‌ IEEE TRO (1)

11.1.4​ Invited talks

  • Marco Tognon​‌ . “Advancements in aerial​​ physical interaction: design control​​​‌ and collaborations”. LAAS-CNRS, Toulouse,​ France. March 2025.
  • Marco​‌ Tognon . “Advancements in​​ aerial physical interaction: design​​​‌ control and collaborations”. University​ of La Reunion, Saint​‌ Denis, La Reunion. September​​ 2025.
  • Paolo Robuffo Giordano​​​‌ . “Intrinsic Robust Planning​ for Uncertain Robots”. Sapienza​‌ Univ Rome, Italy, January​​ 2025
  • Paolo Robuffo Giordano​​​‌ . “Shared Control for​ Tele-manipulation and Tele-navigation at​‌ the Macro and Micro​​ scale”'. GdR Thematic day​​​‌ on “Shared Control”, Paris,​ France, January 2025
  • Paolo​‌ Robuffo Giordano . “Introduction​​ to Sensitivity-Based Robust Planning”.​​​‌ ICRA 2025 Workshop on​ Beyond the Lab: Robust​‌ Planning and Control in​​ Real World Scenarios, May​​​‌ 2025
  • Paolo Robuffo Giordano​ . “Introduction to Sensitivity-Based​‌ Robust Planning”. JNRR 2025​​ Workshop on Introduction to​​​‌ Sensitivity-Based Robust Planning, October​ 2025
  • Paolo Robuffo Giordano​‌ . “Shared Control for​​ Tele-manipulation and Tele-navigation at​​​‌ the Macro and Micro​ scale”'. European Cyber Week​‌ 2025, November 2025
  • Claudio​​ Pacchierotti . “Haptique: la​​​‌ science du toucher.” Visites​ insolites du CNRS, Rennes,​‌ France, 2025.
  • Claudio Pacchierotti​​ . “Haptique: la science​​​‌ du toucher.” Visites insolites​ du CNRS, Rennes, France,​‌ 2025.
  • Claudio Pacchierotti .​​ “Haptic shared control for​​​‌ telerobotics.” Journées Nationales de​ la Recherche en Robotique​‌ (JNRR), Rennes, France, 2025.​​
  • Claudio Pacchierotti . “Cutaneous​​​‌ Haptic Feedback for Human-Centered​ Robotics: a 10-years retrospective.”​‌ Eindhoven University of Technology​​ (TU/e), Eindhoven, The Netherlands,​​​‌ 2025.
  • Claudio Pacchierotti .​ “Cutaneous Haptic Feedback for​‌ Improving Telepresence.” Workshop on​​ “The Importance of Haptics​​​‌ in Telepresence” at IEEE​ World Haptics Conference (WHC),​‌ Suwon, Republic of Korea,​​ 2025.
  • Claudio Pacchierotti .​​​‌ “Wearable cutaneous haptics: an​ historical overview.” Workshop on​‌ “Emerging Challenges in Wearable​​ Haptics” at IEEE World​​​‌ Haptics Conference (WHC), Suwon,​ Republic of Korea, 2025.​‌
  • Claudio Pacchierotti . “Haptics:​​ the science of touch.”​​​‌ Introduction for the keynote​ session on Haptics at​‌ the IEEE International Conference​​ on Robotics and Automation​​​‌ (ICRA), Atlanta, USA, 2025.​
  • Claudio Pacchierotti . “Haptics​‌ for small-scale robotics” Workshop​​ on “Empowering Humans with​​​‌ Miniaturized Sensing and Control:​ Shared Autonomy for Small-Scale​‌ Robots (SASSR)” at the​​ IEEE International Conference on​​​‌ Robotics and Automation (ICRA),​ Atlanta, USA, 2025.
  • Claudio​‌ Pacchierotti . “Haptics for​​ biomedical applications.” Seminar for​​​‌ the M2 course on​ Biomedical Engineering, University of​‌ Twente, Enschede, The Netherlands,​​ 2025.
  • François Chaumette .​​​‌ "Geometric and end-to-end robot​ vision-based control". Plenary talk​‌ at the IEEE International​​ Conference on Emerging Technologies​​​‌ and Computing (ICETC), Brest,​ June 2025
  • Fabien Spindler​‌ presented the national 2RM​​ network of roboticists and​​​‌ mechatronics engineers at the​ National Robotics Research Days​‌ (JNRR 2025), October 2025.​​
  • Gianluca Corsini , Romain​​​‌ Lagneau , Olivier Roussel​ , Fabien Spindler ,​‌ and Samuel Felton each​​ gave presentations on the​​​‌ ROBSTAR robotics platform and​ robotics-related software to promote​‌ ViSP and telekyb3 within​​ the community during the​​​‌ 2RM national meeting (June​ 2025) and at the​‌ first meeting of Inria’s​​ thematic robotics network (Sept.​​​‌ 2025).
  • Esteban Restrepo .​ “Open Multi-Robot Systems for​‌ Resilient Teams.” GdR Robotique​​ TS3 & GICAT Workshop​​ on Multi-Robot Systems, Rennes,​​​‌ France, 2025.
  • Esteban Restrepo‌ . “Towards Resilient and‌​‌ Autonomous Human-Multi-Robot Collaboration.” Seminar​​ for the École normale​​​‌ supérieure de Rennes, Rennes,‌ France, 2025.

11.1.5 Leadership‌​‌ within the scientific community​​

  • Marco Tognon is the​​​‌ co-organizer (co-animateur) of the‌ scientific thematics 3 “Heterogeneity‌​‌ and Complexity” (TS3 “Hétérogénéité​​ et Complexité”, 2024 onwards)​​​‌ of GdR Robotique.
  • Marco‌ Tognon is Co-Chair of‌​‌ the IEEE Technical Committee​​ Aerial Robotics and UAVs​​​‌ (2024 onwards).
  • Paolo Robuffo‌ Giordano was member (elected)‌​‌ of the Section 07​​ of the Comité National​​​‌ de la Recherche Scientifique.‌
  • Paolo Robuffo Giordano has‌​‌ started an appointment as​​ President of the EuRobotics​​​‌ Georges Giralt Award
  • Paolo‌ Robuffo Giordano is co-Chair‌​‌ of the “IEEE​​ RAS Young Reviewers Program​​​‌”, which is part‌ of the IEEE RAS‌​‌ Member Activities Board (MAB)​​
  • Paolo Robuffo Giordano is​​​‌ Distinguished Lecturer for the‌ IEEE RAS Technical Committee‌​‌ on Multi-robot Systems
  • Claudio​​ Pacchierotti is Distinguished Lecturer​​​‌ of the IEEE Robotics‌ & Automation Society for‌​‌ the field of haptics​​ (Region 8: Europe, Middle​​​‌ East and Africa, 2025‌ onwards).
  • Claudio Pacchierotti is‌​‌ Co-Chair, IEEE Technical Committee​​ on Telerobotics (2023 –​​​‌ 2026).
  • Claudio Pacchierotti is‌ Scientific Advisory Board, “TOAST:‌​‌ Touch-enabled Tactile Internet Training​​ Network and Open Source​​​‌ Testbed,” Marie Skłodowska-Curie Action‌ (2025 – 2026).
  • Claudio‌​‌ Pacchierotti is Secretary, Eurohaptics​​ Society (2018 – 2022,​​​‌ 2022 – 2026).
  • Claudio‌ Pacchierotti is Responsible for‌​‌ the GdR Robotique at​​ IRISA (2025 onwards).
  • Claudio​​​‌ Pacchierotti is Organization Committee,‌ Program Committee, and “Code‌​‌ of Conduct” Officer, Journées​​ Nationales de la Recherche​​​‌ en Robotique (JNRR), Rennes,‌ 2025.
  • Claudio Pacchierotti is‌​‌ Co-organizer (co-animateur) of the​​ scientific thematics 4 “Human-centered​​​‌ robotics” (TS4 “Robotique centrée‌ sur l'humain”, 2024 onwards).‌​‌
  • François Chaumette was president​​ of the jury for​​​‌ the 2024 best French‌ thesis in robotics organized‌​‌ by the the "GdR​​ Robotique".
  • Fabien Spindler co-organized​​​‌ the first workshop of‌ Inria’s thematic network dedicated‌​‌ to robotics in sept.​​ 2025.
  • Fabien Spindler was​​​‌ a member of the‌ HCERES evaluation committee of‌​‌ the LIRIS laboratory in​​ Lyon
  • Marie Babel serves​​​‌ as the Deputy Director‌ of the GdR Robotique‌​‌ since 2024.
  • Alexandre Krupa​​ was the organizer of​​​‌ the session “Robotic manipulation”‌ of the French National‌​‌ Robotics Research Days (JNRR​​ 2025).
  • Alexandre Krupa is​​​‌ responsible (since November 2025)‌ of the “manipulation” axis‌​‌ of the national Equipex+​​ Tirrex project devoted to​​​‌ open robotic platforms.

11.1.6‌ Scientific expertise

  • Paolo Robuffo‌​‌ Giordano served as expert/reviewer​​ for the euRobotics “George​​​‌ Giralt” award for the‌ best European PhD thesis‌​‌ in robotics. He was​​ reviewer for EU Consolidator​​​‌ and Advanced Grants. He‌ was member of the‌​‌ HCERES committee for evaluating​​ the LIRMM lab, and​​​‌ committee member of the‌ Chaire professeur junior (CPJ)‌​‌ CNRS “Véhicules autonomes et​​ transport”, Heudiasyc, France. Finally,​​​‌ he is member of‌ the Steering Committee (Comité‌​‌ de Pilotage) for the​​ PEPR “Accélération en Robotique”​​​‌
  • Marie Babel is the‌ vice-president of the Comité‌​‌ d’évaluation of ANR (CE33​​ - Interaction, robotique -​​​‌ 2024, 2025). She leads‌ an Academic Chair on‌​‌ Innovations, Handicap, Autonomy and​​​‌ accessibility since 2020. She​ serves since 2017 as​‌ an expert for the​​ International Mission of the​​​‌ French Research Ministry (MEIRIES).​ She serves as a​‌ member of the Selection​​ and Validation Committee of​​​‌ the Pôle Images et​ Réseaux since 2022.

11.1.7​‌ Research administration

  • Alexandre Krupa​​ is the president of​​​‌ the CUMIR (“Commission des​ Utilisateurs des Moyens Informatiques​‌ pour la Recherche”) of​​ Centre Inria de l'Université​​​‌ de Rennes since February​ 2023.
  • Vincent Drevelle is​‌ an elected member of​​ the IRISA laboratory council​​​‌ since 2023.
  • Eric Marchand​ is the head of​‌ the doctoral school Matisse​​

11.2 Teaching - Supervision​​​‌ - Juries - Educational​ and pedagogical outreach

Marco​‌ Tognon :

  • Master 2​​ DRONE “Introduction to Aerial​​​‌ Physical Interaction” 2h, M2,​ Ecole Centrale de Nantes,​‌ Nantes, France
  • Master ENS:​​ “Robotics 2”, 33 hours,​​​‌ M1, Ecole Nationale Supérieure​ de Rennes

Paolo Robuffo​‌ Giordano :

  • Master SIVOS:​​ “Modeling and Control of​​​‌ Collaborative Mobile Robots (MOCO)”,​ 6 hours, M2, Université​‌ de Rennes, France, December​​ 2025.

François Chaumette

  • Master​​​‌ Mecatronics: “Visual servoing”, 6​ hours, M1, ENS Rennes​‌

Alexandre Krupa :

  • Master​​ ESIR3: “Ultrasound visual servoing”,​​​‌ 9 hours, M2, ESIR​ Rennes
  • Master ESIR3: “Visual​‌ servoing”, 9 hours, M2,​​ ESIR Rennes
  • Master SIVOS:​​​‌ “Visual servoing”, 11 hours,​ M2, Université de Rennes​‌

Claudio Pacchierotti

  • Master AI​​ & Advanced Visual Computing:​​​‌ “INF644 – Virtual/Augmented Reality​ & 3D Interactions”, 6​‌ hours, École Polytechnique, Paris,​​ France, Feb 2025.
  • Master​​​‌ SIVOS: “Haptics for robotics”,​ 24 hours, M2, Université​‌ de Rennes, France, Oct​​ 2025.
  • Master SIF: “Virtual​​​‌ Reality and Multi-Sensory Interaction”,​ 4 hours, M2, Université​‌ de Rennes, France, Dec​​ 2025.
  • Master SPIA: “Mechatronics​​​‌ Assistive Devices”, 2 hours,​ Université de Rennes, France,​‌ Oct 2025.

Fabien Spindler​​

  • Master ESIR3: “Robot Vision”,​​​‌ 12 hours, M2, ESIR​ Rennes
  • Master SIVOS: “Visual​‌ Servoing”, 12 hours, M2,​​ Université de Rennes

Esteban​​​‌ Restrepo

  • Master SIVOS: “Modeling​ and Control of Collaborative​‌ Mobile Robots (MOCO)”, 6​​ hours, M2, Université de​​​‌ Rennes, France, December 2025.​

Vincent Drevelle

  • Master IL:​‌ “Artificial intelligence”, 20 hours,​​ M1, ISTIC, Univ Rennes​​​‌
  • Master IA: “Artificial intelligence​ algorithmics”, 10.5 hours, M1,​‌ ISTIC, Univ Rennes
  • L1:​​ “Principles of computer systems”,​​​‌ 52 hours, ISTIC, Univ​ Rennes
  • L3 Miage: “Computer​‌ programming”, 72 hours, ISTIC,​​ Univ Rennes
  • L3 Info:​​​‌ “Advanced computer programming”, 23​ hours, ISTIC, Univ Rennes​‌
  • M2 EEEA: “Localization, Multisensor​​ data fusion”, 22 hours,​​​‌ ISTIC, Univ Rennes
  • M2​ IL: “Mobile robotics”, 32​‌ hours, ISTIC, Univ Rennes​​
  • M2 SiVOS: “Perception of​​​‌ environment, human and robot”,​ 6 hours, Univ Rennes​‌

Eric Marchand

  • Master Esir2:​​ “BINP”, 9 hours, M1,​​​‌ Esir Rennes
  • Master Esir2:​ “Computer vision: geometry”, 24​‌ hours, M1, Esir Rennes​​
  • Master Esir3: “Robotics Vision​​​‌ 1”, 12 hours, M2,​ Esir Rennes
  • Master Esir3:​‌ “Robotics Vision 2”, 7​​ hours, M2, Esir Rennes​​​‌
  • Master SIVOS: “Geometric Computer​ Vision”, 8 hours, M2,​‌ Université de Rennes
  • Master​​ ENS: “Computer vision”, 6​​​‌ hours, M2, ENS Rennes​
  • Master MIA: “Augmented reality”,​‌ 4 hours, M2, Université​​ de Rennes

Marie Babel​​​‌

  • M1, "Image and video​ processing", 26h, INSA Rennes,​‌
  • L3, "Probability", 24h, INSA​​ Rennes
  • L3, "Concepts de​​ la logique à la​​​‌ programmation", 20h, INSA Rennes‌
  • L3, "Remedial math courses",‌​‌ 24h, INSA Rennes
  • M1,​​ "Computer sciences project", 30h,​​​‌ INSA Rennes
  • Tutoring and‌ support for students with‌​‌ disabilities, 12h, INSA Rennes​​
  • Master 2 SIVOS, "Mecatronics​​​‌ for healthcare", 12h, ENS‌ Rennes
  • Master 1 IEAP,‌​‌ "Handicap and technologies", 6h,​​ Université Rennes 2

François​​​‌ Pasteau

  • M1, "Image and‌ video processing", 6h, INSA‌​‌ Rennes,
  • L3, "Concepts de​​ la logique à la​​​‌ programmation", 12h, INSA Rennes‌
  • L3, "Practical studies", 16h,‌​‌ INSA Rennes
  • M1, "Introduction​​ to robotics", 22h, INSA​​​‌ Rennes
  • M1, "Internet Of‌ Things", 20h, INSA Rennes‌​‌

Maud Marchal

  • L3, "Complexity​​ and algorithms", 26h, INSA​​​‌ Rennes,
  • M1, "Computer Graphics",‌ 26h, INSA Rennes
  • M2,‌​‌ "Human-Computer Interaction", 14h, INSA​​ Rennes
  • M2, "Computer Graphics",​​​‌ 20h, Univ. Rennes
  • Master‌ 2 SIVOS, "Haptics", 10h,‌​‌ ENS Rennes

11.2.1 Supervision​​

  • Ph.D. completed: Maxime Manzano,​​​‌ “Reach-to-grasp in activities of‌ daily living: shared control‌​‌ of a multisensory assistive​​ device to compensate for​​​‌ upper extremity neuromuscular disorders.”,‌ defended in December 2025,‌​‌ supervised by Marie Babel,​​ Ronan Le Breton, and​​​‌ Sylvain Guégan 73
  • Ph.D.‌ completed: Emilie Leblong, “Taking‌​‌ into account social interactions​​ in a virtual reality​​​‌ power wheelchair driving simulator:‌ promoting learning for inclusive‌​‌ mobility”, defended in July​​ 2025, supervised by Marie​​​‌ Babel and Anne-Hélène Olivier‌ (Virtus team) 72
  • Ph.D.‌​‌ completed: Thibault Noël, "Autonomous​​ Exploration of an Unknown​​​‌ 3D Environment" defended in‌ January 2025, supervised by‌​‌ François Chaumette and Eric​​ Marchand 75.
  • Ph.D.​​​‌ completed: Erwan Normand, “Augmenting‌ the interaction with everyday‌​‌ objects with wearable haptics​​ and AR,” defended in​​​‌ January 2025, supervised by‌ Claudio Pacchierotti, Maud Marchal‌​‌ and Eric Marchand 76​​.
  • Ph.D. completed: Maxime​​​‌ Bernard, “Shared control for‌ multi-robot systems”, defended in‌​‌ April 2025, supervised by​​ Paolo Robuffo Giordano and​​​‌ Claudio Pacchierotti 70
  • Ph.D.‌ completed: Lendy Mulot, “Advancing‌​‌ Ultrasound Mid-Air Haptics: Perception​​ Studies, Rendering Methods, and​​​‌ Design of Virtual Reality‌ Interactions,” defended in November‌​‌ 2025, supervised by Claudio​​ Pacchierotti and M. Marchal.​​​‌
  • Ph.D. completed: Antonio Marino,‌ “Learning-based Formation Control and‌​‌ Localizaton for Multiple Robots”,​​ defended in December 2025,​​​‌ supervised by Paolo Robuffo‌ Giordano and Claudio Pacchierotti‌​‌ 74
  • Ph.D. completed: Mandela​​ Ouafo Fonkoua,“Vision-based shape servoing​​​‌ of soft objects using‌ finite element model”, defended‌​‌ in December 2025, supervised​​ by Alexandre Krupa and​​​‌ François Chaumette 71.‌
  • Ph.D. in progress: Sylvain‌​‌ Jannin, “Collaboration and navigation​​ of multi-robot systems at​​​‌ the small-scale for clinical‌ applications,” started in October‌​‌ 2025, supervised by Claudio​​ Pacchierotti.
  • Ph.D. in progress:​​​‌ Francesco Russo, “Shared autonomy‌ for intuitive collaboration between‌​‌ humans and multiple robots,”​​ started in December 2025,​​​‌ supervised by Claudio Pacchierotti‌ and E. Restrepo.
  • Ph.D.‌​‌ in progress: Jessé De​​ Oliveira Santan Alves, “Human-robot​​​‌ interaction and shared control‌ for robotic telemanipulation,” started‌​‌ in November 2024, supervised​​ by Claudio Pacchierotti.
  • Ph.D.​​​‌ in progress: Sara Rossi,‌ “Tactile haptic perception and‌​‌ rendering for robotic prosthesis,”​​ started in February 2024,​​​‌ supervised by Claudio Pacchierotti‌ and M. Marchal.
  • Ph.D.‌​‌ in progress: Yuxin Jin,​​ “Detection and tracking of​​​‌ microagents using Artificial Intelligence,”‌ started in September 2023,‌​‌ supervised by Claudio Pacchierotti​​​‌ and S. Misra.
  • Ph.D.​ in progress: Léon Raphalen,​‌ “Human-centered shared control of​​ multi-robot systems at the​​​‌ microscale,” started in September​ 2023, supervised by Claudio​‌ Pacchierotti.
  • Ph.D. in progress:​​ Andrea Perna, “Coordination of​​​‌ Heterogeneous Multi-robot systems for​ Multi-objective Missions”, started in​‌ November 2025, supervised by​​ Esteban Restrepo and Paolo​​​‌ Robuffo Giordano
  • Ph.D. in​ progress: Valeria Braglia, “Perception-Aware​‌ Cable Suspended Multi-Drone Transportation”,​​ started in February 2025,​​​‌ supervised by Marco Tognon​ and Paolo Robuffo Giordano​‌
  • Ph.D. in progress: Lorenzo​​ Balandi, “Full-Body Design and​​​‌ Control of an Aerial​ Manipulator for Advance Physical​‌ Interaction”, started in October​​ 2023, supervised by Marco​​​‌ Tognon and Paolo Robuffo​ Giordano
  • Ph.D. in progress:​‌ Szymon Bielenin, “Robust and​​ Agile Transportation of Cable​​​‌ Suspended-Loads with Multi-Drone Systems”,​ started in October 2024,​‌ supervised by Marco Tognon,​​ Paolo Robuffo Giordano and​​​‌ Claudio Pacchierotti
  • Ph.D. in​ progress: Phillip Maximilian Mehl,​‌ “Learning-based Control of an​​ Aerial Manipulator for Complex​​​‌ Manipulation Tasks”, started in​ January 2024, supervised by​‌ Marco Tognon
  • Ph.D. in​​ progress: Lluis Prior Sancho,​​​‌ “AEROTouch – AErial RObots​ with the sense of​‌ Touch”, started in November​​ 2024, supervised by Marco​​​‌ Tognon
  • Ph.D. in progress:​ Johan Berrier-Gonzalez,“Forming carbon fiber​‌ fabrics by visual servoing”,​​ started in October 2025,​​​‌ supervised by Alexandre Krupa.​
  • Ph.D. in progress: Simone​‌ Rotondi,“Shape visual servoing of​​ deformable objects robust to​​​‌ model uncertainties”, started in​ November 2025, supervised by​‌ Paolo Robuffo Giordano, Alexandre​​ Krupa and Tommaso Belvedere.​​​‌
  • Ph.D. in progress: Jose​ Eduardo Aguilar Segovia, “Design​‌ of haptic feedback using​​ innovative shape-able materials”, started​​​‌ in October 2022, supervised​ by Marie Babel, Sylvain​‌ Lefebvre (MFXteam, Nancy) and​​ Sylvain Guégan
  • Ph.D. in​​​‌ progress: Maël Gallois, “Shared​ control by muscle mapping​‌ for upper limb assistance​​ in neuromuscular and neurodegenerative​​​‌ pathologies”, started in September​ 2024, supervised by Marie​‌ Babel, Charles Pontonnier (Combo​​ team), Nicolas Vignais (Combo)​​​‌ and Sylvain Guégan (LGCGM)​
  • Ph.D. in progress: Théo​‌ Le Terrier, “Sensor-based control​​ of a power wheelchair​​​‌ with interval set-membership methods”,​ started in October 2023,​‌ supervised by Marie Babel​​ and Vincent Drevelle.
  • Ph.D​​​‌ in progress: Elyse Larribau,​ "Conception et commande d'un​‌ exosquelette de poignet-main basé​​ sur la modélisation de​​​‌ biomécanique personnalisée d'usagers en​ situation de handicap à​‌ mobilité résiduelle.", started in​​ October 2025, supervised by​​​‌ Marie Babel, Charles Pontonnier​ (Combo), Nolwenn Fougeron (Combo),​‌ Sylvain Guégan
  • Ph.D. in​​ progress: Amine Ouasfi, "Apprentissage​​​‌ auto-supervisé pour la reconstruction​ de formes implicites", started​‌ in 2022, supervised by​​ Adnane Boukhayama and Eric​​​‌ Marchand

11.2.2 Juries

HdR​ and PhD juries
  • Paolo​‌ Robuffo Giordano : Yoko​​ Watanabe (HDR, ONERA Toulouse),​​​‌ Elio Jabbour (PhD, member,​ Inria Bordeaux), Pietro Pustina​‌ (PhD, reviewers, Univ Rome​​ La Sapienza)
  • Claudio Pacchierotti​​​‌ : Baptiste Rohou-Claquin (PhD,​ Sorbonne Université, France), Bin​‌ Ren (PhD, Univ. Pisa,​​ Italy), Giuseppe Saviano (PhD,​​​‌ Univ. Siena, Italy), Shehzaib​ Shafique (PhD, Univ. Genova,​‌ Italy), Alexis Boulay (PhD,​​ Inria Bordeaux and Univ.​​​‌ Bordeaux, France), Marion Pontreau​ (PhD, CEA and Sorbonne​‌ Université, France), Chiwoong Hwang​​ (PhD, Aarhus University, Denmark)​​​‌
  • François Chaumette : Erol​ Ozgur (HdR, reviewer, Université​‌ Clermont-Auvergne), Claire Dune (HdR,​​ Université de Toulon)
  • Esteban​​ Restrepo : Lorenzo Govoni​​​‌ (PhD, reviewer, Univ Rome‌ La Sapienza)
  • Marie Babel‌​‌ : Obaida Alrazouk PhD,​​ president, Université Paris Saclay,​​​‌ Lendy Mulot PhD, president,‌ INSA Rennes, Claire Dune‌​‌ HDR, reviewer, Université Toulon,​​ Zhenyu Gao PhD, reviewer,​​​‌ Sorbonne Université, Olivier Kermorgant‌ HDR, president, Ecole Centrale‌​‌ Nantes, Alexandre Oliveira Souza​​ PhD, reviewer, Université de​​​‌ Lorraine, Julia Peladeau PhD,‌ president, ENSAM Paris, Kevin‌​‌ Riou PhD, president, Nantes​​ Université
  • Maud Marchal :​​​‌ David Algis (PhD, reviewer,‌ Univ. Poitiers), Mine Dastan‌​‌ (PhD, reviewer, Politecnico di​​ Bari, Italy), Maxime Bernard​​​‌ (PhD, president, Univ. Rennes),‌ Elise Bonnail (PhD, reviewer,‌​‌ Univ. Paris Saclay), Julien​​ Cauquis (PhD, reviewer, IMT​​​‌ Atlantique), Camille Dupré (PhD,‌ reviewer, Univ. Paris Saclay),‌​‌ Siyuan He (PhD, reviewer,​​ Ecole Nationale des Ponts​​​‌ et Chaussées), Radhouane Jilani‌ (PhD, member, Univ. Lorraine),‌​‌ Claire Martin (PhD, reviewer,​​ Univ. Strasbourg), Nicolas Mellado​​​‌ (HdR, reviewer, Univ. Toulouse),‌ David Algis (PhD, reviewer,‌​‌ Univ. Poitiers), Anderson Brazil​​ Nardin (PhD, president, Sant'Anna​​​‌ Pisa, Italy), Steven Picard‌ (PhD, reviewer, Univ. Luxembourg),‌​‌ Mathieu Pietri (PhD, reviewer,​​ Aix Marseille Université), Pierre-Frédéric​​​‌ Villard (HdR, member, Univ.‌ Lorraine), Sophie Villenave (PhD,‌​‌ reviewer, Centrale Lyon)
  • Eric​​ Marchand Karim Slimani (PhD,​​​‌ member, Sorbonne Université)

11.2.3‌ Educational and pedagogical outreach‌​‌

  • Claudio Pacchierotti organized a​​ one-day educational workshop introducing​​​‌ 8 middle-school students to‌ mobile robotics, including robot‌​‌ control exercises, Rennes, France,​​ 2025.
  • Claudio Pacchierotti organized​​​‌ a one-day educational workshop‌ introducing 20 high-school students‌​‌ to mechatronics and mobile​​ robotics, including hands-on assembly​​​‌ and robot control exercises,‌ Rennes, France, 2025.

11.3‌​‌ Popularization

  • M. Babel, F.​​ Pasteau, L. Devigne, T.​​​‌ Voisin, S. Thomas, F.‌ Grzeskowiak, M.Manzano, P.A. Cabaret,‌​‌ J.E. Aguilar Segovia, M.​​ Gallois: During the Fête​​​‌ de la Sciences, within‌ the Village des Sciences‌​‌ in INSA Rennes, they​​ hosted a booth for​​​‌ school students, featuring demonstrations‌ of mobility assistance devices‌​‌ for people with disabilities,​​ in October 2025
  • M.​​​‌ Babel, L. Devigne: General‌ audience conference, middle school‌​‌ workshops and intergenerational exchange​​ – "Ambition réussite" action,​​​‌ Saint Nicolas du Pelem,‌ 22/05/2025

11.3.1 Productions (articles,‌​‌ videos, podcasts, serious games,​​ ...)

  • In 79,​​​‌ we present a perspective‌ on engineering human-cyberphysical synergy,‌​‌ exploring how machines can​​ evolve from tools into​​​‌ collaborative teammates that perceive‌ touch and context. We‌​‌ discuss the necessary convergence​​ of robotics, materials science,​​​‌ and neuroscience to realize‌ systems such as aerial‌​‌ manipulators and drone swarms​​ capable of physical interaction.​​​‌ The article highlights the‌ role of affective haptics‌​‌ and embodied AI in​​ achieving intuitive collaboration, while​​​‌ also addressing the ethical‌ and societal implications of‌​‌ these emerging technologies.

11.3.2​​ Participation in Live events​​​‌

12 Scientific‌ production

12.1 Major publications‌​‌

12.2 Publications​​ of the year

International​​​‌ journals

International peer-reviewed conferences​​

National peer-reviewed Conferences​​

Conferences without proceedings​‌

Scientific book​​​‌ chapters

Doctoral‌​‌ dissertations and habilitation theses​​

Other scientific‌​‌ publications

12.3 Cited publications​​

  • 80 phdthesisP.-A.Pierre-Antoine​​​‌ Cabaret. Design of‌ multi-actuator haptic devices and‌​‌ rendering methods for navigation​​ and virtual interactions.​​​‌INSA de RennesDecember‌ 2024HALback to‌​‌ text