Section: New Software and Platforms

Litbot

Live together with robots

Keywords: Speaker Localization - Audio tracking - Visual tracking - NAO Robot - Computer vision - Signal processing

Scientific Description: Litbot stands for "Live together with robots". This library aims to provide algorithms and associated software packages to perform audio-visual speaker localization and tracking with a consumer robot (in particular a NAO robot). The scope of this project is two-fold. The first is to develop the robust speaker localization and tracking algorithm in the presence of other audio-visual sources like TV. The second is to modify or optimize the original algorithm to be fit into real-time system. This library benefits from the work done with Online Multiple Sound-Source Localization package developed by X. Li.

Functional Description: This project develops algorithms and associated software packages to perform audio-visual speaker localization and tracking with a consumer robot. This version of the litbot library provides new functions to integrate the Samsung robotic platform to handle ROS middleware (robotic defacto standard) and modifies and optimizes tracking and audio localization processes (better handling of the residual noise signals, performance improved to match real time).

• Participants: Xiaofei Li, Yutong Ban, Soraya Arias, Radu Horaud, Guillaume Sarrazin and Bastien Mourgue

• Contact: Radu Horaud