Section: New Software and Platforms
Participant : Jérémy Laviole [Main developer] .
As part of his thesis work, Jérémy Laviole has developed a software suite for PapARt : Paper Augmented Reality Toolkit. This work is being extended to become a state-of-the-art library for projection mapping (spatial augmented reality) and tangible interfaces.
Papart is a Processing (http://www.processing.org ) library, and follows the Processing philosophy of openness and ease of use. The main features are :
Camera support : in addition to the Processing Video library, PapARt support for video from OpenCV, OpenKinect, FFMPEG, FlyCapture and more is available from JavaCV (http://bytedeco.org/ ). It provides a wide support on Mac, Windows, Linux and possibly Android.
"Tactile" input on planar surface : Touch and hovering can be detected by a depth camera such as Kinect (http://www.microsoft.com/en-us/kinectforwindows/ ), the current support is Kinect XBOX 360 with openKinect drivers. Extensions are planned for Kinect 2, Kinect for Windows, Microsoft SDK (on Windows), DepthSense and most consumer market depth cameras. It scales elegantly from touch input from finger on small surfaces (such as A3 size) to large surfaces (2m x 3m size).
Technical challenges for the next few years :
Research questions and challenges :