Section: New Software and Platforms

Platforms

Platform MultiMod : Multimodal Acquisition Data Platform

Functional Description

Within a LORIA exploratory project (cf. 9.2.13), we have set up an acquisition hardware platform to acquire multimodal data in speech communication context. The system is composed of the articulograph Carstens AG501 (which was acquired as part of the EQUIPEX ORTOLANG - cf. 9.2.1), 4 Vicon cameras (a motion capture system), an Intel RealSense which is a depth camera (acquired as part of the project CORExp - cf. 9.1.1), a video camera and a microphone. With such heterogeneous hardware the synchronization is essential; this is achieved through a trigger device. All the data processing is performed with the PLAVIS software. This year, the system has been used to acquire multimodal data for the MCC project (cf. 9.4.2.1) and a first exploratory expressive multimodal corpus [40].

• Participants: Slim Ouni, Vincent Colotte, Valerian Girard, Sara Dahmani

• Contact: Slim Ouni