The purpose of work package WP4 is to provide the mapping from raw sensory data to information that can be exploited by work package WP5 for behaviour assessment and in work package WP6 autonomous robot behaviour.

The final output of this WP will therefore be a classification of the movements and emotional appearance cues captured by the sensors in the smart room. Additionally, if it is possible classify the intentions underlying the action and/or its goal, this will also form part of the output. We name these outputs percepts. Work package WP5 will then infer the overall behaviours based on the percepts provided by work package WP4.