Multimodality is about the usage of data from different channels for emotion analysis for Natural Data Processing. Multimodal cues we use to analyse emotion states and social signals: