EMOTION RECOGNITION
AS A NEW AGE INDUSTRY

Description

The multimodal database RAMAS (The Russian Acted Multimodal Affective Set) includes: synchronously recorded video from several angles, multi-channel audio, physiological indicators (electrical activity of t he skin and heart rhythm) and three-dimensional coordinates of movements.

The multimodal database RAMAS (The Russian Acted Multimodal Affective Set) includes: synchronously recorded video from several angles, multi-channel audio, physiological indicators (electrical activity of t he skin and heart rhythm) and three-dimensional coordinates of movements.

Each actor signed a document providing formal consent to participate in the study and to use of survey materials for scientific and commercial activities. The participants were paid the amount equal to the cost of one day of shooting. The selection of actors and the process of writing of the scenarios and filming was conducted under the supervision of the senior teacher from the VGIK acting skills department - E.B. Arkova.

All the video sequences were marked by annotators (a total of 21 people) in the Elan program (Sloetjes & Wittenburg, 2008).

Actors

Five pairs of actors took part in the recording of the database: 5 women and 5 men, aged 18-28. The shooting took 6 days, one pair participated twice (the first time - in the test mode). All the couples were mixed-gender. All participants had a professional acting experience of at least two years. All the filming days consisted of one set of scenarios with small variations for the convenience of expressing emotions by specific actors.

After filming, the participants filled in a test of manual asymmetry (Oldfield, 1971), a Russian version of the questionnaire of the scale of positive and negative affect PANAS (Osin, 2012), a questionnaire on emotional intelligence (Lyusin, 2006, 2009), a personal questionnaire of Spielberger-Khanin (Khanin, 1976).

During the recording, the subjects were dressed in comfortable tight clothes of dark colors. The actors' faces were without makeup, long hair retracted into a tail.

Video:

  • Close-up of the face of each of the actors: two cameras (Canon HF G40, Panasonic HC-V760), 50 FPS.
  • Each actor in full height: two webcams (Canyon CNE-CWC3), 15 FPS.
  • The whole scene, both actors in full height: the camera (Microsoft Kinect RGB-D sensor v. 2, RGB and Depth video), 15 FPS