Photo: Web interface for rating emotion content of film and music.
The music accompanying a movie or video scene has a profound affect on its meaning, significance, and perceived emotion. Together, the visual events and the music create a rich, cohesive experience. The Music • Film • Emotion project seeks to understand and model this multi-modal interaction of visual and aural stimuli on the perception of emotion. In particular, we study the effect of music on viewers' emotion response to film. Combining ambiguous visual scenes from film with emotionally evocative music excerpts, we study participants' ratings of the mood and emotion content, as measured across a three-dimensional emotion space (stress, activity, and dominance).
memento radiohead (nice dream) performed by section quartet music: anxious
memento chopin (prelude no.4) music: depressing
Composed Music Study: three sample clips
amélie, silent
amélie music: sad, mourning, longing
amélie music: anxious, happy, anticipating
publications
peer-reviewed publications
Parke, R., E. Chew, and C. Kyriakakis (2007). Quantitative and Visual Analysis of the Impact of Music on Perceived Emotion of Film. ACM Computers in Entertainment. 5(3). [ PUB | PDF | APPEND ]
Parke, R., E. Chew, and C. Kyriakakis (2007). Multiple Regression Modeling of the Emotional Content of Film and Music. In Proceedings of the 123rd AES Convention (123AES). New York, NY, Oct 5-8. [ PUB | PDF ]
reports and posters
IMSC 10th NSF Site Visit (2006): Music Film Emotion [ report, poster ]
Annenberg Report (2007): Music Film Emotion [ report ]
presentations
Parke, R. (2007). Multiple Regression Modeling of the Emotional Content of Film and Music. In Proceedings of the 123rd AES Convention (123AES). New York, NY, Oct 5-8.
