University Of Nottingham Brings Brain-controlled Movie With Live, Reactive Music Score
Film fans will have the chance to watch a brain-controlled movie and listen to its soundtrack being improvised live at a unique screening in Nottingham this weekend.
‘The MOMENT’ is a dystopian science fiction film like no other. Created by University of Nottingham researchers, it picks up reactions from the audience via a headset, which records brain signals. The storyline then changes depending on audience reactions so that no two viewings are the same.
Music also plays a powerful storytelling role, helping to change the mood and pace of the narrative. For the first time ever, the music will be performed live in front of the audience during this screening. There are over 18 billion possible outcomes within the film, so the musicians will have to improvise because they won’t know exactly what form the story is going to take. An album of soundtrack recordings will also be launched at the event.
Dr Richard Ramchurn, Artist and Computer Science Researcher at the University of Nottingham, created and directed the film.
We know that music plays a fundamental role in how audiences experience films. For this film, I drew inspiration from the soundtracks of the 70s and 80s by Tangerine Dream, and the work of the late Johan Johansson, combining expressive acoustic instruments with modern synths to create a unique and memorable score. I’m incredibly proud of the music we’ve created and I truly believe that it will leave a lasting impact on viewers long after the credits roll.
Dr Richard Ramchurn, Film Creator and Computer Science Researcher at the University of Nottingham
The film score will be performed by musicians, Hallvardur Asgeirsson and Scrubber Fox (aka Gary Naylor). Commenting on the process, Scrubber Fox said: “This is totally different to any sound design project I have worked on before. At first, it took me a while to get my head around how the film works and how the characters’ sounds fit together. I have banks of sounds that I can manipulate and play, depending on the cues from the brain data. This project involves futuristic, dark, moody, sci-fi and apocalyptic themes and I love dark films, so I wanted to be involved from the start.”
The MOMENT is a completely new type of filmmaking. The next stage of experimentation involves using a low light camera, focused on the audience, which feeds into technology that can read emotional responses. After the live score performance, the audience can enjoy an exclusive special preview of this new system used to deliver another of Richard’s dystopian worlds, entitled Before We Disappear. The event will end with a short Q&A for anyone who wants to learn more about interactive filmmaking.
This work is so exciting because it’s a completely different type of film viewing experience. It feels like you’re involved in creating the story as well as consuming it. It’s a live event that won’t be the same as other screenings. We’re interested in whether this means people want to see the film more than once, to compare different versions and whether certain versions seem more important than others.
Dr Sarah Martindale, Senior Research Fellow at the University of Nottingham
Dr Martindale continues: “If a film is influenced by our person responses – like thought processes or facial expressions – do we feel a greater sense of connection with the content? It’s such an imaginative way to use technologies that have medical and surveillance uses.”
This research and development is supported by the LEADD:NG programme (Live, Experimental & Digital Diversification), a £1.6 million ERDF (European Regional Development Fund) project, hosted by the University of Nottingham and Nottingham Trent University. The programme encourages the adoption of immersive technologies for SMEs.