The Sound of Dance

"The Sound of Dance" is a showcase experiment exploring the expressive nature of dance and music. The project involved the construction of a motion capture system, converting dance moves into music and sound. The experiment included a comparison between music composed by a musician, and music composed by a dancer through the system. The measure of the experiment was the perception of a thematic prompt. This project delved into the importance of the bond between dance and music, from an audience's perspective, as well as a creator's perspective.

The Sound of Dance - Showcase Details of Event
"The Sound of Dance" is a dance performance using interactive music systems. It was showcased in the Immersive Studio (A016/18) in IADT.
Max Patch of the motion-to-sound coding system.
Ableton Set/Session for audio playback
The system was built using MediaPipe's body tracking device in Max, into Ableton. The instruments were triggered by the x or y coordinates of certain points on the body, e.g. The x value of the right foot controlled the strings.
Stage set up of showcase
Set up of laptop for the stage, with MIDI controller.
This was the stage setup for the showcase. The dancer used the measured out space as their stage, with myself on the side, using a MIDI controller to control the volume of the instruments. A webcam was used to detect the motion tracking.
I composed my own music, according to an assigned prompt. The dancer's choreography was applied to my music composition. This was the Musician's Version.
Then, the same choreography was applied, using the motion-to-sound system to generate real-time music playback, forming the Dancer’s Version. The dancer also choreographed this dance, according to the same prompt. Can you guess what the prompt was?
Project Objectives

My project explores the relationship between dance and music. The artefact aims to build a functional motion-to-sound system, which dancers can use as a compositional tool; using their moves to make music.

To test the motion-to-sound system, I posed the question, "How expressive can dance be compared to music?" An experiment was conducted, which included the dancer using the system to compose music, while I composed my own music. We used prompts from Brian Eno's Oblique Strategies to express ourselves through dance and/or music.

A showcase was held in the Immersive Studio in IADT. A survey was conducted to understand audience perception of dance and music. As well as that, an interview with the dancer and my reflective journal explored each party's creative process.

Project Outcomes

The motion-to-sound system was successfully made. Overall, the system was able to produce sound through dance movement, with a few inconsistencies, in terms of the accuracy of the system. The performance and showcase was a major success, with 27 people attending in total.

In terms of the results from the survey, 40% guessed the prompt correctly from the Dancer's Version, while 25% guessed the prompt correctly from the Musician's Version. Words describing the dance like "elegant," "flowy," and "graceful," were successful in guessing the prompt. Overall, the audience that watched the Dancer's Version was more in line with the dancer's intentions.

In conclusion, the motion-to-sound system was successful as a compositional tool. The perception of dance and music vary from each other, in terms of emotional response and the portrayal of a prompt, but the relationship of dance and music is highly appreciated by audiences. Therefore, music can evoke complex emotions in someone, and by adding dance into the equation, it invokes a different experience that sometimes, music cannot do alone.

Thesis: How does music composed by a musician compare to music composed by a dancer using motion capture, in terms of expressing a prompt?

Abstract:
This professional project explores the expressive nature of dance and music, comparing the two through interactive music systems. The project involved the construction of a motion capture system to convert dance movements into music and sound. This system was built using MediaPipe’s motion tracking application in Max and was then linked to Ableton. The experiment included the comparison between music composed by a musician, and music composed by a dancer through the motion capture system. The measure of the experiment was the perception of a thematic prompt. Qualitative and quantitative data was collected through a showcase and survey of an audience, an interview with the dancer, and a reflective journal from the researcher/musician. The results of all data points were analysed and a conclusion was made; a dancer relies on music heavily to convey both their intentions, as well as the musician’s intentions through music.

Profile of Ciara June Baui
Ciara June Baui
BA (Hons) Creative Music Production

My name is Ciara June Baui. I am 21 years old and I have been passionate in music since I was young. From studying classical music theory and violin at the age of 6, to present day, having released my own music under my artist name, "ciara june". Throughout my time in this course, I have developed a love for song writing, performing, composing and producing. I wish to develop on these passions and venture out into the music industry as an independent artist and composer.

BA (Hons) Creative Music Production