麥克風陣列音訊互動裝置設計及其應用之研究

Abstract

音樂與舞蹈是密不可分的，一般都是舞者透過肢體動作來表現音樂的內容與情感，如果音樂的呈現是取決於舞者的肢體動作，便能讓音樂與舞蹈之間有另一層面的對話。本研究的目標為開發一個以聲音為主的互動裝置，在互動裝置的輸入部分，我們利用麥克風陣列來接收使用者的舞步，並使用了舞步偵測與三角定位的方法來分辨其節奏與踏步位置；輸出部分，依照使用者的舞步節奏與位置即時地改變音樂的速度與內容，並使用MIDI的音樂混音輸出回饋給使用者。藉由本互動裝置的開發，提供了一種無須配戴的互動方式來進行人機互動，使用者透過舞步做為互動的輸入，並即時呈現配合自己舞步的音樂輸出，進而完成即時的聲音互動裝置。

Music and dance are inseparable, generally, dancers use their body movement to present music's content and emotion; However, if the presentation of music is decided by dancer's body movement, that could make music and dance has another interactive relationship. The purpose of this study is to develop an audio interactive device. In the part of input, we use microphone array as interactive device to capture the sound signal of user’s steps, and use step recognition and triangulation to recognize user steps' tempo and location. In the part of output, the different tempo of user's stepping will change the tempo of MIDI music, and the different location of stepping will make MIDI music different mixed content. By the development of this device, offering a wearless way to make interaction between human and machine. User can display the music immediately match up with his body movement, achieving a real-time interactive music device.