以視覺為基礎之指揮練習系統研究

Abstract

本研究提出視覺化互動式音樂指揮系統供使用者培養音樂節奏感。利用快速平均位移追蹤演算法即時追蹤指揮動作，並藉由分析指揮軌跡可以決定指揮速度。使用者練習指揮時，本系統可以提供聽覺與視覺的節奏提示，來幫助使用者穩定節奏感。甚至音樂速度可隨著指揮速度改變，作為進階的節奏訓練。 實驗結果顯示本研究的指揮追蹤與指揮速度偵測是很可靠的。音樂指揮實驗顯示使用者藉由指揮系統練習節奏，對提升節奏感是很有效果的。

This paper presents a vision-based interactive music conducting practice system. A fast mean-shift object tracking algorithm is implemented to track the baton of the conductor in real time. By analyzing the tracked baton path, the conducting tempo is determined. When practicing, the system provides both visual and audio cues to help user to improve their steadiness. Furthermore, practice conduction of MP3 music with realtime feedback is possible. Experimental results show that the system is robust in terms of baton tracking and tempo detection. Furthermore, music conduction experiments show that the practicing system is effective for steading user's conducting tempo and enhancing conducting skills with only limited number of practices.