李忠謀Greg C Lee張吳嘉Chang, Wu-Jia2024-12-172029-10-172024https://etds.lib.ntnu.edu.tw/thesis/detail/0ba71713daba7307031dd7169d48bab5/http://rportal.lib.ntnu.edu.tw/handle/20.500.12235/123717大多數健身運動追蹤研究主要以單人追蹤進行，單人追蹤可以記錄的訓練資訊，包含：動作辨識、動作計數、重量辨識、訓練時間以及準確度分析。然而在健身房環境中同時會有多人使用各種器材，僅進行單人追蹤會無法捕捉到多人的運動情形。利用攝影機的多人追蹤技術，可以同時對健身區域進行大範圍的偵測與追蹤，而不局限於單人追蹤。本研究提出基於攝影機的多人健身運動偵測與辨識方法，拍攝廣角的畫面藉以同時涵蓋多樣健身器材，處理這些器材使用者的訓練影像資訊。首先，對健身影片進行人體偵測，找出畫面中所有人物的位置。由於訓練器材的位置固定而人員則是隨意走動，利用物件交集(Intersection Over Union, IOU)方法，可以定位出正在使用健身器材的人物。對於這些訓練者，利用人體姿態估計方法記錄使用者的運動資訊，辨識划船、肩推、胸推、上斜胸推、腿部屈伸等五種不同的健身動作，並計算運動者在該器材的動作次數。除此之外，由於健身動作可能被其他移動的人員所遮蔽，造成健身動作辨識與計次的判斷出現錯誤，因此藉由多攝影機的協調建立補償機制，改善在多人環境中因為遮擋產生的辨識問題。本研究根據健身房的實際情形拍攝，未刻意安排訓練過程，使用者根據自身習慣自由的選擇訓練動作與次數。為了驗證補償機制是否改善遮擋產生的問題，會確保拍攝的每部影片中都有遮擋情形發生。最後設計三項實驗用以驗證偵測與辨識方法之效果。根據實驗結果，系統可以利用物件交集方式區分出不同人物的運動過程，在多人的環境中區分出運動與非運動之人員，並且辨識使用者訓練的動作與次數。在發生遮擋情況時，加入補償機制減少運動次數漏檢情形發生，補償後的次數回復率為52%，改善因為遮擋產生的辨識問題。Most fitness exercise tracking research is mainly conducted with single-person tracking. Single-person tracking can record training information, including: action identification, action counting, weight identification, training time, and accuracy analysis. However, in a gym environment, there are many people using various equipment at the same time, and tracking only one person will not be able to capture the movement of multiple people. Using the multi-person tracking technology of the camera, a large-scale detection and tracking of the fitness area can be carried out at the same time, and is not limited to single-person tracking.This study proposes a camera-based method for detecting and identifying multi-person fitness activities, capturing wide-angle images to cover a variety of fitness equipment at the same time, and processing the training image information of users of these equipment. First, perform human body detection on fitness videos to find out the locations of all people in the screen. Since the position of the training equipment is fixed and people move around at will, the Intersection Over Union (IOU) method can be used to locate the people using the fitness equipment. For these trainers, the human body posture estimation method is used to record the user's movement information, identify five different fitness movements such as rowing, shoulder press, chest press, incline chest press, and leg flexion and extension, and calculate the movement of the athlete on the equipment. Number of actions. In addition, since fitness movements may be obscured by other moving people, resulting in errors in the recognition and counting of fitness movements, a compensation mechanism is established through the coordination of multiple cameras to improve the problems caused by occlusion in a multi-person environment. Identify the problem.This study was shot based on the actual situation in the gym. The training process was not deliberately arranged. Users can freely choose training actions and times according to their own habits. In order to verify whether the compensation mechanism improves the problems caused by occlusion, we will ensure that occlusion occurs in every video shot. Finally, three experiments were designed to verify the effectiveness of the detection and identification methods. According to the experimental results, the system can use the intersection of objects to distinguish the movement processes of different people, distinguish between moving and non-moving people in a multi-person environment, and identify the actions and times of the user's training. When occlusion occurs, a compensation mechanism is added to reduce the number of missed movements. The recovery rate after compensation is 52%, which improves recognition problems caused by occlusion.人體姿態估計物件偵測動作辨識遮擋補償多人健身追蹤human posture estimationobject detectionmotion recognitionocclusion compensationmulti-person fitness tracking學術論文