第卅七屆2005國際化學奧林匹亞競賽理論試題之相關研究

Abstract

摘 要 本研究為台灣主辦2005年第37屆國際化學奧林匹亞(化奧)理論試題之相關研究。研究內容主要是對學術委員會所編製的第37屆化奧理論試題進行試題分析並提出相關建議。 本屆試題共分八大題62小題，由北台灣學術界中化學菁英所命題，範圍包含化學領域中最主要的五個科目：有機化學、無機化學、物理化學、分析化學、實作化學。出題風格自生態環境到台灣風土都有渉及，可說相當多元。 第37屆國際化學奧林匹亞競賽理論考試施測時間共有五小時，施測對象為225位來自59個國家的高中化學資優生；本研究利用古典測驗理論檢視試題性質與測驗結果分析, 研究結果如下： 一、 本屆八大題理論試題的試題難易度指數(P值)在 .49~ .75之間，鑑別力指數(D值)在 .35~ .64之間，屬於難易度中等偏易，鑑別力非常優良之試題、符合競賽目的與學術委員會之預期目標。 二、 本屆理論試題由於化奧規章在評分上相當嚴謹，所以具有相當高的評分者信度，且試題之Cronbach’s α 係數為 .90，試題品質十分良好。 三、 各大題得分與總分相關在 .71~ .85之間，皆達高度相關，代表命題皆能在同一個脈絡下進行，內容效度經過相關比對後，層級三試題除7-3小題外，皆能在準備題中找到，所以本屆試題的效度水準應足以區辨學生高低上下。 四、 有機理論題及有機實驗題相關為0.39、分析理論題及分析實 驗題相關為0.38，皆達 .01 顯著水準的低度相關，符合命題時的目標：理論題與實作題應測量不同領域的能力。 根據研究結果，本屆理論考試試題大致能夠維持優秀出題水準，也相當符合學術委員會所預定的競賽目的。 關鍵字：第卅七屆2005國際化學奧林匹亞，理論試題， 古典測驗理論 ， 難易度指數，鑑別力指數，Cronbach’s α 係數Abstract This research is the study of the theoretical tasks prepared by the academic committee of the 37th 2005 International Chemistry Olympiad (37th IChO). Item analyses and suggestions of these tasks are reported in this study. There are 8 tasks (62questions/items) in 37th ICHO theoretical tasks which were made by the scientific committee’s professors in Northern Taiwan. It covers five major fields of chemistry：organic chemistry、inorganic chemistry、physical chemistry、analytical chemistry、practical chemistry. Test contents from environmental issues to local and practical culture in Taiwan, were widely and uniquely considered. In the 37th International Chemistry Olympiad, there were 225 senior high school competitors who came from 59 different countries participating in the five-hour theoretical examination. Each of them was very outstanding in this area. The results and discussion derived from item analyses by the classical test theory and the related studies of the tasks are as follows: 1. The item discrimination index of the theoretical tasks is between .35~.64, and the item difficult index of the tasks is between .49~.75, indicating that the tasks which accord with the goal of the academic committees as a result of whose excellent discriminations and easy difficulties. 2. By the serendipity of the rules of the ICHO, the theoretical tasks were well qualified with excellent scoring reliability. Cronbach’s α is .90 . Quality of these tasks is excellent. 3. Quantitative analysis reveals that significant high correlations existed among each item’s score and total score of the tasks.( r > .71, p<.01 ). It means that all the tasks are on same framework of the chemical theory (are coherent through out the whole exam). All the question-items in tertiary level can be found parallelly in the preparatory problems except 7-3. So we can say that the content validity of the 37th theoretical tasks is good enough to differentiate from excellent and fair grades. 4. Quantitative analysis indicated that significant low correlation existed both between examinees’ organic chemistry achievement intheory and practical ( r = .39, p<.01 ), and between examinees’ analytic chemistry achievement in theory and practical ( r = .38, p<.01 ). These results are met with the goal set by the target that theoretical tasks and practical tasks should measure different abilities.

In summary, the theoretical tasks of 37th ICHO were well designed and tested, which in accordance with the aims proposed by the academic committee of this event.

Keywords: International Chemistry Olympiad, Theoretical Tasks, Classical Test Theory, P-Index, D-Index, Cronbach’s α