我國大學校院系所評鑑結果之效度檢核與改進研究－以政治學門評鑑報告之內容分析為例

Abstract

我國於2005年底成立財團法人高等教育評鑑中心基金會，專責辦理系所評鑑等大學相關評鑑工作，至此，我國大學評鑑制度已經進入專業化、制度化階段。我國大學校院系所評鑑自2006年開始實施，以五年為一個週期，至2010年結束，謂之第一週期大學系所評鑑，計有79所大學校院（含9所軍警校院）、2920個系所班制接受評鑑。 本研究基於後設評鑑強調「任何的評鑑都可以接受評鑑」之觀點，以政治學門評鑑報告為例進行研究。由於評鑑報告是評鑑結果是否具有效度的關鍵證據，因此，利用評鑑報告作為後設評鑑對象，進行檢視評鑑結果的正確性，並根據研究發現與結論提出改進建議，以供相關單位參考。本研究主要運用文獻分析法與內容分析法，進行文獻探討，並針對政治學門38系所66個班制的評鑑報告內容進行質性與量化分析。 整體而言，經由對評鑑報告進行內容分析，研究發現評鑑認可要素的確是評鑑結果通過與否的重要關鍵，系所評鑑報告具有高度的評鑑效度，評鑑結果具有效度；系所辦學量化指標並非影響系所評鑑結果的關鍵因素；惟應強化評鑑報告的信服度，提昇評鑑委員的評鑑專業知能。同時，文獻探討發現對於續辦系所評鑑的必要性或價值性，各大學仍然有相當程度的疑慮。 本研究根據16項的綜合性結論，針對主管教育行政機關與高教評鑑中心提出下列建議：1.引導我國大學建立自我認可機制，強化其功能，並建立外部校務評鑑與內部系所評鑑機制2.重起大學評鑑辦法的修訂工作3.成立專責單位，積極推動大學後設評鑑4.建置評鑑委員隨時更新的長期性資料庫，並且建構評鑑委員選聘、培育訓練及專業倫理的有效機制，以追求更高的評鑑客觀性與公正性5.規劃我國研究評鑑制度，以強化提昇我國大學的研究力與競爭力。其次，針對各大學校院提出建議如下：1.建構系統化的自我評鑑與自我改進機制，以落實辦學績效責任2.虛心面對外部評鑑機制，化為辦學績效助力3.強化師資結構素質是各大學校院的要務4.參考英國大學的作法，建立學生充分參與校內自我評鑑的機制，以贏得學生對於學校的認同歸屬感。Higher Education Evaluation& Accreditation Council of Taiwan (HEEACT) has been founded in the year 2005, the aim of this organization is to assist on Program Accreditation、 Institutional Accreditation and so forth. The Institutional Accreditation System has now come in to a specialized and institutionalization stage. The Institutional of the Accreditation System has a period of five years each cycle, which has introduced in year 2006, and the first trial was ended in year 2010. There were 79 Universities (including ninemilitary Police School), 2029 Department shifts agreed to participate. The results show that there are still rooms for improving this system as the universities and communities are having negative feedback and doubts after implementation of the system. This study is based on the Meta-evaluation theory that is “every evaluation can be evaluated’. Taking the political science Specialized Accreditation as an example, the evaluation report is the key evidence of the evaluation validity. Therefore, the use of the evaluation report as a meta-evaluation object, to examine the validity of evaluation results, and to make recommendations based on the findings and conclusions, to the relative reference. This study used literature analysis and content analysis, against 38 political science department and 66 shifts by the qualitative and quantitative content analysis of evaluation reports. Overall, through a content analysis on the evaluation report Accreditation factor is indeed an important key to evaluation results through, Specialized Accreditation results with high degree, that departments review reports with a high degree of assessment validity. The quantification of running indicator was not the key factor that to affect the faculty evaluation results. Strengthen convinced of the evaluation report, and thus enhance the evaluation committee's evaluation of professional knowledge and ethics, is the key to the success of the evaluation. Meanwhile, the literature review found that for renewal Specialized Accreditation of the necessity or value of, the universities still have a considerable degree of doubt. According to 16 integrated conclusions of this study, recommends to the educational administration agency and Higher Education Evaluation& Accreditation Council of Taiwan (HEEACT) as follow: 1. Guide the Universities to set up self-evaluation system, strengthening its functions and to establish external Institutional Accreditation system and internal Specialized Accreditation mechanisms. 2. Resume and revise the Higher Institutional Accreditation Rule. 3. Set up an ad hoc unit to actively pursue the Higher Institutional Meta-evaluation. 4. Build long term comment updated database, and building effective evaluation mechanisms forselecting, nurturing and training of members and professional ethics in pursuit of higher appraisal objectivity and impartiality. 5. Plane to study on evaluation system of our country, strengthening the University's research and competitiveness. Moreover, make recommendations to the higher education institution as follow: 1. Construct systematic self-evaluation and self-improvement mechanism for the implementation of school accountability. 2. Humbly face of external evaluation mechanisms into school performance booster. 3. Enhanced quality faculties’ structure is the major priorities of colleges. 4. Refer to United Kingdom University practices, establishing internal self-evaluation of student participation in school perfecting mechanism in order to win recognition of the students for the school a sense of belonging.