Establishing the criterion-related, construct, and content validities of a simulation-based assessment of inquiry abilities

dc.contributor.authorWu, P. H.en_US
dc.contributor.authorWu, H.-K.en_US
dc.contributor.authorHsu, Y. S.en_US
dc.description.abstractThe emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed students to generate scientific explanations and demonstrate their experimental abilities. This paper describes the validation of the assessment. Data were collected from 48 12th-grade students at a local high school who were categorized into three groups based on their program majors. Both quantitative and qualitative approaches were utilized to validate SAIA. The quantitative results showed that SAIA was aligned with a validated reasoning-skill test (criterion-related validity), discriminated variance among different groups (construct validity), and was highly suitable for examining inquiry abilities (content validity). Additionally, we utilized the think-aloud technique in order to identify the performances exhibited by students while they accomplished the SAIA tasks. The protocol analysis indicated that in general, students demonstrated the expected abilities in SAIA and that their SAIA scores accurately reflected their performance levels of inquiry abilities. The results suggested that SAIA was a valid assessment for evaluating the inquiry abilities of high school students. This study also provided systemic strategies for validating simulation-based assessments.en_US
dc.relationInternational Journal of Science Education, 2013.en_US
dc.subject.otherSimulation-based assessmenten_US
dc.subject.otherInquiry abilityen_US
dc.titleEstablishing the criterion-related, construct, and content validities of a simulation-based assessment of inquiry abilitiesen_US