Detlev Leutner: Development of proficiency scales for large-scale assessments such as PISA @ CREATE Lab

04/03/2013 3:00 pm – 04/03/2013 4:40 pm Development of proficiency scales for large-scale assessments such as PISA Detlev Leuter, University of Essen-Duisburg, Germany International large-scale assessments of school achievements such as the “Programme for International Student Assessment” (PISA) make use of psychometric proficiency scales that are based on modern Item-Response Theory (IRT). In this presentation, the process of developing such scales is outlined using – among others – examples from the PISA 2003 assessment of problem-solving skills. The item development process includes creating the assessment framework, developing and piloting test items, evaluating test items in the field test, and interpreting test results. The presentation will conclude by giving an outlook on new computer-based test instruments that are used in the PISA 2012 assessment of problem solving, the results of which will be published in 2014. Detlev Leutner is Professor for Instructional Psychology at Duisburg-Essen University. He received his PhD from RWTH Aachen University of Technology. His research interests include learning with multimedia, self-regulated learning, problem-solving skills, early mathematics skills, effectiveness of teacher training programs, and large-scale assessments. He is a member of the Senate of the German Research Foundation (DFG) and author/coauthor of nearly 300 papers and 25 books/edited books.