Syllabus/achievement requirements

Most of the texts on the reading list are available electronically through the University of Oslo Library. You have to be logged on to the UiO network in order to access them. Information about how to gain access from home can be found on this webpage.

The books that are listed are available in the library.

Analysis of Large-Scale Assessment Data

Andreas Frey

[Book]Rutkowski, L., Rutkowski, D., & von Davier, M. (Eds.) (2014). Handbook of international large-scale assessment. Background, technical issues, and methods of data analysis. Boca Raton: CRC Press.

The following chapters will be used:

  • Rutkowski, D., Rutkowski, L., & von Davier, M. (2014). A brief introduction to modern international large-scale assessment. 
  • Wagemaker, H. (2014). International large-scale assessments: From research to policy. 
  • Rust, K. (2014). Sampling, weighting, and variance estimation in international large-scale assessments. 
  • von Davier, M., & Sinharay, S. (2014). Analytics in international large-scale assessments: Item response theory and population models. 
  • Stapleton, L. M. (2014). Incorporating sampling weights into single- and multilevel analyses. 
  • Kim, J. S., Anderson, C. J., & Keller, B. (2014). Multilevel analysis of assessment data. 
  • Rutkowski, L., & Zhou, Y. (2014). Using structural equation model to analyze ILSA data. 

[Electronic handbook] OECD (2009). PISA data analysis manual (2. Ed.). Paris: OECD Publishing. Retrieved from

The following chapters will be used:


  • OECD (2009). Exploratory analysis procedures. In OECD (Ed.), PISA data analysis manual (pp. 35-46). 
  • OECD (2009). Sample weights. In OECD (Ed.), PISA data analysis manual (pp. 47-56). 
  • OECD (2009). Replicate weights. In OECD (Ed.), PISA data analysis manual (pp. 57-75). 
  • OECD (2009). Plausible values. In OECD (Ed.), PISA data analysis manual (pp. 93-101). 
  • OECD (2009). Computation of standard errors. In OECD (Ed.), PISA data analysis manual (pp. 103-115).
  • OECD (2009). Analyses with plausible values. In OECD (Ed.), PISA data analysis manual (pp. 117-131). 
  • OECD (2009). Standard error on a difference. In OECD (Ed.), PISA data analysis manual (pp. 149-162). 
  • OECD (2009). Trends. In OECD (Ed.), PISA data analysis manual (pp. 173-181). 

Note: Please ignore the parts referring to SPSS syntax in some chapter; we will use R in the course.

Additional sources
Frey, A., & Hartig, J. (in press). Methodological challenges of international student assessment. In H. Harju-Luukkainen, N. McElvany, & J. Stang. Monitoring of Student Achievement in the 21st Century - European Policy Perspectives and Assessment Strategies. New York: Springer. [This text will be placed on Canvas as it is not yet available in print]

OECD (2019). What is PISA? In OECD (Ed.), PISA 2018 assessment and analytical framework (pp. 11-20). 

Program Evaluation:

David Rutkowski

[Book]: Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines. Pearson Education.

The reading list for Jan-Eric Gustafsson's workshop will be published on the semester page for spring 2020, which will be available in the end of November 2019.

Published May 23, 2019 3:07 PM - Last modified Aug. 23, 2019 3:34 PM