Syllabus/achievement requirements

Analysis of Large-Scale Assessment Data: 

Andreas Frey

[Book]: Rutkowski, L., Rutkowski, D., & von Davier, M. (Eds.) (2014). Handbook of international large-scale assessment. Background, technical issues, and methods of data analysis. Boca Raton: CRC Press.

The following chapters will be used:

• Rutkowski, D., Rutkowski, L., & von Davier, M. (2014). A brief introduction to modern international large-scale assessment. 
• Wagemaker, H. (2014). International large-scale assessments: From research to policy. 
• Rust, K. (2014). Sampling, weighting, and variance estimation in international large-scale assessments. 
• von Davier, M., & Sinharay, S. (2014). Analytics in international large-scale assessments: Item response theory and population models. 
• Stapleton, L. M. (2014). Incorporating sampling weights into single- and multilevel analyses. 
• Kim, J. S., Anderson, C. J., & Keller, B. (2014). Multilevel analysis of assessment data. 
• Rutkowski, L., & Zhou, Y. (2014). Using structural equation model to analyze ILSA data. 

[Electronic handbook] OECD (2009). PISA data analysis manual (2. Ed.). Paris: OECD Publishing. Retrieved from https://www.oecd-ilibrary.org/education/pisa-data-analysis-manual-spss-second-edition_9789264056275-en

The following chapters will be used:

• OECD (2009). Exploratory analysis procedures. In OECD (Ed.), PISA data analysis manual (pp. 35-46). 
• OECD (2009). Sample weights. In OECD (Ed.), PISA data analysis manual (pp. 47-56). 
• OECD (2009). Replicate weights. In OECD (Ed.), PISA data analysis manual (pp. 57-75). 
• OECD (2009). Plausible values. In OECD (Ed.), PISA data analysis manual (pp. 93-101). 
• OECD (2009). Computation of standard errors. In OECD (Ed.), PISA data analysis manual (pp. 103-115).
• OECD (2009). Analyses with plausible values. In OECD (Ed.), PISA data analysis manual (pp. 117-131). 
• OECD (2009). Standard error on a difference. In OECD (Ed.), PISA data analysis manual (pp. 149-162). 
• OECD (2009). Trends. In OECD (Ed.), PISA data analysis manual (pp. 173-181). 

Note: Please ignore the parts referring to SPSS syntax in some chapter; we will use R in the course.

Additional sources
Frey, A., & Hartig, J. (in press). Methodological challenges of international student assessment. In H. Harju-Luukkainen, N. McElvany, & J. Stang. Monitoring of Student Achievement in the 21st Century - European Policy Perspectives and Assessment Strategies. New York: Springer. [This text will be placed on Canvas as it is not yet available in print]

OECD (2019). What is PISA? In OECD (Ed.), PISA 2018 assessment and analytical framework (pp. 11-20). 

Program Evaluation:

David Rutkowski

[Book]: Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines. Pearson Education.

The reading list for Jan-Eric Gustafsson's workshop will be published on the semester page for spring 2020, which will be available in the end of November 2019.