UV9917V1 – Introduction to International Assessment Databases

Course content

The goals of this course are to:

  1. Familiarize participants with the statistical complexities involved in using international large-scale assessment databases
  2. Familiarize participants with the data structure of TIMSS and PISA
  3. Familiarize participants with software currently available to take into account statistical and data complexities of the TIMSS and PISA database
  4. Prepare users to take into account the statistical complexities and complex data structure when using the databases with commercially available software.

Learning outcome

The course will provide an overview of the structure and contents of the TIMSS and PISA databases, as well as an overview of the main design features of these surveys that are relevant for the analysis of their data. The topics covered include:

  • Overview of the surveys and available data
  • Review of the background questionnaires
  • Sampling and design issues and implications for analyses
  • Overview of sampling
  • Sampling variance estimation
  • Assessment design
  • Principles of item response theory
  • Principles of population modeling and multiple imputations
  • Estimating sampling variance
  • Using the IDB Analyzer to analyze international large-scale assessment data
  • Using the International Data Explorer
  • Calculating standard errors with complex designs
  • Working with independent and dependent samples
  • Working with composite statistics

The general schedule will include both presentations and hands-on practical assignments.

Admission

All applicants must hold at least a Master's degree.

All candidates admitted to a PhD-program at the Faculty of Educational Sciences (UV): Apply by using Studentweb

Other applicants: apply through registration form

Registration deadline: January 27th 2017

Maximum participants: 20

Teaching

Dates: 6th - 7th February 2017
Times: 9:00 to 16:00

Lecturers: Eugenio Gonzalez, PhD (ETS); Leslie Rutkowski, PhD (CEMO)

Location: room 232, Helga Engs hus, University of Oslo

 

Literature: 

1. Rutkowski, L., Gonzalez, E., Joncas, M., & von Davier, M. (2010). International large-scale assessment data: Issues in secondary analysis and reporting. Educational Researcher, 39(2), 142-151.

2. Rutkowski, L., von Davier, M. Gonzalez, E., & Zhou, Y. (2014). Assessment design for international large-scale assessment. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis. London: Chapman & Hall/CRC Press

3. von Davier, M., Gonzalez, E., & Mislevy, R. J. (2009). What are plausible values and why are they useful? IERI Mongraph Series, 2, 9–36.

4. Wu, M. (2005). The role of plausible values in large-scale surveys. Studies in Educational Evaluation, 31(2), 114–128.

5. Mislevy, R. (1995). What can we learn from international assessments? Educational Evaluation and Policy Analysis, 17(4), 419-437.

6. Rutkowski, D., Rutkowski, L., & von Davier, M. (2014). A brief introduction to modern international large-scale assessment. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis. London: Chapman & Hall/CRC Press

7. Gonzalez, E., & Rutkowski, L. (2010). Principles of multiple matrix booklet designs and parameter recovery in large-scale assessments. IEA-ETS Research Institute Monograph, 3, 125-156.

8. Linn, R. L. (2002). The measurement of student achievement in international studies. Methodological advances in cross-national surveys of educational achievement, 27-57.

9. Chromy, J. (2002). Sampling issues in design, conduct, and interpretation of international comparative studies of school achievement. Methodological advances in cross-national surveys of educational achievement, 80-116

Examination

To obtaine 1 study point 80% participation is required.

Evaluation

Evaluation form.

Facts about this course

Credits
1
Level
PhD
Teaching

Spring 2017

Teaching language
English