• What It Does
• Input Files
• Graphical User Interface
• Command Line Interface
• Output Files
• Video Instructions

This software has been deprecated. The software at https://www.assessmentdisaggregation.org/ does everything this software does, and more.

Disaggregate and Adjust Value-added Learning Scores

A tool to disaggregate Scantron, ZipGrade, Quick Key, or Akindi pre- and post-test responses into value-added learning scores (Walstad and Wagner 2016) and adjust them for guessing (Smith and Wagner 2018).

In the Spring of 2016, Walstad and Wagner released a paper suggesting that the pre-test/post-test delta is insufficient in assessing learning outcomes. In 2018, Smith and Wagner showed that this disaggregation should be adjusted using the probability of guessing correct.   However, performing such a disaggregation and adjustment is time intensive, especially if the questions appear in a different location (or order) on the pre- and post-test.

 

This tool makes disaggregation easy. It uses four CSV (comma separated values) files to generate outcomes by question and student. The first file specifies the mapping between the assessment questions and their locations on the pre- and post-test. The second file is a list of student IDs to use in the assessment. Finally, the last two files are either Scantron files as routinely received from the testing center or ZipGrade formatted exam output files (used the 'standard' export option). The program can also read files from Akindi's CSV report (View Results->Actions->Download CSV) and Quick Key with limited modification to the 'quiz itemization report' (the user must remove the header and save the output as a CSV).