Computer Programs, CASMA, College of Education

Equating Recipes Open-source Code and Monograph

Classification/Decision Consistency Programs

NOTE:
The PC files are in .zip format. They can be unzipped using various software including WinZip (www.winzip.com) and PK Unzip (www.pkware.com).

The Mac files are in .sit format. These files require Stuffit Expander to extract the contents. A free version of Stuffit Expander is available from www.stuffit.com/win/index.html.

(Stuffit can also expand .zip files.)

Download GENOVA Suite Programs (top)

The GENOVA Suite of computer programs for generalizability theory consists of GENOVA, urGENOVA, and mGENOVA. The three programs are coordinated with Brennan (2001), which provides an extensive treatment of generalizability theory. Brennan (2001) can be purchased from the publisher, Springer-Verlag (www.springer-ny.com). It is strongly recommended that users of these programs consult Brennan (2001) in order to interpret the output accurately.

There are complied versions of GENOVA, urGENOVA, and mGENOVA for both Macintosh PowerPCs and DOS/Windows-based PCs. Each of the programs in the GENOVA Suite may be distributed to others without obtaining the permission of the author(s). The folders for each program contain a "readme" file, a manual in pdf format, the application, and at least one sample input file.

Questions concerning these programs should be directed to:
Robert L. Brennnan
University of Iowa
CASMA, College of Education
210 Lindquist Center
Iowa City, IA 52242
(Tel: 319-335-5405) (Fax: 319-384-0505)
(Email: robert-brennan@uiowa.edu)

GENOVA (16.9 MB for P C and Mac)

GENOVA is a ANSI FORTRAN computer program for univariate generalizability analyses with complete, balanced designs. It has both G study and D study capabilities. GENOVA was designed by R. L. Brennan and coded by J. E. Crick in the early 1980s. The file is large because the manual is a pdf version of a scanned file.
urGENOVA (356 KB for PC and Mac)

urGENOVA is an ANSI C computer program for the estimation of variance components for unbalanced random effects G study designs. The program does not have D study capabilities. urGENOVA was designed and coded by R. L. Brennan.
mGENOVA (660 KB for PC and Mac)

mGENOVA is an ANSI C computer program for multivariate generalizability analyses for a restricted class of designs. For these designs, the program has both G study and D study capabilities. mGENOVA was designed and coded by R. L. Brennan.
GT Other (320 KB for PC and Mac)

Brennan's (2001) book on "Generalizability Theory" provides a set of exercises for each chapter, and Appendix I provides answers to about half of the exercises. Answers to the remaining exercises are provided as a separate pdf file in the "GT Other" folder. Also provided in this folder is a pdf file containing errata for "Generalizability Theory". In the future, this folder may contain additional files listing other information that may be of interest to users of generalizability theory.

Reference

Brennan, R. L. (2001). Generalizability theory. New York: Springer-Verlag.

Download Equating Recipes Open-source Code and Monograph (top)

Equating Recipes provides a set of open-source functions written in ANSI C to perform all types of equating discussed by Kolen and Brennan (2004), as well as some other equating methods, including modified frequency estimation, kernel equating, and continuized log-linear equating. There are over 25,000 lines of code in Equating Recipes, including comments. The Equating Recipes code and the associated monograph/manual are freely available. The code is available under the open-source license conditions discussed in the ReadMe file distributed with the code and summarized in Section 1.5 of the monograph/manual. Older versions of some of the Equating Recipe functions are used in equating programs provided elsewhere on the CASMA website.

Equating Recipes is provided in a folder named “ER for distribution (date)”. This folder contains: (a) source files and header files; (b) main functions, data files, conversion tables, and output files for the examples in the monograph/manual; (c) the Equating Recipes monograph/manual and a ReadMe file; and (d) the Microsoft Visual Studio project (which is the only code distributed that is platform specific). All users should read Chapter 1 of the monograph/manual, as well as the ReadMe file.

Equating Recipes (2,783 KB)

Reference

Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices (2nd ed.). New York: Springer-Verlag.

Download Equating/Linking Programs (top)

The computer programs listed below can be used to conduct many of the equating analyses described in Kolen and Brennan (2004). Data sets from this book are included with some of the programs. Windows PC console and graphical user interface (GUI) versions and Macintosh OS9 console and OS10 GUI versions are available for at least some of the programs. The programs can be downloaded below.

CIPE (for PC Console, for PC GUI, for MAC OS 9, for MAC OS10 )

Conducts linear and equipercentile equating under the common-item nonequivalent groups design.
RAGE-RGEQUATE (for PC Console, for PC GUI, for MAC OS9, for MAC OS10)

Conducts linear equating and equipercentile equating under the random groups design using cubic spline and log-linear methods.
Equating Error (for PC Console, for PC GUI, for MAC OS9, for MAC OS10)

Estimates bootstrap standard errors of linear equating and equipercentile equating under the random groups design.
PIE (for PC Console, for PC GUI, for MAC OS9, for MAC OS10)

Conducts IRT true and observed scoring equating for dichotomously scored tests.
POLYEQUATE (for PC Console, for MAC OS9)

Conducts IRT true and observed scoring equating for dichotomously and polytomously scored tests.
LEGS (for PC Console, for PC GUI, for MAC OS10, for MAC Console)

Conducts linear and equipercentile linking.

Reference

Kolen, M. J. & Brennan, R. L. (2004). Test Equating, Scaling, and Linking: Methods and Practices (2nd ed.). New York: Springer-Verlag.

Download IRT Scale Transformation Programs (top)

The computer programs listed below can be used to conduct various IRT scale transformations. Windows PC console and graphical user interface (GUI) versions and Macintosh OS9 console and OS10 GUI versions are available for at least some of the programs. The programs can be downloaded below.

ST (for PC Console, for PC GUI, for MAC OS9, for MAC OS10)

Conducts item response theory (IRT) scale transformations for dichotomously scored tests.
POLYST (for PC Console, for MAC OS9)

Conducts IRT scale transformations for dichotomously and polytomously scored tests.
STUIRT (for PC Console)

Conduct IRT scale transformations for mixed-format tests.

Download Classification/Decision Consistency Programs (top)

BB-CLASS (approximately 480 KB for PC and Mac)

BB-CLASS is an ANSI C computer program that uses the beta-binomial model (and its extensions) for estimating classification consistency and accuracy. BB-CLASS is intended to provide results for both the Hanson and Brennan (1990) and Livingston and Lewis (1995) procedures, although BB-CLASS has some capabilities that slightly extend these procedures. The BB-CLASS program, a manual, and the sample runs in the manual are provided.

References

Hanson, B. A., & Brennan, R. L. (1990). An investigation of classification consistency indexes estimated under alternative strong true score models. Journal of Educational Measurement, 27, 345-359.

Livingston, S. A., & Lewis, C. (1995). Estimating the consistency and ccuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179-197.
MULT-CLASS v3.0 (approximately 202 KB for PC)

MULT-CLASS is a FORTRAN computer program that uses the compound multinomial model for estimating classification consistency and accuracy. MULT-CLASS is intended to provide results discussed in Lee (2005).

References

Lee, W. (2005, Revised 2008). Classification consistency and accuracy under the compound multinomial model (CASMA Research Report No. 13). Iowa City, IA: University of Iowa.
IRT-CLASS v2.0 (approximately 224 KB for PC)

IRT-CLASS is a PC console version of a FORTRAN computer program that computes classification consistency and accuracy indices for raw and scale scores. IRT-CLASS is intended to be used for tests that are scaled using dichotomous, polytomous, or mixtures of different IRT models.

Reference

Lee, W. (2008). Classification consistency and accuracy for complex assessments using item response theory (CASMA Research Report No. 27). Iowa City, IA: University of Iowa.

Download Other Programs (top)

POLYCSEM (for PC Console, for MAC OS9)

POLYCSEM can be used to estimate conditional standard errors of measurement under an IRT model dichotomously and polytomously scored tests.