Test Preparation:
Considering the Appropriateness of these Activities

A Professional Development Module for Iowa Educators

space

space

Criterion #3: Educational Value (gained and lost)


Objectives:

  1. The action should promote the learning and long-term retention of important knowledge and content skills that students are expected to learn, as defined by the district’s standards/curriculum.

  2. The action should provide students with knowledge and skills that have applicability to a broad range of situations/contexts—not just completion of a set of multiple-choice questions.

  3. The amount of instructional time dedicated to test preparation should be warranted in light of the types of educational opportunities being replaced/lost.

  4. The actions should be matched with the needs of individual students.

Negative consequences associated with lost educational value include the following:

  • Student learning is short-term or is lacking in importance.

  • Students are not learning all important educational outcomes due to the reallocation of instructional emphasis.

  • Students are not being given the opportunity to apply their knowledge and skills to a broad range of situations.

All of these consequences are worse (for students) than if the school makes “the list.”

Let’s turn to a scenario illustrating the use of multiple-choice questions on classroom assessments and consider in what ways this practice is related to educational opportunities gained and lost.

(Duration: 44 sec., File size: 1 MB)

Mr. Newton, a 7th grade science teacher has become annoyed and overwhelmed by the continuous edicts from the administration to “get those scores up.” Though he’s adamant about not changing the curriculum, he has decided that one logical and beneficial thing to do is to structure most of his classroom tests like the ITBS so that students are familiar with the format and language used on the science assessment. To do this, he reviewed the Interpretive Guide for Teachers and Counselors and saw that a large number of questions on the Science test were related to scientific inquiry—a skill he teaches but very rarely assesses on his regular classroom tests. Thus, he has made a concerted effort to include multiple-choice questions on his regular classroom tests to measure skills related to scientific inquiry.

It appears as if Mr. Newton has decided to integrate test preparation into his regular instruction instead of right before the ITBS is administered. Is this appropriate? According to the guidance from Iowa Testing Programs (August, 2005):

Q: How far in advance of testing should test-preparation activities be used, or for how long prior to the start of testing should each activity be used?


So, integrating the practice into regular instruction is a good thing. But what about the fact that Mr. Newton has structured most of his classroom tests to be similar to the ITBS in terms of item format and language used? What, if anything, has been gained or lost? Do the benefits outweigh the loss?

The emphasis that Mr. Newton has placed on scientific inquiry—a skill directly covered by the ITBS—is not problematic because it is a valuable learning outcome as defined by his school’s curriculum and because he did not use questions from the ITBS as a model of what he should include on his regular tests.

In addition, helping students with the format of the test helps ensure that errors are a result of lack of achievement and not because of a lack of understanding based on how the question was worded. However, if he makes most of his tests resemble the ITBS (i.e., nearly all multiple choice questions), he will miss out on other aspects of science achievement, such as use of lab equipment and the written summaries of lab results, which are not easily measured by multiple-choice questions.

As a final scenario, let’s look once again at an example of how teaching of test-taking skills might be implemented.

(Duration: 32 sec., File size: 0.7 MB)

At South Central Junior High, “ITBS Week” is a time when everyone comes together in a unified effort to motivate and prepare students for the tests. The counselor has developed a test-taking skills curriculum, and every teacher uses this curriculum with his or her 2nd period students the week before the test for two full class periods. Skills that are practiced include strategies for answering multiple-choice questions, what to do when you get stuck on a problem, and tips for pacing and timing. The curriculum is also designed to motivate students to try their best.

The staff at South Central Junior High are using practices designed to review test-taking skills rather than content that will be on the test; it is encouraging that the efforts are designed to help students do their best on the tests so as to get the most accurate scores possible. However, two full class periods on these skills might be a bit much and probably takes away from other important learning objectives. Additionally, doing the practice right before the test might place undue pressure on some students. This pressure could result in them not being able to do their best, and may result in only short-term learning of these important skills. A few students might benefit from such intense work, but most likely won’t. Thus, the activity helps a few and wastes the time of many.

But, what about the fact that all students are being taught this test-taking skills curriculum? Is it important to make sure that all students are treated the same way? Once again, turning to the guidance provided by Iowa Testing Program (August, 2005):

Q: Should all students be provided an opportunity for test preparation in advance of the actual test each year?



Scenario Activity:

You have now completed Part 4. The examples provided in this part of the module were selected to illustrate some of the most common practices used by teachers in an attempt to prepare students for the Iowa Tests. Additional scenarios are available for you to apply what you have learned regarding how the appropriateness of test preparation can be evaluated in terms of academic ethics, score meaning & use, and educational value.

Although you can work through these scenarios on your own, working together in a small group would probably be more beneficial because of the opportunity to interact and exchange ideas and perceptions. There is no need to work through the scenarios sequentially or to complete them all at once—each scenario is independent of the others. Thus, if you are not able to work through the scenarios at this time, you might want to consider using part of them when you return to complete the module as a way of reviewing previously learned concepts before returning to Parts 5 and 6.

The expanded flowchart in the following figure provides a summary of the general questions to be considered for each of the three criteria. (A print-version of this flowchart is located on page 27 of the print version of Part 4, which can be obtained from the “Downloads” page.)



Senario Activity Flowchart

Go to Criterion #2  

Center for Evaluation and Assessment
218C Lindquist Center South Iowa City, IA 52242

Phone: 319.335.6457
Map http://www.uiowa.edu/~maps/l/lc1.htm

Copyright © The University of Iowa College of Education The University of Iowa College of Education