|
Objectives:
-
The action should promote the learning and long-term retention
of important knowledge and content skills that students are expected
to learn, as defined by the district’s standards/curriculum.
-
The action should provide students with knowledge and skills
that have applicability to a broad range of situations/contexts—not
just completion of a set of multiple-choice questions.
-
The amount of instructional time dedicated to test preparation
should be warranted in light of the types of educational opportunities
being replaced/lost.
-
The actions should be matched with the needs of individual students.
Negative consequences associated with lost educational value
include the following:
-
Student learning is short-term or is lacking in importance.
-
Students are not learning all important educational outcomes
due to the reallocation of instructional emphasis.
-
Students are not being given the opportunity to apply their
knowledge and skills to a broad range of situations.
All of these consequences are worse (for students) than if the
school makes “the list.”
Let’s turn to a scenario illustrating the use of multiple-choice
questions on classroom assessments and consider in what ways this
practice is related to educational opportunities gained and lost.
(Duration: 44 sec., File size: 1 MB)
Mr. Newton, a 7th grade science teacher
has become annoyed and overwhelmed by the continuous edicts
from the administration to “get those scores up.”
Though he’s adamant about not changing the curriculum,
he has decided that one logical and beneficial thing to do is
to structure most of his classroom tests like the ITBS so that
students are familiar with the format and language used on the
science assessment. To do this, he reviewed the Interpretive
Guide for Teachers and Counselors and saw that a large number
of questions on the Science test were related to scientific
inquiry—a skill he teaches but very rarely assesses on
his regular classroom tests. Thus, he has made a concerted effort
to include multiple-choice questions on his regular classroom
tests to measure skills related to scientific inquiry. |
It appears as if Mr. Newton has decided to integrate test preparation
into his regular instruction instead of right before the ITBS
is administered. Is this appropriate? According to the guidance
from Iowa Testing Programs (August, 2005):
| Q: |
How far in advance of testing should test-preparation
activities be used, or for how long prior to the start of testing
should each activity be used? |
So, integrating the practice into regular instruction is a good
thing. But what about the fact that Mr. Newton has structured most
of his classroom tests to be similar to the ITBS in terms
of item format and language used? What, if anything, has been gained
or lost? Do the benefits outweigh the loss?
The emphasis that Mr. Newton has placed on scientific inquiry—a
skill directly covered by the ITBS—is not problematic
because it is a valuable learning outcome as defined by his school’s
curriculum and because he did not use questions from the
ITBS as a model of what he should include on his regular
tests.
In addition, helping students with the format of the test helps
ensure that errors are a result of lack of achievement and not because
of a lack of understanding based on how the question was worded.
However, if he makes most of his tests resemble the ITBS (i.e.,
nearly all multiple choice questions), he will miss out on other
aspects of science achievement, such as use of lab equipment and
the written summaries of lab results, which are not easily measured
by multiple-choice questions.
As a final scenario, let’s look once again at an example
of how teaching of test-taking skills might be implemented.
(Duration: 32 sec., File size: 0.7 MB)
At South Central Junior High, “ITBS Week” is a time when everyone comes together in a unified
effort to motivate and prepare students for the tests. The counselor
has developed a test-taking skills curriculum, and every teacher
uses this curriculum with his or her 2nd period students the
week before the test for two full class periods. Skills that
are practiced include strategies for answering multiple-choice
questions, what to do when you get stuck on a problem, and tips
for pacing and timing. The curriculum is also designed to motivate
students to try their best. |
The staff at South Central Junior High are using practices designed
to review test-taking skills rather than content that will be on
the test; it is encouraging that the efforts are designed to help
students do their best on the tests so as to get the most accurate
scores possible. However, two full class periods on these skills
might be a bit much and probably takes away from other important
learning objectives. Additionally, doing the practice right before
the test might place undue pressure on some students. This pressure
could result in them not being able to do their best, and may result
in only short-term learning of these important skills. A few students
might benefit from such intense work, but most likely won’t.
Thus, the activity helps a few and wastes the time of many.
But, what about the fact that all students are being taught this
test-taking skills curriculum? Is it important to make sure that
all students are treated the same way? Once again, turning to the
guidance provided by Iowa Testing Program (August, 2005):
| Q: |
Should all students be provided an opportunity
for test preparation in advance of the actual test each year? |
| Scenario Activity:
You have now completed Part 4. The examples provided
in this part of the module were selected to illustrate some
of the most common practices used by teachers in an attempt
to prepare students for the Iowa Tests. Additional scenarios
are available for you to apply what you have learned regarding
how the appropriateness of test preparation can be evaluated
in terms of academic ethics, score meaning &
use, and educational value.
Although you can work through these scenarios on
your own, working together in a small group would probably
be more beneficial because of the opportunity to interact
and exchange ideas and perceptions. There is no need to work
through the scenarios sequentially or to complete them all
at once—each scenario is independent of the others.
Thus, if you are not able to work through the scenarios at
this time, you might want to consider using part of them when
you return to complete the module as a way of reviewing previously
learned concepts before returning to Parts 5 and 6.
The expanded flowchart in the following figure provides
a summary of the general questions to be considered for each
of the three criteria. (A print-version of this flowchart
is located on page 27 of the print version of Part 4, which
can be obtained from the “Downloads”
page.) |

|