Lesson 3: Technical Adequacy Parts 2 and 3:
What is the quality of data collection and reporting?

Lesson 3 Self Test

For each item in this self test, read the item and then click on the circle you wish to select for a correct response. After you have made your selection, feedback will be provided to you. A total score will not be calculated

1. The primary purpose of an accommodation is to
 
a. help a student get the best score possible.
b. satisfy the requirements of an IEP.
c. help obtain a good measure of a student's achievement.
d. enable all students to be included in an assessment.
Feedback
 
2. When deciding which accommodation, if any, to use with a particular student who has a disability, one should rely most on
 
a. recommendations in the student's IEP.
b. the recommendation of the student's special-education teacher.
c. procedures usually used by the teacher for classroom assessments.
d. procedures used last year for the student.
Feedback
 
3. Which of the following is not an appropriate accommodation for use with an English Language Learner (ELL) on a science test?
 
a. Providing a read-aloud in English
b. Providing an English glossary of science terms
c. Teacher translation of test directions in student's native language
d. Testing individually or in a small group
Feedback
 
4. Which of these would be the most appropriate method for determining the best test level for a particular student?
 
a. Consult the test manual to determine the test level for the student’s grade.
b. Try to match the content of a test level with the student's instructional level across the curriculum.
c. Try to match the reading in a test level with the student's reading level.
d. Determine which test level was used last year and select the next one.
Feedback
 
5. Whenever a student is allowed multiple accommodations (e.g., extra time and sections of the test read aloud), this constitutes a modification to the test.
 
a. True
b. False
Feedback
 
6. In which scoring situation should we have the most confidence in the scores assigned to 200 student responses to a 5-point task?
 
a. 85% exact agreement based on two independent scorings of 80 responses
b. 90% exact agreement based on two independent scorings of 10 responses
Feedback
 
Use the table below to answer questions 7 and 8 about the ratings of a 3-point task by two raters.
 
7.

What is the percent of exact agreement for this scoring situation?

 
a. 20%
b. 70%
c. 95%
d. 100%
Feedback
 
8. What is the percent of agreement within 1 point for this scoring situation?
 
a. 20%
b. 70%
c. 95%
d. 100%
Feedback
 
Use this graph to answer items 9-11.
 
9. It would be easier to examine the gender trends if the groups on the horizontal scale were rearranged so that all of the males are grouped together and all of the females are grouped together.
a. True
b. False
Feedback
 
10. The titles for the horizontal and vertical scales both should be rewritten to improve their clarity and accuracy.
 
a. True
b. False
Feedback
 
11. The title for the graph should be rewritten to communicate more clearly what is in the graph.
 
a. True
b. False
Feedback
 
The following table contains a reporting error. Use the table to answer items 12-14.
 
12. Which of the following changes would most improve the quality of the inferences readers might make from the scores reported in this table?
 
a. Present the data in a graph instead of a table
b. Include the number of students in each grade
c. Revise how the scores in the table are represented or labeled
Feedback
13. What appears to be the intended purpose for reporting this set of scores?
 
a. To make state and national comparisons for each grade
b. To monitor annual improvement within each grade
c. To make state and national comparisons and to monitor annual improvement
Feedback
14. Which type of score information is most likely being reported in this table?
 
a. Average percent-correct scores
b. Percent of students “proficient and above”
c. Percentile ranks of average scores
Feedback
 
End of Lesson 3 Self Test
 
 UILogo All contents copyright ©2003.The University of Iowa®. All rights reserved.