Ch 11 Norms, Scores and Profiles
Most of today is norms/scores.
In the field of education, we have two types of tests: NRT, CRT. Not distinguishable. Really in depth, ask a lot of questions.
Reporting of the scores.
NRT - lots of computation, interpretation of results wrt norm.
Ex: Give a test, tell you that he got 47 on the test. What can you tell about the test? Nothing, as far as assessment is concerned. Need a reference.
How did the others do? 20 students too it, and here is the distribution of scores. 47 in the top quarter. Top 5. Or bottom 5. Make a conclusion based on the others. That's only in relation to the peers. May not have been the typical class.
Average was 40? Conjure that he did better than average. That average is the norm, if it is a group of people like Ed.
What constitutes a meaningful norm?
How people perceive the effectiveness of TV in education people about the environment. Compare it to a study in 1954, people here now really are more effective in using the environment. Comparing people now to old norm. Not good.
Have to make sure that the average is derived from viable set of information.
Norms-
Recency. Needs to be a reasonably close period of time, so that time is not a variable in the scores. What is reasonable? Not a uniform answer. Expensive for some tests, can't afford to do it every two years. May not be money related, may be human subjects who are unwilling.
Representative. How effective are my methods for instruction of CEP 920? Should not run the test on 10,000 graduate students at large. They may be large number of current grad students, but not representative of the people in the class.
Great test of math problem solving for 8th graders. (Because it is the best indicator of math processes in high school) Look at NAEP results, MI is right in the middle of the nation. select states distributed in the midwest, ask for a sample of 8th graders. Adminster the test. Have a norm and how we have a national norm. (Regionally normed, higher and lower good for validity, but the choice of groups makes the norms for grades 7-9)
All schools in country with 8th graders. list alphabetically. 6K public schools. Select every 100th building. Write to them, please participate in this test. Give each of them a $1000 certificate to B&N if they participate. Get response from 300. Others don't respond. Wrote to 600 hoping to get 300. Do testing. Is there systematic error in selection (getting poor schools, rather than rich ones), not representative.
Grade level, age level, SES, community type, region state.
Precision of the norms.
Standard 4.6
Difficult to relate to others, to get a quality sample.
More than one norm in education.
Ex: Catholic school. ITBS wants to compare to all students public/private. Want to know how you do wrt other catholic schools nationally or in MI. How compared to catholic schools in region of the state. Develop norms not just for nation, but also state and region.
NCE - Normal curve equivalent
Creation of feds and USDoE. Chapter 1, to assist students. Billions of dollars, started by LBJ.
![[info]](http://l-stat.livejournal.com/img/userinfo.gif){kind=small}