Table 20.2 Person score and measure distribution |
Top Up Down
A A |
TABLE 20.2
TABLE OF SAMPLE NORMS (500/100) AND FREQUENCIES CORRESPONDING TO COMPLETE TEST
+---------------------------------------------------------------------------+
| SCORE MEASURE S.E.|NORMED S.E. FREQUENCY % CUM.FREQ. % PERCENTILE|
|------------------------+--------------------------------------------------|
| 0 -6.17E 1.83| 147 107 0 .0 0 .0 0 |
| 1 -4.86 1.08| 225 63 0 .0 0 .0 0 |
| 2 -3.94 .85| 278 50 1 2.9 1 2.9 1 |
| 3 -3.27 .79| 318 46 2 5.9 3 8.8 6 |
| 4 -2.64 .78| 355 46 2 5.9 5 14.7 12 |
| 5 -1.97 .83| 394 49 2 5.9 7 20.6 18 |
| 6 -1.19 .92| 440 54 3 8.8 10 29.4 25 |
| 7 -.23 1.00| 496 59 12 35.3 22 64.7 47 |
| 8 .80 .97| 557 57 5 14.7 27 79.4 72 |
| 9 1.72 .92| 610 54 4 11.8 31 91.2 85 |
| 10 2.55 .89| 660 52 1 2.9 32 94.1 93 |
| 11 3.37 .89| 707 52 2 5.9 34 100.0 97 |
| 12 4.21 .93| 756 54 0 .0 34 100.0 100 |
| 13 5.23 1.12| 817 66 0 .0 34 100.0 100 |
| 14 6.60E 1.84| 897 108 0 .0 34 100.0 100 |
+---------------------------------------------------------------------------+
The columns in the Table of Sample Norms and Frequencies are:
Measures on the Complete Test: |
|
SCORE |
raw score on a complete test containing all calibrated items |
MEASURE |
measure corresponding to score |
If a person did not take all items or items are weighted, then that person is stratified with the measure on the complete test nearest the person's estimated measure (as reported in Table 18), regardless of that person's observed score. |
|
S.E. |
standard error of the measure (model) |
The statistical information is (USCALE/S.E.)² |
|
Statistics for this sample: |
|
NORMED |
measures linearly locally-rescaled so that the mean person measure for this sample is 500 and the sample measure sample standard deviation is 100. Equivalent to UPMEAN=500, USCALE=100/(Person S.D.) |
S.E. |
standard error of the normed measure (for a score based on all the items) |
FREQUENCY |
count of sample with measures at or near (for missing data) the complete test measure |
% |
percentage of sample included in FREQUENCY |
CUM.FREQ. |
count of sample with measures near or below the test measure, the cumulative frequency. |
% |
percentage of sample include in CUM. FREQ. |
PERCENTILE |
mid-range percentage of sample below the test measure, constrained to the range 1-99 for non-zero frequencies. |
Logit measures support direct probabilistic inferences about relative performances between persons and absolute performances relative to items. Normed measures support descriptions about the location of subjects within a sample (and maybe a population). Report the measures which are most relevant to your audience.
This Table is easy to paste into Excel. Use Excel's "data", "text to columns" feature to put the scores and measures into columns.
Example: I want to stratify my sample into low, medium, high ability groups.
The separation index is based on the statistical fiction that your data accord exactly with a normal distribution and that the average measurement error (RMSE) precisely summarizes the precision of your data. In practice, these assumptions are only met approximately.
If your data are "complete" (everyone responds to every item), then a convenient places to start is Table 20.2. Starting at the lowest score, look down the scores until you find the score that best characterizes (as a first guess) your "low group". Then mentally multiply its S.E. by 3, and add it to the measure for the low group. This will take you to the measure for the middle group, which will be approximately statistically significantly different (p<.05) from the low group. Do the same again for the middle group, and it will take you to the high group. Same again may take you to an even higher group, or up into the outliers at the top of the test. The cut-points will be half-way between the group centers that you have identified.
Do the same process from the top score downwards for another version of the stratification.
Then synthesize the two stratifications by adjusting the group by moving their center scores further apart (not closer together).