AGREEFILE= paired-person agreement counts |
Top Up Down
A A |
(controlled by PSELECT=, ISELECT=, PSUBTOTAL=)
AGREEFILE= reports the paired-person information underlying Table 35. Use PSELECT= and ISELECT= to choose subsets to compare for agreement. Sub-samples (groups of persons) can be specified with PSUBTOTAL=.
AGREEFILE=? opens a Browse window.
When AGREEFILE= is launched from the Output Files menu, the AGREEFILE= dialog box displays.
Contents of AGREEFILE=
; AGREEMENT FILE FOR An MCQ Test: administration was Computer-Adaptive ISELECT=* PSELECT=*
TWOOBS TWOSAME TWOSCOR ONEHIGH TWOHIGH ONELOW TWOLOW ONEMISS TWOMISS MEASURE MEASURE STUDENT STUDENT P-LABEL PLABEL
1 0 0 1 0 1 0 68 35 .40 -1.92 1 2 IM CAT NM KAT
2 1 1 2 1 1 0 67 47 .40 5.04 1 3 IM CAT S STA
1 0 0 1 0 1 0 68 42 .40 2.07 1 4 IM CAT S CHE
1 0 0 1 0 1 0 68 47 .40 -3.09 1 5 IM CAT NL SMI
Field |
Columns |
Description |
TWOOBS |
1-8 |
count of items for which both persons have non-missing observations |
TWOSAME |
9-16 |
count of items for which both persons have the same non-missing observations |
TWOSCORE |
17-24 |
count of items for which both persons have non-missing observations scored the same |
ONEHIGH |
25-32 |
count of items for which one or both persons have non-missing observations scored in the highest (correct) category |
TWOHIGH |
33-40 |
count of items for which both persons have the same non-missing observations scored in the highest (correct) category |
ONELOW |
41-48 |
count of items for which one or both persons have non-missing observations scored in the lowest (wrong) category |
TWOLOW |
49-56 |
count of items for which both persons have the same non-missing observations scored in the lowest (wrong) category |
ONEMISS |
57-64 |
count of items for which one or both persons have a missing observation |
TWOMISS |
65-72 |
count of items for which both persons have missing observations |
MEASURE(1) |
73-80 |
person ability measure for one person |
MEASURE(2) |
81-88 |
person ability measure for the other person |
PERSON(1) |
89-96 |
person entry number for one person |
PERSON(2) |
97-104 |
person entry number for the other person |
P-LABEL(1) |
106-....(length of longest person label) |
person label for one person |
P-LABEL(2) |
(one blank, then) ...-.... |
person label for the other person |
Example 1: an MCQ test with 60 questions, scored 1, 0. One person answered questions 1-40 and the other answered 10-50. They were scored 1-1 on 10 items, 1-0 on 8 items, 0-1 on 5 items, 0-0 on 8 items = 31 items.
TWOOBS: both students must be observed on the item. They were both observed on items 10-40, so that 31 will appear here.
TWOSAME: counts of items to which both students made the same response. There was only one correct response to each item, so SAME = 10 (1-1) correct answers + 2 (out of 8 0-0) incorrect same choice of distractors = 12.
TWOSCORE: the count of items on which they scored the same (for a dichotomy, both correct or both incorrect). They made the SAME score on 10 (1-1) + 8 (0-0) = 18.
ONEHIGH: one or both persons scored in the highest category, "1", in 10+8+5 = 23 items. The "highest" category is the highest score possible on each item, for dichotomies usually scored 1. For Likert rating scales, the high category is usually scored 5.
TWOHIGH: 10 pairs of responses are in the highest category (1-1).
ONELOW: one or both persons score in the lowest category, "0", in 8+5+8 = 21 items. The "lowest" category is the lowest score possible on each item, for dichotomies usually scored 0. For Likert rating scales, the low category is usually scored 1.
TWOLOW: 8 pairs of responses are in the lowest category (0-0).
ONEMISS: there are 60 questions, the both responded to 31, so one or other or both students had missing data on ONEMISS = 60 - 31 = 29 items.
TWOMISS: items 51-60 were missing for both students. TWOMISS = 10.
Example 2: In the Excel AGREEFILE= output, the students are listed pairwise. To identify persons in Table 35.1.4, please compute two more columns: the average of the two measures (x-axis) and the TWOLOW/ONELOW value (y-axis). Plot y-axis against x-axis. Then put your mouse arrow on the plotted point of interest, and Excel will tell you where to find that point in the Excel worksheet.