AGREEFILE= paired-person agreement counts

Top Up Down  A A

(controlled by PSELECT=, ISELECT=, PSUBTOTAL=)

 

AGREEFILE= reports the paired-person information underlying Table 35. Use PSELECT= and ISELECT= to choose subsets to compare for agreement. Sub-samples (groups of persons) can be specified with PSUBTOTAL=.

 

AGREEFILE=? opens a Browse window.

 

When AGREEFILE= is launched from the Output Files menu, the AGREEFILE= dialog box displays.

 

Contents of AGREEFILE=

 

; AGREEMENT FILE FOR An MCQ Test: administration was Computer-Adaptive ISELECT=* PSELECT=*

  TWOOBS TWOSAME TWOSCOR ONEHIGH TWOHIGH  ONELOW  TWOLOW ONEMISS TWOMISS MEASURE MEASURE STUDENT STUDENT P-LABEL PLABEL

       1       0       0       1       0       1       0      68      35     .40   -1.92       1       2 IM  CAT NM  KAT

       2       1       1       2       1       1       0      67      47     .40    5.04       1       3 IM  CAT S   STA

       1       0       0       1       0       1       0      68      42     .40    2.07       1       4 IM  CAT S   CHE

       1       0       0       1       0       1       0      68      47     .40   -3.09       1       5 IM  CAT NL  SMI

 

Field

Columns

Description

TWOOBS

1-8

count of items for which both persons have non-missing observations

TWOSAME

9-16

count of items for which both persons have the same non-missing observations

TWOSCORE

17-24

count of items for which both persons have non-missing observations scored the same

ONEHIGH

25-32

count of items for which one or both persons have non-missing observations scored in the highest (correct) category

TWOHIGH

33-40

count of items for which both persons have the same non-missing observations scored in the highest (correct) category

ONELOW

41-48

count of items for which one or both persons have non-missing observations scored in the lowest (wrong) category

TWOLOW

49-56

count of items for which both persons have the same non-missing observations scored in the lowest (wrong) category

ONEMISS

57-64

count of items for which one or both persons have a missing observation

TWOMISS

65-72

count of items for which both persons have missing observations

MEASURE(1)

73-80

person ability measure for one person

MEASURE(2)

81-88

person ability measure for the other person

PERSON(1)

89-96

person entry number for one person

PERSON(2)

97-104

person entry number for the other person

P-LABEL(1)

106-....(length of longest person label)

person label for one person

P-LABEL(2)

(one blank, then) ...-....

person label for the other person

 

Example 1: an MCQ test with 60 questions, scored 1, 0. One person answered questions 1-40 and the other answered 10-50. They were scored 1-1  on 10 items, 1-0 on 8 items, 0-1 on 5 items, 0-0 on 8 items = 31 items.

 

TWOOBS: both students must be observed on the item. They were both observed on items 10-40, so that 31 will appear here.

 

TWOSAME: counts of items to which both students made the same response. There was only one correct response to each item, so SAME = 10 (1-1) correct answers + 2 (out of 8 0-0) incorrect same choice of distractors = 12.

 

TWOSCORE: the count of items on which they scored the same (for a dichotomy, both correct or both incorrect). They made the SAME score on 10 (1-1) + 8 (0-0) = 18.

 

ONEHIGH: one or both persons scored in the highest category, "1", in 10+8+5 = 23 items. The "highest" category is the highest score possible on each item, for dichotomies usually scored 1. For Likert rating scales, the high category is usually scored 5.

 

TWOHIGH: 10 pairs of responses are in the highest category (1-1).

 

ONELOW: one or both persons score in the lowest category, "0", in 8+5+8 = 21 items. The "lowest" category is the lowest score possible on each item, for dichotomies usually scored 0. For Likert rating scales, the low category is usually scored 1.

 

TWOLOW: 8 pairs of responses are in the lowest category (0-0).

 

ONEMISS: there are 60 questions, the both responded to 31, so one or other or both students had missing data on ONEMISS = 60 - 31 = 29 items.

 

TWOMISS: items 51-60 were missing for both students. TWOMISS = 10.

 

Example 2: In the Excel AGREEFILE= output, the students are listed pairwise. To identify persons in Table 35.1.4, please compute two more columns: the average of the two measures (x-axis) and the TWOLOW/ONELOW value (y-axis). Plot y-axis against x-axis. Then put your mouse arrow on the plotted point of interest, and Excel will tell you where to find that point in the Excel worksheet.