Test Form Statistics Report (Annotated Report Sample)

TEST FORM STATISTICS REPORT (Annotated Report Sample)
Test FieldForm Number of Tests Taken Total Test Scaled Score Indices Multiple-Choice Section Open Response Section Pearson Corr. of MC & OR Section Scores
Mean SEM Decision Consistency Stratified Alpha G Coefficient
Fixed Random Length Keats' SEM Computed SEM KR20 I Fixed I Random
01 TestName01A2272537.40.930.920.90854.33.90.890.890.610.66
B 2212547.30.910.920.89854.33.80.870.890.630.63
  • Test Field. The test field code and name.
    • Form (A, B, C, etc.). For each test field, a letter code designates the different test forms—each comprising a different set of scorable multiple-choice items—that were administered during the reporting period. Test forms are considered to be identical if they contain identical sets of scorable multiple-choice items, regardless of the order of the items.
  • Number of Tests Taken. The number of tests taken during the reporting period, including those tests retaken by the same candidate.
  • Total Test Scaled Score Indices
    • Mean. The mean of the total test scaled scores achieved by the candidates taking the test form, reported for each test form taken by 10 or more candidates.
    • SEM. The standard error of measurement of the total test scaled scores (Brennan 2001), reported for each test form with at least 100 attempts.
    • Decision Consistency. The total test decision consistency index of the total test scaled score (Breyer and Lewis 1994), reported for each test form with at least 100 attempts.
    • Stratified Alpha (Fixed and Random). Stratified coefficient alpha (with items as a fixed facet and with items as a random facet), reported for each test form with at least 100 attempts.

    Multiple-Choice Section

    • Length. The number of scorable items in the multiple-choice section.
    • Keats' SEM (Keats 1957). The estimated standard error of measurement of the multiple-choice section (on the raw score metric), reported for each test form with at least 100 attempts.
    • Computed SEM. The computed standard error of measurement for the multiple-choice section (on the raw score metric), reported for each test form with at least 100 attempts
    • KR20. The Kuder-Richardson index of item homogeneity.
  • G Coefficient (I Fixed and I Random). The Generalizability coefficient (with I fixed and I random) (reported for each test form with at least 100 attempts).

    Pearson Corr. of MC and OR Section Scores. Pearson Correlation of Multiple-Choice and Open-Response Section Scores, reported for each test form with at least 100 attempts.