Message: FW: EOC "Slowdown" Report

FW: EOC "Slowdown" Report
FW: EOC "Slowdown" Report

From | Strand, Jocelyn | Date Tuesday, June 13, 2017 7:19 AM

To | Neale, Chris
Cc |
Subject | FW: EOC "Slowdown" Report

asmt-tac-eoc-network-slowdown.pdf (77 Kb )

FYI

From: Sireno, Lisa
Sent: Friday, June 09, 2017 2:13 PM
To: Strand, Jocelyn; Duncan, Janet
Subject: EOC "Slowdown" Report

FYI

Lisa Sireno | Standards and Assessment Administrator | Office of College and Career Readiness

Missouri Department of Elementary and Secondary Education | 573-751-3545 | dese.mo.gov

    MO EOC Spring 2017 Online Testing Network Slowdown
    Presented to DESE | May 31, 2017
    1. Introduction  This document presents descriptive analyses conducted to investigate the network  slowdown due to the high volume of Missouri End-of-Course (MO EOC) test takers on  Tuesday, April 25, 2017.
    Although the system was never down, slower-than-normal response times were  reported. Some students experienced delays logging into the system, and others  experienced delays submitting their completed test. The network slowdown did not  affect students progressing from one item to the next because the test is downloaded in  its entirety when students log on. The purpose of these analyses is to investigate  whether the students who experienced the network slowdown may have been  disadvantaged compared to those who did not experience the network slowdown.
    2. MO EOC Assessment Overview  For accountability purposes, districts are required to administer the MO EOC English II,  Algebra I, Biology, and Government Assessments to all students prior to graduation. For  students who completed the Algebra I assessment before high school, Algebra II is the  required high school Mathematics assessment.
    The MO EOC Assessments are intact pre-equated forms. Two or more forms are  rotated across administrations for all content areas except English I, Geometry, and  Physical Science that only have one form. Table 2.1 presents the forms used for the  Spring 2015, 2016, and 2017 administrations to facilitate interpretation of the data.
    Table 2.1. MO EOC Spring Forms
    Content Area 2015 2016 2017
    English II 2014H 2014G 2014H  Algebra I H G H
    Biology A C A
    English I 7 7 7
    Algebra II 8 7 8
    Geometry 7 7 7
    Government 5 1 5
    American History 3 1 3
    Physical Science 1 1 1
    3. Results  Table 3.1 shows the number and percent of students at each performance level for the  Spring 2015, 2016, and 2017 administrations of the MO EOC Assessments. The table  also shows the number and percent of students experiencing the network slowdown for
    Page 1 of 5

    MO EOC Spring 2017 Online Testing Network Slowdown
    Spring 2017, as well as the percent difference for each administration and the students  experiencing the network slowdown.
    A consistent pattern of performance was not observed for the students who experienced  network slowdown across content areas. Rather, various patterns were evident. Looking  at the percent of students in the Proficient and Advanced performance level (Proficient +  Advanced), there was a higher percent of network-slowdown students compared to the  Spring 2017 population for Algebra I, Biology, and Geometry. However, there was a  lower percent of network-slowdown students in the Proficient + Advanced performance  level compared to the Spring 2015, 2016, and 2017 populations for English II, English I,  Government, and Physical Science. The reverse was true for American History. Algebra  II had a lower percent of students in the Proficient + Advanced performance level for  Spring 2016 and Spring 2017 and a higher percent of students for Spring 2015.
    Page 2 of 5

    MO EOC Spring 2017 Online Testing Network Slowdown
    Table 3.1. Achievement Level Distribution by Administration and Students Experiencing System Slowdown
    Content  Area
    Achievement Level
    Spring 2015 Spring 2016 Spring 2017
    Spring 2017  Slowdown
    % Difference  (Admin - Slowdown)
    Freq. % Freq. % Freq. % Freq. %
    Spring  2015  Spring  2016
    Spring  2017
    English II
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    3,126 5.0
    12,769 20.5
    34,970 56.1
    11,439 18.4
    15,895 25.5
    46,409 74.5
    2,027 3.2
    10,074 16.0
    39,538 63.0
    11,150 17.8
    12,101 19.2
    50,688 80.8
    3,531 5.7
    14,067 22.9
    34,109 55.5
    9,768 15.9
    17,598 28.6
    43,877 71.4
    233 5.7
    1,024 25.0
    2,246 54.9
    589 14.4
    1,257 30.7
    2,835 69.3
    -0.7 -2.5 0.0
    -4.5 -9.0 -2.1
    1.2 8.1 0.6
    4.0 3.4 1.5
    -5.2 -11.5 -2.1
    5.2 11.5 2.1
    Total 62,304 100.0 62,789 100.0 61,475 100.0 4,092 100.0 -- -- --
    Algebra I
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    11,373 18.1
    11,947 19.0
    27,426 43.7
    11,992 19.1
    23,320 37.2
    39,418 62.8
    7,938 13.0
    11,949 19.6
    29,691 48.7
    11,393 18.7
    19,887 32.6
    41,084 67.4
    12,038 20.2
    11,434 19.2
    24,774 41.5
    11,451 19.2
    23,472 39.3
    36,225 60.7
    538 17.5
    575 18.7
    1,402 45.7
    555 18.1
    1,113 36.3
    1,957 63.7
    0.6 -4.5 2.6
    0.3 0.9 0.4
    -2.0 3.0 -4.2
    1.0 0.6 1.1
    0.9 -3.7 3.1
    -0.9 3.7 -3.1
    Total 62,738 100.0 60,971 100.0 59,697 100.0 3,070 100.0 -- -- --
    Biology
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    1,878 3.0
    13,217 21.1
    31,465 50.3
    16,015 25.6
    15,095 24.1
    47,480 75.9
    3,537 5.8
    16,282 26.5
    28,634 46.6
    13,033 21.2
    19,819 32.3
    41,667 67.8
    3,809 6.2
    17,014 27.7
    27,729 45.1
    12,972 21.1
    20,823 33.8
    40,701 66.2
    247 5.8
    1,157 27.3
    1,913 45.1
    927 21.8
    1,404 33.1
    2,840 66.9
    -2.8 0.0 0.4
    -6.1 -0.8 0.4
    5.2 1.5 0.0
    3.8 -0.6 -0.8
    -9.0 -0.8 0.8
    9.0 0.9 -0.8
    Total 62,575 100.0 61,486 100.0 61,524 100.0 4,244 100.0 -- -- --
    Page 3 of 5

    MO EOC Spring 2017 Online Testing Network Slowdown
    Content  Area
    Achievement Level
    Spring 2015 Spring 2016 Spring 2017
    Spring 2017  Slowdown
    % Difference  (Admin - Slowdown)
    Freq. % Freq. % Freq. % Freq. %
    Spring  2015  Spring  2016
    Spring  2017
    English I
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    1,113 6.2
    4,774 26.6
    10,075 56.2
    1,952 10.9
    5,887 32.9
    12,027 67.1
    1,006 6.3
    4,343 27.4
    8,889 56.0
    1,627 10.3
    5,349 33.7
    10,516 66.3
    931 7.2
    3,844 29.9
    6,879 53.4
    1,223 9.5
    4,775 37.1
    8,102 62.9
    65 8.5
    252 33.1
    384 50.4
    61 8.0
    317 41.6
    445 58.4
    -2.3 -2.2 -1.3
    -6.4 -5.7 -3.2
    5.8 5.6 3.0
    2.9 2.3 1.5
    -8.7 -7.9 -4.5
    8.7 7.9 4.5
    Total 17,914 100.0 15,865 100.0 12,877 100.0 762 100.0 -- -- --
    Algebra II
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    3,022 14.5
    4,031 19.3
    7,896 37.8
    5,936 28.4
    7,053 33.8
    13,832 66.2
    2,499 12.6
    3,434 17.4
    7,988 40.4
    5,870 29.7
    5,933 30.0
    13,858 70.0
    2,199 12.0
    2,964 16.1
    6,760 36.8
    6,452 35.1
    5,163 28.1
    13,212 71.9
    67 20.1
    40 12.0
    116 34.8
    110 33.0
    107 32.1
    226 67.9
    -5.7 -7.5 -8.2
    7.3 5.3 4.1
    3.0 5.5 2.0
    -4.6 -3.4 2.1
    1.6 -2.1 -4.0
    -1.6 2.1 4.0
    Total 20,885 100.0 19,791 100.0 18,375 100.0 333 100.0 -- -- --
    Geometry
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    2,147 19.1
    2,059 18.3
    5,189 46.1
    1,861 16.5
    4,206 37.4
    7,050 62.6
    1,780 20.5
    1,633 18.8
    3,695 42.5
    1,585 18.2
    3,413 39.3
    5,280 60.7
    1,593 22.7
    1,344 19.2
    2,972 42.4
    1,100 15.7
    2,937 41.9
    4,072 58.1
    47 21.0
    40 17.9
    95 42.4
    42 18.8
    87 38.8
    137 61.2
    -1.9 -0.5 1.7
    0.4 0.9 1.3
    3.7 0.1 0.0
    -2.2 -0.5 -3.1
    -1.5 0.5 3.1
    1.5 -0.5 -3.1
    Total 11,256 100.0 8,693 100.0 7,009 100.0 224 100.0 -- -- --
    Page 4 of 5

    MO EOC Spring 2017 Online Testing Network Slowdown
    Content  Area
    Achievement Level
    Spring 2015 Spring 2016 Spring 2017
    Spring 2017  Slowdown
    % Difference  (Admin - Slowdown)
    Freq. % Freq. % Freq. % Freq. %
    Spring  2015  Spring  2016
    Spring  2017
    Government
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    3,183 7.0
    12,884 28.2
    20,965 45.9
    8,669 19.0
    16,067 35.2
    29,634 64.8
    4,042 9.1
    11,516 25.9
    18,344 41.2
    10,578 23.8
    15,558 35.0
    28,922 65.0
    3,346 7.4
    12,528 27.6
    20,111 44.3
    9,393 20.7
    15,874 35.0
    29,504 65.0
    186 10.5
    554 31.4
    696 39.4
    331 18.7
    740 41.9
    1,027 58.1
    -3.6 -1.4 -3.2
    -3.2 -5.5 -3.7
    6.5 1.9 4.9
    0.2 5.0 2.0
    -6.7 -6.9 -6.9
    6.7 6.9 6.9
    Total 45,701 100.0 44,480 100.0 45,378 100.0 1,767 100.0 -- -- --
    American  History
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    2,832 25.0
    2,847 25.2
    3,406 30.1
    2,224 19.7
    5,679 50.2
    5,630 49.8
    2,201 24.0
    2,469 27.0
    2,966 32.4
    1,519 16.6
    4,670 51.0
    4,485 49.0
    1,663 25.5
    1,595 24.5
    1,945 29.9
    1,310 20.1
    3,258 50.0
    3,255 50.0
    12 21.4
    13 23.2
    18 32.1
    13 23.2
    25 44.6
    31 55.4
    3.6 2.6 4.1
    2.0 3.8 1.3
    -2.0 0.3 -2.3
    -3.5 -6.6 -3.1
    5.6 6.4 5.4
    -5.6 -6.4 -5.4
    Total 11,309 100.0 9,155 100.0 6,513 100.0 56 100.0 -- -- --
    Physical  Science
    Below Basic
    Basic
    Proficient
    Advanced
    Below Basic + Basic
    Proficient + Advanced
    344 5.5
    4,175 67.2
    1,443 23.2
    250 4.0
    4,519 72.7
    1,693 27.3
    299 6.3
    3,103 65.6
    1,106 23.4
    220 4.7
    3,402 72.0
    1,326 28.0
    180 6.1
    1,914 64.9
    711 24.1
    143 4.9
    2,094 71.0
    854 29.0
    7 10.9
    43 67.2
    11 17.2
    3 4.7
    50 78.1
    14 21.9
    -5.4 -4.6 -4.8
    0.0 -1.6 -2.3
    6.0 6.2 6.9
    -0.7 0.0 0.2
    -5.4 -6.1 -7.1
    5.4 6.1 7.1
    Total 6,212 100.0 4,728 100.0 2,948 100.0 64 100.0 -- -- --
    Page 5 of 5