Message: FW: EOC "Slowdown" Report

FW: EOC "Slowdown" Report
FromDuncan, JanetDate  Friday, June 9, 2017 2:42 PM
To
Cash, Amanda
Cc
SubjectFW: EOC "Slowdown" Report

FYI

 

From: Sireno, Lisa
Sent: Friday, June 09, 2017 2:13 PM
To: Strand, Jocelyn; Duncan, Janet
Subject: EOC "Slowdown" Report

 

FYI

 

Lisa Sireno | Standards and Assessment Administrator | Office of College and Career Readiness

Missouri Department of Elementary and Secondary Education | 573-751-3545 | dese.mo.gov

 


MO EOC Spring 2017 Online Testing Network Slowdown Presented to DESE | May 31, 2017 1. Introduction This document presents descriptive analyses conducted to investigate the network slowdown due to the high volume of Missouri End-of-Course (MO EOC) test takers on Tuesday, April 25, 2017. Although the system was never down, slower-than-normal response times were reported. Some students experienced delays logging into the system, and others experienced delays submitting their completed test. The network slowdown did not affect students progressing from one item to the next because the test is downloaded in its entirety when students log on. The purpose of these analyses is to investigate whether the students who experienced the network slowdown may have been disadvantaged compared to those who did not experience the network slowdown. 2. MO EOC Assessment Overview For accountability purposes, districts are required to administer the MO EOC English II, Algebra I, Biology, and Government Assessments to all students prior to graduation. For students who completed the Algebra I assessment before high school, Algebra II is the required high school Mathematics assessment. The MO EOC Assessments are intact pre-equated forms. Two or more forms are rotated across administrations for all content areas except English I, Geometry, and Physical Science that only have one form. Table 2.1 presents the forms used for the Spring 2015, 2016, and 2017 administrations to facilitate interpretation of the data. Table 2.1. MO EOC Spring Forms Content Area 2015 2016 2017 English II 2014H 2014G 2014H Algebra I H G H Biology A C A English I 7 7 7 Algebra II 8 7 8 Geometry 7 7 7 Government 5 1 5 American History 3 1 3 Physical Science 1 1 1 3. Results Table 3.1 shows the number and percent of students at each performance level for the Spring 2015, 2016, and 2017 administrations of the MO EOC Assessments. The table also shows the number and percent of students experiencing the network slowdown for Page 1 of 5 MO EOC Spring 2017 Online Testing Network Slowdown Spring 2017, as well as the percent difference for each administration and the students experiencing the network slowdown. A consistent pattern of performance was not observed for the students who experienced network slowdown across content areas. Rather, various patterns were evident. Looking at the percent of students in the Proficient and Advanced performance level (Proficient + Advanced), there was a higher percent of network-slowdown students compared to the Spring 2017 population for Algebra I, Biology, and Geometry. However, there was a lower percent of network-slowdown students in the Proficient + Advanced performance level compared to the Spring 2015, 2016, and 2017 populations for English II, English I, Government, and Physical Science. The reverse was true for American History. Algebra II had a lower percent of students in the Proficient + Advanced performance level for Spring 2016 and Spring 2017 and a higher percent of students for Spring 2015. Page 2 of 5 MO EOC Spring 2017 Online Testing Network Slowdown Table 3.1. Achievement Level Distribution by Administration and Students Experiencing System Slowdown Content Area Achievement Level Spring 2015 Spring 2016 Spring 2017 Spring 2017 Slowdown % Difference (Admin - Slowdown) Freq. % Freq. % Freq. % Freq. % Spring 2015 Spring 2016 Spring 2017 English II Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 3,126 5.0 12,769 20.5 34,970 56.1 11,439 18.4 15,895 25.5 46,409 74.5 2,027 3.2 10,074 16.0 39,538 63.0 11,150 17.8 12,101 19.2 50,688 80.8 3,531 5.7 14,067 22.9 34,109 55.5 9,768 15.9 17,598 28.6 43,877 71.4 233 5.7 1,024 25.0 2,246 54.9 589 14.4 1,257 30.7 2,835 69.3 -0.7 -2.5 0.0 -4.5 -9.0 -2.1 1.2 8.1 0.6 4.0 3.4 1.5 -5.2 -11.5 -2.1 5.2 11.5 2.1 Total 62,304 100.0 62,789 100.0 61,475 100.0 4,092 100.0 -- -- -- Algebra I Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 11,373 18.1 11,947 19.0 27,426 43.7 11,992 19.1 23,320 37.2 39,418 62.8 7,938 13.0 11,949 19.6 29,691 48.7 11,393 18.7 19,887 32.6 41,084 67.4 12,038 20.2 11,434 19.2 24,774 41.5 11,451 19.2 23,472 39.3 36,225 60.7 538 17.5 575 18.7 1,402 45.7 555 18.1 1,113 36.3 1,957 63.7 0.6 -4.5 2.6 0.3 0.9 0.4 -2.0 3.0 -4.2 1.0 0.6 1.1 0.9 -3.7 3.1 -0.9 3.7 -3.1 Total 62,738 100.0 60,971 100.0 59,697 100.0 3,070 100.0 -- -- -- Biology Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 1,878 3.0 13,217 21.1 31,465 50.3 16,015 25.6 15,095 24.1 47,480 75.9 3,537 5.8 16,282 26.5 28,634 46.6 13,033 21.2 19,819 32.3 41,667 67.8 3,809 6.2 17,014 27.7 27,729 45.1 12,972 21.1 20,823 33.8 40,701 66.2 247 5.8 1,157 27.3 1,913 45.1 927 21.8 1,404 33.1 2,840 66.9 -2.8 0.0 0.4 -6.1 -0.8 0.4 5.2 1.5 0.0 3.8 -0.6 -0.8 -9.0 -0.8 0.8 9.0 0.9 -0.8 Total 62,575 100.0 61,486 100.0 61,524 100.0 4,244 100.0 -- -- -- Page 3 of 5 MO EOC Spring 2017 Online Testing Network Slowdown Content Area Achievement Level Spring 2015 Spring 2016 Spring 2017 Spring 2017 Slowdown % Difference (Admin - Slowdown) Freq. % Freq. % Freq. % Freq. % Spring 2015 Spring 2016 Spring 2017 English I Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 1,113 6.2 4,774 26.6 10,075 56.2 1,952 10.9 5,887 32.9 12,027 67.1 1,006 6.3 4,343 27.4 8,889 56.0 1,627 10.3 5,349 33.7 10,516 66.3 931 7.2 3,844 29.9 6,879 53.4 1,223 9.5 4,775 37.1 8,102 62.9 65 8.5 252 33.1 384 50.4 61 8.0 317 41.6 445 58.4 -2.3 -2.2 -1.3 -6.4 -5.7 -3.2 5.8 5.6 3.0 2.9 2.3 1.5 -8.7 -7.9 -4.5 8.7 7.9 4.5 Total 17,914 100.0 15,865 100.0 12,877 100.0 762 100.0 -- -- -- Algebra II Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 3,022 14.5 4,031 19.3 7,896 37.8 5,936 28.4 7,053 33.8 13,832 66.2 2,499 12.6 3,434 17.4 7,988 40.4 5,870 29.7 5,933 30.0 13,858 70.0 2,199 12.0 2,964 16.1 6,760 36.8 6,452 35.1 5,163 28.1 13,212 71.9 67 20.1 40 12.0 116 34.8 110 33.0 107 32.1 226 67.9 -5.7 -7.5 -8.2 7.3 5.3 4.1 3.0 5.5 2.0 -4.6 -3.4 2.1 1.6 -2.1 -4.0 -1.6 2.1 4.0 Total 20,885 100.0 19,791 100.0 18,375 100.0 333 100.0 -- -- -- Geometry Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 2,147 19.1 2,059 18.3 5,189 46.1 1,861 16.5 4,206 37.4 7,050 62.6 1,780 20.5 1,633 18.8 3,695 42.5 1,585 18.2 3,413 39.3 5,280 60.7 1,593 22.7 1,344 19.2 2,972 42.4 1,100 15.7 2,937 41.9 4,072 58.1 47 21.0 40 17.9 95 42.4 42 18.8 87 38.8 137 61.2 -1.9 -0.5 1.7 0.4 0.9 1.3 3.7 0.1 0.0 -2.2 -0.5 -3.1 -1.5 0.5 3.1 1.5 -0.5 -3.1 Total 11,256 100.0 8,693 100.0 7,009 100.0 224 100.0 -- -- -- Page 4 of 5 MO EOC Spring 2017 Online Testing Network Slowdown Content Area Achievement Level Spring 2015 Spring 2016 Spring 2017 Spring 2017 Slowdown % Difference (Admin - Slowdown) Freq. % Freq. % Freq. % Freq. % Spring 2015 Spring 2016 Spring 2017 Government Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 3,183 7.0 12,884 28.2 20,965 45.9 8,669 19.0 16,067 35.2 29,634 64.8 4,042 9.1 11,516 25.9 18,344 41.2 10,578 23.8 15,558 35.0 28,922 65.0 3,346 7.4 12,528 27.6 20,111 44.3 9,393 20.7 15,874 35.0 29,504 65.0 186 10.5 554 31.4 696 39.4 331 18.7 740 41.9 1,027 58.1 -3.6 -1.4 -3.2 -3.2 -5.5 -3.7 6.5 1.9 4.9 0.2 5.0 2.0 -6.7 -6.9 -6.9 6.7 6.9 6.9 Total 45,701 100.0 44,480 100.0 45,378 100.0 1,767 100.0 -- -- -- American History Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 2,832 25.0 2,847 25.2 3,406 30.1 2,224 19.7 5,679 50.2 5,630 49.8 2,201 24.0 2,469 27.0 2,966 32.4 1,519 16.6 4,670 51.0 4,485 49.0 1,663 25.5 1,595 24.5 1,945 29.9 1,310 20.1 3,258 50.0 3,255 50.0 12 21.4 13 23.2 18 32.1 13 23.2 25 44.6 31 55.4 3.6 2.6 4.1 2.0 3.8 1.3 -2.0 0.3 -2.3 -3.5 -6.6 -3.1 5.6 6.4 5.4 -5.6 -6.4 -5.4 Total 11,309 100.0 9,155 100.0 6,513 100.0 56 100.0 -- -- -- Physical Science Below Basic Basic Proficient Advanced Below Basic + Basic Proficient + Advanced 344 5.5 4,175 67.2 1,443 23.2 250 4.0 4,519 72.7 1,693 27.3 299 6.3 3,103 65.6 1,106 23.4 220 4.7 3,402 72.0 1,326 28.0 180 6.1 1,914 64.9 711 24.1 143 4.9 2,094 71.0 854 29.0 7 10.9 43 67.2 11 17.2 3 4.7 50 78.1 14 21.9 -5.4 -4.6 -4.8 0.0 -1.6 -2.3 6.0 6.2 6.9 -0.7 0.0 0.2 -5.4 -6.1 -7.1 5.4 6.1 7.1 Total 6,212 100.0 4,728 100.0 2,948 100.0 64 100.0 -- -- -- Page 5 of 5