SAGE Validity Test Discourages Use of Student Test Scores
By Brian Halladay and Wendy Hart
Board Members, Alpine School District
Florida has done what Utah has been afraid to do. They have performed a validity test on the SAGE test administered by the American Institutes for Research (AIR) on the assessments of grades 3-10 ELA, grades 3-8 math, Algebra 1, Algebra 2, and Geometry.
The validity test, performed by Alpine Testing and EdCount, was performed to test whether or not the test scores were valid for a specific use. In other words, does the test work or not?
Once the validity test was completed, Alpine Testing and Edcounts reported their findings to the Florida Senate K-12 Committee on September 17, 2015. The full video can be seen here.
https://youtu.be/7c8HY5bft9s
What significance does this have for Utah? As can be seen from the video (and in their report) the field testing wasn’t performed primarily on Florida’s test. They used Utah’s test (thank you, Florida, for paying for Utah’s validity test.)
What Alpine Testing said in their comments to Florida is astounding. I have outlined some key points from the video:
At 44:50- Many items found in the test didn’t align with the standard that was being tested.
At 47:70: Test scores should only be used at an aggregate level.
At 48:15 – They recommend AGAINST using test scores for individual student decisions.
At 1:01:00 – They admit that “test scores should not be used as a sole determinant in decisions such as the prevention of advancement to the next grade, graduation eligibility, or placement in a remedial course.”
At 1:20:00 – “There is data than can be looked at that shows that the use of these test scores would not be appropriate”
Alpine Testing was the only company that applied to perform the validity study for Florida. Once awarded the contract, they teamed with EdCount, the founder of which had previously worked for AIR.
So, what we have is a questionably independent group stating that this test should not be used for individual students, but it’s ok for the aggregate data to be used for schools and teacher evaluations. If this sounds absurd, it’s because it is. If it’s been shown that this test isn’t good for students, why would we be comfortable using it for the grading or funding of our schools and teachers? The sum of individual bad data can’t give us good data. Nor should we expect it to.
What more evidence is needed by our State Board, Legislature or Governor to determine that our students shouldn’t be taking the SAGE test? This test is a failure. How much longer will our children and our state (and numerous other states) spend countless time and resources in support of a failed test, or teaching to a failed test?
Utah deserves more. Our children deserve more than to waste their time with this nonsense. Opt your children out of this test, write your State School Board, Legislators and Governor and let’s put our focus on what works best for the education of our children.
****************
This post continues with:
https://www.utahnsagainstcommoncore.com/sage-validity-part-2-dr-thompson-responds/
Let us not forget that SAGE is also being used in TN and AZ. AIR signed a lease agreement with Utah to lease these assessments for FL, TN and AZ. I have verified that the new assessments in TN have not been tested for validity or reliability. I was told that will be done AFTER the students take the test in the spring. WHAT? That is using our kids at test lab rats. And our children’s future, teachers future and the future of the schools are dependent on garbage data. But what we must also not forget. The data from these tests has nothing to do with achievement and everything to do with measuring the attitudes, beliefs, values, perseverance, grit and tenacity so they can use that data to change all of the above to fit their objective.
Don’t do it Utah!
It sucks I do it and I’m in utah
Try to wrap your head around this idea … SAGE tests on … wait for it … math … language … and science. GASP! And the weirdest part is that I teach the kids fractions during the year and they get tested on … fractions. GASP! And even crazier — I teach them about moon phases and they get tested on … moon phases. GASP!
You guys crack me up with your fear tactics. And to your talking points — every teacher knows you don’t use one test as your sole data source. It is just one indicator that you combine with other indicators to make an assessment of a child’s progress.
Get over yourselves. It’s just a test.
It’s not just a test. It’s a data collection tool and a behavioral assessment. It’s also an invalid instrument so says an independent evaluation.
Everything is a data collection tool. I don’t see you out demanding we all stop using credit cards because they are collecting our financial information and shopping habits.
It is not an invalid instrument. The independent evaluation cited says you shouldn’t use it for specific purposes … purposes we wouldn’t use it for anyway. It is simply an indicator … and that is how it is used in Utah schools.
The Obama administration has specifically relaxed FERPA laws to enable sharing of children’s personally identifiable information. Data collection on minors and sharing of that data with 3rd parties without parental knowledge and consent has been intentionally compromised. Behavioral data in a massive statewide longitudinal database the feds paid for creates massive opportunities for exploitation and no database is secure from hackers. If you want to protect children’s data, they shouldn’t be taking SAGE.
Right … because the same hackers couldn’t just hack the school district and get the information there.
What personal or behavioral information are you afraid of hackers getting? How they answer questions about the seasons? Their first and last name? It’s not like they are taking an FBI personality profile assessment before each test.
By the way, did you gloss over that first comment on the video where the testing company notes that many items found in the test didn’t align with the standard that was being tested? That seems problematic. :)
It is being used for those things… As part of the assessment to grade teachers and schools.
My teacher grade comes from a combination of many sources, and SAGE is NOT at the top of the priority list. My assessment typically comes from growth that my students have shown over the year and is measured by formative and summative assessments given in class.
It is much more attractive to hackers to go after one large database of information, but that is not the chief concern for me. My concern is a data profile, especially an invalid one, following my child through their education and career and affecting their opportunities. What if that credit data you refer to was incorrect and kept you from purchasing a home, a car or being trusted with a job? Finally, I did see the test as a parent reviewer and while there is some basic academic stuff in there, there was also some things that concerned me. I hope all parents will look into the education reform