The majority of teachers and principals in Pennsylvania hate standardized tests.
An increasing number of parents are refusing to allow their kids to take the tests.
And there may be better alternatives to the state’s Keystone Exams.
These were just some of the key findings of a blockbuster report from June 2019 by the state General Assembly’s Legislative Budget and Finance Committee.
However, now that things are returning to some semblance of normalcy, it seems that bureaucrats from the state Department of Education (PDE) are taking the wrong lessons from the report while the legislature seems to have forgotten it entirely.
The report was conducted because of legislation written by state Sen. Ryan P. Aument (R-Lancaster County). It directed the Legislative Budget and Finance Committee to “study the effectiveness of standardized testing, including the Keystone Exams and SATs, and their use as indicators of student academic achievement, school building performance, and educator effectiveness.”
The key findings are as follows:
1)The majority of principals and teachers disapprove of the state’s standardized tests – both the Pennsylvania System of School Assessment (PSSA) tests given in grades 3-8 and Keystone Exams given in high school. They think these tests are ineffective, expensive and harmful to district curriculum and students.
2) State law allows parents to opt their children out of testing for one reason only – religious grounds. Parents are using this religious exemption in increasing numbers. This puts districts in danger of violating federal participation and accountability standards.
3) It has been suggested that the state allow two additional reasons for parents to opt their children out of testing – philosophical grounds and health concerns. It is unclear whether doing so would increase overall opt outs or not.
4) The federal Every Student Succeeds Act (ESSA) passed in 2015 allows the use of the SAT and/or ACT test to take the place of high school standardized testing. It has been suggested the Commonwealth replace the Keystone Exams with these tests. The report finds the ACT and/or SAT would successfully determine college readiness and reduce the overall amount of standardized testing. However, this would not allow other uses of current state tests like evaluating teacher effectiveness and school building performance.This may not matter though because the report also casts doubt on whether the current tests (PSSA and Keystone Exams) do an adequate job of assessing teacher or building performance now or even if student tests can be accurately used to evaluate teachers and schools.
There’s a lot of information here. Let’s look at each finding in turn.
1) PA Educators Hate Standardized Tests
When it comes to the PSSAs, 67% of principals and 76% of teachers said the tests were ineffective indicators of student achievement.
There was slightly more support for the Keystone Exams. This time 45% of principals said the test was an ineffective indicator of student achievement (with 27% saying the tests were effective). Meanwhile, 60% of teachers said the test was ineffective.
Both principals and teachers said their curriculum had been narrowed to prepare students for PSSAs and Keystone Exams. Instead of going into more depth on regular classwork or learning new skills, the focus shifts to teaching to the tests.
Most principals (approximately 80-90%) said that students are taught test-taking skills, and their schools administered practice tests, bench-mark tests, and/or diagnostic tests to prepare students for the PSSA exams. This held for teachers, too, with 81-88% saying they teach test-taking skills and administer practice tests. Principals also said the costs of this additional test prep varied from $200 to more than $100,000.
Taking the tests also eats up valuable class time. Administering the assessments takes between 5.7 to 8 days for each kind of test – the PSSA and the Keystone Exams, according to Principals.
In addition, the report details the cost of giving these tests. In fiscal year 2017-2018, PDE paid $42.17 million for these tests. This is part of a national trend:
“Standardized tests and test preparation have subsequently become big business and that multibillion dollar business continued to grow since the enactment of NCLB and the subsequent enactment of ESSA. According to the Pew Center on the States, annual state spending on standardized tests increased from $423 million before the NCLB (enacted in 2002) to upwards of $1.1 billion in 2008 (to put this in perspective this reflects a 160 percent increase compared to a 19.22 percent increase in inflation during the same time period). A more recent study by the Brown Center on Education Policy at Brooking put the cost at upwards of $1.7 billion in 2011 related to state spending on standardized tests.”
2) Opt Outs on the Rise
Many states allow parents to opt their children out of standardized testing. Some do so in cases of a physical disability, medical reasons, or emergencies. A few allow opt-outs based on religious objection – like Pennsylvania. Some states allow opt-outs for any reason whatsoever.
The religious exemption is not used widespread throughout the state and most schools meet the 95% participation rate required by the federal government. However, use of the religious exemption is definitely on the rise – enough so that the authors of the report find it alarming:
“Meanwhile, as previously indicated in this section, schools throughout the country are experiencing and grappling with an increase in the number of parents seeking to have their children opt-out of standardized testing now that new state assessments have been implemented pursuant to the federal requirements. Pennsylvania is no exception to this trend and is also experiencing an increase in the number of parents utilizing the religious opt-out.”
For the PSSA tests, opt outs increased from 2013-14 to 2016-17. However, total numbers in school year 2017-18 decreased sightly.
Opt outs went from 1,886 to 6,425 to 15,644 to 19,012 to 16,961.
During the same time period for the Keystone Exams, opt outs steadily increased each year but were at lower overall rates.
For the high school test, opt outs went from 382 to 666 to 1,000 to 1,313 to 1,633.
These are vitally important figures because opt out data is rarely tabulated and released to the public. Many media accounts actually state the opposite of the data in this report – in particular that opting out has decreased since Congress passed the ESSA in 2015. Apparently the media got this one wrong.
Though the religious opt-out is the only reason specifically allowed in state Chapter 4 regulations, PDE reports there are five additional ways that students end up not taking the tests:
1) Other Parental Request – parents simply refusing to let their kids participate but not objecting based on specifically religious reasons.
2) No Attempt and No Exclusion Marked – students who are given the test but do not answer enough questions to receive a score.
3) No Test – no test record on file for unknown reasons.
4) Extended Absence – a student missed the testing and make-up window due to absences.
5) Other – does not fit any of the other categories.
Federal law – in particular No Child Left Behind (NCLB) and subsequent reauthorizations of that legislation – requires states to use student participation in standardized testing as a factor in a state’s accountability system. According to the report, any district with less than 95% of students taking the test should be “addressed.”
The report does not go into any further detail about what this means, other than to say that falling under 95% can:
“…ultimately result in a reduced achievement/proficiency measure… If the student participation rate falls below 95 percent, states are required to calculate student achievement/proficiency by dividing the number of students scoring proficiently by no less than 95 percent of the total students (which effectively assigns a score of “0” to all nonparticipants once the participation rate has fallen below 95 percent).”
In effect, the district gets a bad mark on a piece of paper. So what?
Under NCLB, schools with poor performance could receive sanctions like state takeover or lower funding. However, this is extremely unlikely – especially since the passing of ESSA. This newest reauthorization of the law gives states leeway in designing their accountability systems. It leaves the enforcement of this 95% participation rate up to the states, requiring them to develop an accountability plan in the event that a school or district fails to meet this standard.
So a school would only be punished if the state decided to do so. If a state legislature decided to allow parents to opt their children out for any reason at all, they would not have to take any punitive measures. Since the ESSA, the buck stops at the state house door on this one. California, for example, takes note of low participation rates but these rates are not factored into a school’s rating. On the other hand, Florida mandates direct intervention from the state’s Department of Education until participation rates are met.
3) Impact of New Reasons to Opt Out
This is where things get a bit sticky.
The report mentions the idea of expanding the options for opting-out of statewide assessments (e.g., PSSA and Keystone Exams) to include objections based on philosophical grounds or due to health issues.
On the one hand, the authors write “The impact of adding opt-out categories may be minimal.” They don’t know if more people would use the expanded options or if the same numbers who use the religious exemption today might simply divide themselves up among all three options.
The authors worry, however, that new pathways to opt out may increase the total number of people refusing the tests for their children and would reduce Pennsylvania’s participation rate in standardized testing.
This is a particularly troubling paragraph:
“The existence of opt-outs (religious or otherwise) has the potential to negatively impact a state’s participation rates and may potentially impact a state’s [Local Education Agency (LEAs)] and schools achievement/proficiency rate and ultimately the ability of a state to be in compliance with federally required assessments and accountability measures. Furthermore, providing opt-outs and giving parents notice of such has the potential to conflict with the message about the importance of standardized testing. Ultimately placing the state departments of education and local school districts in the potentially awkward position of having to explain why it is important for students to participate in testing (given the federal requirements), while also giving and notifying parents of the opt-out options for their children. In 2015, US Department of Education sent out letters to a dozen states flagging their low participation rates (statewide, or at the district or subgroup level) on the 2014-15 school year assessments and indicated that they needed to create a plan to reduce opt-outs due to low participation rates.”
This seems to be the order of the day at PDE. It’s why earlier this year, school administrators were advised by state officials to crack down on parents opting their children out of standardized tests.
And all of it is based on a cowardly and incomplete understanding of federal law. If Commonwealth schools fall below 95% participation in the test and get a bad mark on a worthless metric, it doest have to matter. No matter how many letters the federal government sends to the state legislature or PDE, the law is clear. The state is in charge here. Our legislature can choose to side with taxpayers, residents, and citizens or with civil servants and strongly worded letters.
4) Replacing the Keystone Exams
There’s not much more to add to this than the initial finding.
The authors of the report say there would be no problem with replacing the Keystone Exams with the ACT or SAT because these national tests would properly assess students’ college and career readiness.
The report is actually pretty shoddy in this regard not really examining the claims of the College Board which makes both tests. The authors just pretty much accepted the College Board’s word wholesale. Nor was their any evaluation of what teachers and principals thought about these tests like there had been for the PSSA and Keystone Exams.
However, the report does make a good point about test reduction. Many students already take the SAT or ACT test, so eliminating the Keystones would reduce the over all amount of tests they had to take.
Also the authors deserve credit for writing about how using student test scores to evaluate teachers and schools is seriously bad practice.
According to the report, 77 percent of principals and 93 percent of teachers said PSSA tests were not effective indicators for teacher evaluations, with similar figures for the Keystone Exams and building performance evaluations.
While everything in the report may not be 100% accurate, it includes important information that should be wider known.
In addition, the report has trustworthy data about opt outs throughout the Commonwealth. Unlike what has been reported in the media, opting out is not on the decline, it is on the rise.
The Keystone Exams should be thrown in the trash, because that’s what they are – trash. At very least they should be replaced with the SAT or ACT. Even better to remove any requirement for standardized tests wholesale – and that includes the PSSA.
The ESSA allows states a lot of leeway about how and what accountability system they use. There is no need to worry about some imperial federal power invading Pennsylvania to force our hand with standardized testing. We should call their bluff on this. I’ll bet that if we did so, many other states would do the same.
Standardized testing is another failed education policy. Our legislators would do good to read this report and make up their own minds about it.
Though a few years and disasters have happened since its publication, it doesn’t deserve to be forgotten by the very people who ordered it to be written in the first place.
Like this post? You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.
The Covid-19 pandemic closed school rooms across the nation for various lengths of time. Some are still closed. Some are beginning to close again.
Many classes were conducted remotely through conferencing software like Zoom and file sharing programs like Google Classroom. Others were conducted through a hybrid model combining in-person instruction and cyber instruction. While still others met in-person with numerous mitigation efforts like masks, social distancing and air purifiers.
Many students were absent, struggled to learn and experienced countless traumas due to the isolation, sickness and deaths.
That’s more than Americans who died in the attack on Pear Harbor (2,403), the 9/11 terrorists attacks (3,000), WWI (116,000) or WWII (405,000).
Only the Civil War (600,000 – 850,000) has a larger death toll. For now.
As of April 1, nearly 3.47 million children have tested positive for COVID-19, most with mild symptoms, according to the American Academy of Pediatrics. A few hundred have died, mostly children of color. Many more kids probably contracted the virus but were asymptomatic spreaders of the disease to adults.
As a result, between 37,000 and 43,000 children in the United States have lost at least one parent to COVID-19, according to USC research.
How do you sort through all these tragedies and traumas and say THIS was caused by a lack of standardized testing?
But in 2001 we created an industry. Huge corporations write the tests, grade the tests and provide the remediation for the tests. Billions of dollars in taxes are funneled into this captive market which creates monetary incentives for our lawmakers to keep the system going.
Yes, some civil rights organizations have waffled back and forth over this as big donors who value the tests make or withhold contributions. Meanwhile, many other more grassroots civil rights organizations such as Journey for Justice Alliance (JJA), a group made up of 38 organizations of Black and Brown parents and students in 23 states, have continuously called for the abolition of high stakes testing.
A scientific mind would be empirical about this. It would examine the results as much as possible and determine whether moving forward made any sense.
This is especially true as the pandemic health crisis continues to make the act of giving the tests difficult at best and dangerous at worst.
There is no way a logical mind can look at the situation and not come to the conclusion that the status quo on testing is a triumph of capitalism over science and reason.
In a month or so, the year without testing will be just that – a single year.
We shall go on to the end. We shall test during Covid, we shall test in the classes and on-line, we shall test with growing confidence and growing strength wearing masks, we shall defend our industry, whatever the cost may be. We shall test in the homes, we shall fill in bubbles on sanitized desks, we shall test in the fields and in the streets, we shall test in the hospitals; we shall never surrender!
Do you live in Allegheny County, Pennsylvania? I’m running for County Council in District 9
Like this post? You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.
The federal government still requires all states to give high stakes tests to public school students in grades 3-8 and once in high school. So states require their districts to give the tests – despite increasing criticism over the assessments’ validity, age appropriateness, racial and economic bias and the very manner in which the scores are used to justify narrowing the curriculum, school privatization, funding cuts, teacher firings and closing buildings serving the most underprivileged children.
Most administrators don’t actually go so far as out right refusal of a parent’s demand to opt out their children.
That’s especially true in states where the right to opt out is codified in the law.
Three states – California, Utah, and Wisconsin – have enacted legislation permitting parents to opt their children out of standardized tests. However, at least five others, including my home of Pennsylvania, have laws respecting parents’ opt-out wishes for certain reasons. In others states there may not be specific legislation permitting it, but none have laws forbidding it either. At worst, test refusal is an act of civil disobedience like tearing down a confederate monument or freedom rides.
In Pennsylvania, the school code specifies that parents can refuse the test for their children for “religious reasons.” Those reasons and the religion in question never need be named. Citing “religious reasons” is rationale enough.
(4) …If upon inspection of a State assessment parents or guardians find the assessment to be in conflict with their religious belief and wish their students to be excused from the assessment, the right of the parents or guardians will not be denied upon written request that states the objection to the applicable school district superintendent, charter school chief executive officer or AVTS director.”
So when a parent provides just such an objection, it’s there in black and white that administrators must comply with that request.
However, some administrators are trying to game the system. When the other students are taking the state standardized test, the opt out students are rounded up and forced instead to take a district created assessment that just so happens to look almost exactly like the test their parents explicitly asked they not be subjected to.
So in my state, some parents have opted their children out of the Pennsylvania System of School Assessment (PSSA) or Keystone Exams, but administrators are requiring them instead to take an assessment they cobbled together themselves that closely resembles the PSSA and/or Keystone Exam.
They take a little bit from the PSSA, a bit from the Partnership for Assessment of Reading Readiness for College and Careers (PARRC) test, a question or two from the Scholastic Assessment Test (SAT) and voila! A brand new Frankenstein’s monster of standardized assessment.
Does that violate the law? Parents did not want their children to be assessed with a standardized test, and that’s exactly what the school did anyway. The only difference is the name of the standardized test they used.
I am not a lawyer, but I’ve contacted several. The answer I’ve gotten is that this may not be technically illegal, but it does at least violate the spirit of the law.
Districts are given a certain latitude to determine their own curriculum and assessments. This kind of runaround is ugly, petty and possibly just on the line of legality.
But our administrators are not done. Not only are they requiring such students to take a cobbled together standardized assessment, when children are done, they are forced to do hours of test prep for the state assessment that their parents refused for them.
Imagine opting out of the PSSA and then being forced to spend that time preparing for that very test. Imagine refusing to allow your children to take the Keystone Exam but then having them forced to prepare for it instead.
Petty, small-minded, punitive and – in this case – possibly illegal.
“(d) School entities shall adopt policies to assure that parents or guardians have the following:
(3) …The right to have their children excused from specific instruction that conflicts with their religious beliefs, upon receipt by the school entity of a written request from the parent or guardians.”
Again, I am not a lawyer, but it seems pretty clear that this, at least, is a violation of the law.
They can request their children not be given specific instruction – in this case test prep. Yet that’s exactly what administrators are doing anyway.
So what are opt out parents to do? Should they lawyer up?
Possibly. Though no one likes to have to take their own school to court. Any monetary damages thus recovered come from the collective pot that should go to help all students learn. It’s unfortunate that some administrators play so freely with taxpayer dollars when it would be a simple matter to safeguard them AND respect parental rights.
We’re not some charter school where school directors are appointed to their positions, hold their meetings in private and rarely if ever have to account for their decisions.
It’s shocking that in an age when public schools are often set against privatized ones that we’d allow such foolishness.
Opting out of testing is one way to deny this data to the state so that they can’t use it against the school.
Certainly having high numbers of students opting out can, itself, become an excuse for punitive action from the state. But nowhere in the country has it ever actually happened.
State legislatures, too, are run by majority rule. The same with the federal government.
Our lawmakers have no authority to tell voters they can’t opt their children out of testing. It is the voters who are the boss.
gadflyonthewallblog 