The majority of teachers and principals in Pennsylvania hate standardized tests.
An increasing number of parents are refusing to allow their kids to take the tests.
And there may be better alternatives to the state’s Keystone Exams.
These were just some of the key findings of a blockbuster report from June 2019 by the state General Assembly’s Legislative Budget and Finance Committee.
However, now that things are returning to some semblance of normalcy, it seems that bureaucrats from the state Department of Education (PDE) are taking the wrong lessons from the report while the legislature seems to have forgotten it entirely.
The report was conducted because of legislation written by state Sen. Ryan P. Aument (R-Lancaster County). It directed the Legislative Budget and Finance Committee to “study the effectiveness of standardized testing, including the Keystone Exams and SATs, and their use as indicators of student academic achievement, school building performance, and educator effectiveness.”
The key findings are as follows:
1)The majority of principals and teachers disapprove of the state’s standardized tests – both the Pennsylvania System of School Assessment (PSSA) tests given in grades 3-8 and Keystone Exams given in high school. They think these tests are ineffective, expensive and harmful to district curriculum and students.
2) State law allows parents to opt their children out of testing for one reason only – religious grounds. Parents are using this religious exemption in increasing numbers. This puts districts in danger of violating federal participation and accountability standards.
3) It has been suggested that the state allow two additional reasons for parents to opt their children out of testing – philosophical grounds and health concerns. It is unclear whether doing so would increase overall opt outs or not.
4) The federal Every Student Succeeds Act (ESSA) passed in 2015 allows the use of the SAT and/or ACT test to take the place of high school standardized testing. It has been suggested the Commonwealth replace the Keystone Exams with these tests. The report finds the ACT and/or SAT would successfully determine college readiness and reduce the overall amount of standardized testing. However, this would not allow other uses of current state tests like evaluating teacher effectiveness and school building performance.This may not matter though because the report also casts doubt on whether the current tests (PSSA and Keystone Exams) do an adequate job of assessing teacher or building performance now or even if student tests can be accurately used to evaluate teachers and schools.
There’s a lot of information here. Let’s look at each finding in turn.
1) PA Educators Hate Standardized Tests
When it comes to the PSSAs, 67% of principals and 76% of teachers said the tests were ineffective indicators of student achievement.
There was slightly more support for the Keystone Exams. This time 45% of principals said the test was an ineffective indicator of student achievement (with 27% saying the tests were effective). Meanwhile, 60% of teachers said the test was ineffective.
Both principals and teachers said their curriculum had been narrowed to prepare students for PSSAs and Keystone Exams. Instead of going into more depth on regular classwork or learning new skills, the focus shifts to teaching to the tests.
Most principals (approximately 80-90%) said that students are taught test-taking skills, and their schools administered practice tests, bench-mark tests, and/or diagnostic tests to prepare students for the PSSA exams. This held for teachers, too, with 81-88% saying they teach test-taking skills and administer practice tests. Principals also said the costs of this additional test prep varied from $200 to more than $100,000.
Taking the tests also eats up valuable class time. Administering the assessments takes between 5.7 to 8 days for each kind of test – the PSSA and the Keystone Exams, according to Principals.
In addition, the report details the cost of giving these tests. In fiscal year 2017-2018, PDE paid $42.17 million for these tests. This is part of a national trend:
“Standardized tests and test preparation have subsequently become big business and that multibillion dollar business continued to grow since the enactment of NCLB and the subsequent enactment of ESSA. According to the Pew Center on the States, annual state spending on standardized tests increased from $423 million before the NCLB (enacted in 2002) to upwards of $1.1 billion in 2008 (to put this in perspective this reflects a 160 percent increase compared to a 19.22 percent increase in inflation during the same time period). A more recent study by the Brown Center on Education Policy at Brooking put the cost at upwards of $1.7 billion in 2011 related to state spending on standardized tests.”
2) Opt Outs on the Rise
Many states allow parents to opt their children out of standardized testing. Some do so in cases of a physical disability, medical reasons, or emergencies. A few allow opt-outs based on religious objection – like Pennsylvania. Some states allow opt-outs for any reason whatsoever.
The religious exemption is not used widespread throughout the state and most schools meet the 95% participation rate required by the federal government. However, use of the religious exemption is definitely on the rise – enough so that the authors of the report find it alarming:
“Meanwhile, as previously indicated in this section, schools throughout the country are experiencing and grappling with an increase in the number of parents seeking to have their children opt-out of standardized testing now that new state assessments have been implemented pursuant to the federal requirements. Pennsylvania is no exception to this trend and is also experiencing an increase in the number of parents utilizing the religious opt-out.”
For the PSSA tests, opt outs increased from 2013-14 to 2016-17. However, total numbers in school year 2017-18 decreased sightly.
Opt outs went from 1,886 to 6,425 to 15,644 to 19,012 to 16,961.
During the same time period for the Keystone Exams, opt outs steadily increased each year but were at lower overall rates.
For the high school test, opt outs went from 382 to 666 to 1,000 to 1,313 to 1,633.
These are vitally important figures because opt out data is rarely tabulated and released to the public. Many media accounts actually state the opposite of the data in this report – in particular that opting out has decreased since Congress passed the ESSA in 2015. Apparently the media got this one wrong.
Though the religious opt-out is the only reason specifically allowed in state Chapter 4 regulations, PDE reports there are five additional ways that students end up not taking the tests:
1) Other Parental Request – parents simply refusing to let their kids participate but not objecting based on specifically religious reasons.
2) No Attempt and No Exclusion Marked – students who are given the test but do not answer enough questions to receive a score.
3) No Test – no test record on file for unknown reasons.
4) Extended Absence – a student missed the testing and make-up window due to absences.
5) Other – does not fit any of the other categories.
Federal law – in particular No Child Left Behind (NCLB) and subsequent reauthorizations of that legislation – requires states to use student participation in standardized testing as a factor in a state’s accountability system. According to the report, any district with less than 95% of students taking the test should be “addressed.”
The report does not go into any further detail about what this means, other than to say that falling under 95% can:
“…ultimately result in a reduced achievement/proficiency measure… If the student participation rate falls below 95 percent, states are required to calculate student achievement/proficiency by dividing the number of students scoring proficiently by no less than 95 percent of the total students (which effectively assigns a score of “0” to all nonparticipants once the participation rate has fallen below 95 percent).”
In effect, the district gets a bad mark on a piece of paper. So what?
Under NCLB, schools with poor performance could receive sanctions like state takeover or lower funding. However, this is extremely unlikely – especially since the passing of ESSA. This newest reauthorization of the law gives states leeway in designing their accountability systems. It leaves the enforcement of this 95% participation rate up to the states, requiring them to develop an accountability plan in the event that a school or district fails to meet this standard.
So a school would only be punished if the state decided to do so. If a state legislature decided to allow parents to opt their children out for any reason at all, they would not have to take any punitive measures. Since the ESSA, the buck stops at the state house door on this one. California, for example, takes note of low participation rates but these rates are not factored into a school’s rating. On the other hand, Florida mandates direct intervention from the state’s Department of Education until participation rates are met.
3) Impact of New Reasons to Opt Out
This is where things get a bit sticky.
The report mentions the idea of expanding the options for opting-out of statewide assessments (e.g., PSSA and Keystone Exams) to include objections based on philosophical grounds or due to health issues.
On the one hand, the authors write “The impact of adding opt-out categories may be minimal.” They don’t know if more people would use the expanded options or if the same numbers who use the religious exemption today might simply divide themselves up among all three options.
The authors worry, however, that new pathways to opt out may increase the total number of people refusing the tests for their children and would reduce Pennsylvania’s participation rate in standardized testing.
This is a particularly troubling paragraph:
“The existence of opt-outs (religious or otherwise) has the potential to negatively impact a state’s participation rates and may potentially impact a state’s [Local Education Agency (LEAs)] and schools achievement/proficiency rate and ultimately the ability of a state to be in compliance with federally required assessments and accountability measures. Furthermore, providing opt-outs and giving parents notice of such has the potential to conflict with the message about the importance of standardized testing. Ultimately placing the state departments of education and local school districts in the potentially awkward position of having to explain why it is important for students to participate in testing (given the federal requirements), while also giving and notifying parents of the opt-out options for their children. In 2015, US Department of Education sent out letters to a dozen states flagging their low participation rates (statewide, or at the district or subgroup level) on the 2014-15 school year assessments and indicated that they needed to create a plan to reduce opt-outs due to low participation rates.”
This seems to be the order of the day at PDE. It’s why earlier this year, school administrators were advised by state officials to crack down on parents opting their children out of standardized tests.
And all of it is based on a cowardly and incomplete understanding of federal law. If Commonwealth schools fall below 95% participation in the test and get a bad mark on a worthless metric, it doest have to matter. No matter how many letters the federal government sends to the state legislature or PDE, the law is clear. The state is in charge here. Our legislature can choose to side with taxpayers, residents, and citizens or with civil servants and strongly worded letters.
4) Replacing the Keystone Exams
There’s not much more to add to this than the initial finding.
The authors of the report say there would be no problem with replacing the Keystone Exams with the ACT or SAT because these national tests would properly assess students’ college and career readiness.
The report is actually pretty shoddy in this regard not really examining the claims of the College Board which makes both tests. The authors just pretty much accepted the College Board’s word wholesale. Nor was their any evaluation of what teachers and principals thought about these tests like there had been for the PSSA and Keystone Exams.
However, the report does make a good point about test reduction. Many students already take the SAT or ACT test, so eliminating the Keystones would reduce the over all amount of tests they had to take.
Also the authors deserve credit for writing about how using student test scores to evaluate teachers and schools is seriously bad practice.
According to the report, 77 percent of principals and 93 percent of teachers said PSSA tests were not effective indicators for teacher evaluations, with similar figures for the Keystone Exams and building performance evaluations.
While everything in the report may not be 100% accurate, it includes important information that should be wider known.
In addition, the report has trustworthy data about opt outs throughout the Commonwealth. Unlike what has been reported in the media, opting out is not on the decline, it is on the rise.
The Keystone Exams should be thrown in the trash, because that’s what they are – trash. At very least they should be replaced with the SAT or ACT. Even better to remove any requirement for standardized tests wholesale – and that includes the PSSA.
The ESSA allows states a lot of leeway about how and what accountability system they use. There is no need to worry about some imperial federal power invading Pennsylvania to force our hand with standardized testing. We should call their bluff on this. I’ll bet that if we did so, many other states would do the same.
Standardized testing is another failed education policy. Our legislators would do good to read this report and make up their own minds about it.
Though a few years and disasters have happened since its publication, it doesn’t deserve to be forgotten by the very people who ordered it to be written in the first place.
Like this post? You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.
Year after year, decade after decade, the poor and people of color get fewer school resources, larger class sizes, narrowed curriculum and lower acceptance to colleges.
Yet, as defenders of standardized testing (and racist practices in general) love to point out, not all minorities consistently fail these tests.
In particular, Asian-Americans – taken as a whole – score better than white Americans.
So the tests are totally fair, right? Case closed?
Wrong.
Asian-Americans, who make up roughly 5 percent of public school enrollment nationally, are just as much victimized by standardized testing as any other minority. The only difference is their success is held up as an excuse for upholding this deeply inequitable practice.
It’s kind of like if two people were pitted against each other in a race, and one had to run a mile, and the other had to run 1.5 miles – and the second person actually won. Would that make the race fair?
No. Not at all. But the organizers point to the result as proof that running that extra distance in the same amount of time was nondiscriminatory. So stop complaining!
Take the SAT. Asian-American students typically score higher than other students on America’s most popular college gatekeeper as they do on other standardized tests. For instance, among high school students who graduated in 2020, Asian students scored an average of 632 on the SAT math section, compared with 547 for white students. The average math score overall was 523 (out of 800).
What does this really mean?
ASIAN AMERICANS ARE NOT A MONOLITH
First of all, when we talk about Asian-American students doing well on standardized tests, we’re generalizing. We don’t mean all Asians – only a certain percentage of certain kinds of these people. After all, Asia is a pretty big continent.
According to the US Census Bureau, there are roughly 23 million Americans of Asian descent, and the largest subgroups are people of Chinese and Indian ancestry with populations of approximately 5 million each. Next comes people of Filipino (4.2 million), Vietnamese (2.2 million), Korean (1.9 million) and Japanese descent (1.5 million).
But those are just the biggest subgroups. When you add in all Asian-Americans including Pacific Islanders, you get more than 50 different ethnic groups with varying languages, immigration histories and educational experiences.
Any generalization about such a diverse group will leave out important details, including test scores.
ALL ASIANS DON’T GET HIGH TEST SCORES
For example, high test achievement is not something attained universally by all people who can trace their parentage through that part of the world. It’s actually much more common for East Asians than others. In particular, we’re talking about people of Chinese, Korean and similar heritages.
In these countries, college admission often is decided on a single high-stakes test – the gaokao in China or the suneung in South Korea. People whose cultures trace back to these parts of the world are used to engaging in intense test prep as a regular feature of teenage life. So many Asian immigrant parents with ties to these countries often see the SAT or ACT as the equivalent of Asia’s admissions tests and thus engage in test prep as a matter of course, regardless of cost or effort.
This goes far in explaining why Chinese- and Korean-Americans have the highest rate of participation in SAT/ACT test prep – even more than people from other Asian ethnicities.
In one study, more than half of Korean-Americans and 42 percent of Chinese-Americans took an SAT prep course before college compared to 35.6 percent of white students, 32.4 percent of Hispanic students and 40.4 percent of black students. This is true regardless of household income. Affluent Asian Americans were more likely to take test prep, but 46.7 percent of low-income Korean-Americans still took a prep course.
East Asian-Americans show statistically significant gains from test prep much more often than others. This is partially due to having better access to adequately funded K-12 schools than other minority groups. They are less likely to attend racially segregated, poorly resourced schools, unlike their Black and Hispanic peers. Even Asians from lower socio-economic backgrounds tend to get more out of test prep than others because they are more likely to attend well-resourced schools than their counterparts in the same socio-economic bracket.
And let’s not forget that test prep companies target Asian-American communities. You’ll find them in urban centers like Koreatown in Los Angeles or heavily Asian suburbs such as the San Gabriel Valley. Advertising material for these services are often in multiple languages or displayed in Asian-language newspapers and ethnic media.
Most of New York City’s 411 prep centers are based in Queens and Brooklyn, “with over a quarter of them… most notably in the boroughs’ Asian enclaves of Flushing and Sunset Park in Brooklyn,” The New York Times reported.
“On the opposite coast, 861 such tutoring centers exist in California’s Orange, Santa Clara and Los Angeles counties, all heavy with Asian-American families,” the article states.
So it’s no wonder why certain Asian-American communities – especially East Asian communities – tend to favor test prep and achieve high standardized test scores.
ASIANS ARE HELD TO UNFAIR STANDARDS
But let us not forget that East Asians are not ALL ASIANS. If you’re unlucky enough to be from other parts of that massive continent or the island chains of the Pacific, the US will still paint you with the same broad brush.
All Asian-Americans – whether of East Asian descent or not – are held to a higher standard in things like college admissions where overachievement is considered the norm and little else is tolerated.
This is unfair to East Asians because it expects them to jump through more hoops than white people or other ethnic groups just to be accepted, but it is even worse for other Asian subgroups.
A 2022 study of the nine-campus University of California – the state with the country’s largest Asian-American population – concluded that Filipino, Thai, Native Hawaiian/Pacific Islander and Laotian students were admitted at below-average rates and that many ethnicities including Samoans and Chamorros, were underrepresented in the system.
Why? They had lower test scores than admissions officials expected.
Such an emphasis on standardized testing is not healthy for students of any nationality. The College Board makes millions of dollars every year with assessments like the SAT and ACT holding the scores up as proof that certain students have what it takes to excel in college or universities.
This is a rarely mentioned side effect of Asian-American’s standardized testing overachievement. And it may help to explain why – despite scoring well on standardized tests – Asians don’t complete college as often as students from other ethnicities.
According to an analysis of the 23-campus California State University System, all Asian subgroups were less likely than whites to complete their degrees in four years. There were roughly 78,000 Asians attending the university system in 2016, yet their four-year completion rate was 3% below that of all students. Only a few subgroups – Japanese and Asian Indians – had four-year completion rates that exceeded the average.
If test scores and admissions were all it took to achieve post secondary success, you’d expect college completion to be shared by Asian-Americans across the board.
In reality, college attainment varies significantly within the Asian community. While more than half of Japanese and Korean Americans (and nearly 3/4 of Asian Indian Americans) age 24 or older had a bachelor’s degree or higher in 2019, the same was true for less than 1/5 of their Laotian, Hmong and Cambodian counterparts.
CONCLUSIONS
Therefore, it is highly suspect when standardized testing apologists point to Asian-American test scores as proof the system is fair and balanced.
First of all, it conflates the achievements of mostly East Asians with all Americans of eastern heritage. Second, it demands more of one minority group to be accepted as equal to a white majority.
In any case, the standardized testing industry can no longer hide behind the myth of the Asian-American model minority to justify their shady business practices.
Like this post? You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.
Fewer states require high stakes tests as graduation exams and/or use them to evaluate their teachers. Across the nation, states are cutting the size of standardized tests or eliminating them altogether. And more state legislatures passed laws explicitly allowing parents to opt their children out of the tests.
I think we have different definitions of “Slows” and “Crawl.”
That may not be surprising since we also seem to have different definitions of “Anti-Test.”
The Opt Out Movement is not “Anti-Test.” It is anti-high stakes standardized test.
It is against the federal government forcing states to use corporate written, corporate graded and corporate remediated standardized assessments.
It is against the federal government requiring each state to participate in a corporate boondoggle that not only wastes billions of tax dollars that could be better spent to educate children but also unfairly assesses their academic progress and feeds the push to privatize public schools.
Calling these folks “Anti-Test” is like labeling those pushing for stricter gun regulations “Anti-Gun” or smearing those protesting government corruption as “Anti-Government.”
And that’s just the title!
The author Alyson Klein further misdirects readers by conflating opt out rates and test resistance.
She implied that the only measure of opposition was the percentage of students who opt out. However, as noted above, there are multiple measures of resistance.
Moreover, few states advertise their opt out rates. Especially after the movement began, states made that information harder to come by to dissuade more people from joining it.
Of those states where information is available, Klein puts the most negative possible spin on the facts in order to make her point – a point that it seems to me is not at all justified.
“At least some of the steam has gone out of the opt-out movement in states such as New Jersey and New York, considered hotbeds of anti-testing fervor.”
And New York is one of our most densely populated states. That percentage represents more than 225,000 parents across the Empire State who refused to let their children take the tests despite threats from many administrators and district officials for doing so.
In New Jersey, opt out rates were marginally lower this year than last year. They went from 7% to 5%. But once again New Jersey is a populous state. That percentage represents about 68,500 students.
In addition, this is after massive opt outs three years ago that forced the state to change its federally mandated assessment. Testing boycotts pushed the state education association to get rid of four PARCC assessments and allow students who fail the remaining two tests to take an alternative assessment. And this is in a state where there is no law explicitly allowing parents to opt out of the tests.
I don’t know if I’d call that running out of steam.
And it nearly doubled in Utah over the past two years to about 6%. In some schools in the Beehive State, rates are much higher. According to the Salt Lake Tribune, 1 in 5 students in the Park City school district refused to take the tests.
Though my own state of Pennsylvania has been mum on last year’s opt outs, from my own personal experience as a teacher in suburban Pittsburgh, I never had more students boycott our federally mandated standardized test than I did last year.
There were so many they had to be quarantined in a special room.
Moreover, an increasing number of parents ask me about the issue, express concern and wonder about their rights.
So even when examining just the rate of opt out, I don’t see any reason to assume the movement is slowing down.
As recently as 2012, half of all U.S. states required high school exit exams in order for students to graduate. Today that number has dropped to 12. The reason? Exit exams don’t raise student achievement – they raise the dropout rate. At least that’s what The National Research Council of the National Academy of Sciences tells us.
And when it comes to opt out, two more states – Idaho and North Dakota – now have explicit laws on the books allowing parents to refuse the test for their children – in whole or in part. That brings the total number of states up to 10. It would have been 11, but Georgia Governor Nathan Deal, a Republican, vetoed an opt-out bill. The federal government still wants us to penalize these districts for non-participation in flagrant violation of its authority. But as more states respect parents’ rights on this matter, it will be increasingly difficult for the U.S. Department of Education to continue trampling them.
There is already some proposed legislation to make positive changes. Sen. Jon Tester (D-Mont.) and Rep. Krysten Sinema (D-Ariz.) introduced legislation last year to replace annual assessments with grade-span tests. The United States is, after all, one of the only countries in the world – if not the only one – to require students be tested every year. These proposed changes are not nearly enough, but they’re a step in the right direction.
One of the biggest obstacles to abolishing federally mandated testing last time was that some of the oldest and most well funded civil rights organizations opposed it. Many of them get their money and support from the same billionaires who profit off of the standardized testing and privatization industries.
gadflyonthewallblog 