Forgotten Pre-Covid Report Reveals Standardized Testing Weaknesses in PA

The majority of teachers and principals in Pennsylvania hate standardized tests.

An increasing number of parents are refusing to allow their kids to take the tests.

And there may be better alternatives to the state’s Keystone Exams.

These were just some of the key findings of a blockbuster report from June 2019 by the state General Assembly’s Legislative Budget and Finance Committee.

The report, “Standardized Tests in Public Education” was published about 9 months before the Covid-19 pandemic hit.

It effectively got lost in the chaos that followed the global pandemic.

However, now that things are returning to some semblance of normalcy, it seems that bureaucrats from the state Department of Education (PDE) are taking the wrong lessons from the report while the legislature seems to have forgotten it entirely.

The report was conducted because of legislation written by state Sen. Ryan P. Aument (R-Lancaster County). It directed the Legislative Budget and Finance Committee to “study the effectiveness of standardized testing, including the Keystone Exams and SATs, and their use as indicators of student academic achievement, school building performance, and educator effectiveness.”

The key findings are as follows:

1)The majority of principals and teachers disapprove of the state’s standardized tests – both the Pennsylvania System of School Assessment (PSSA) tests given in grades 3-8 and Keystone Exams given in high school. They think these tests are ineffective, expensive and harmful to district curriculum and students.

2) State law allows parents to opt their children out of testing for one reason only – religious grounds. Parents are using this religious exemption in increasing numbers. This puts districts in danger of violating federal participation and accountability standards.

3) It has been suggested that the state allow two additional reasons for parents to opt their children out of testing – philosophical grounds and health concerns. It is unclear whether doing so would increase overall opt outs or not.

4) The federal Every Student Succeeds Act (ESSA) passed in 2015 allows the use of the SAT and/or ACT test to take the place of high school standardized testing. It has been suggested the Commonwealth replace the Keystone Exams with these tests. The report finds the ACT and/or SAT would successfully determine college readiness and reduce the overall amount of standardized testing. However, this would not allow other uses of current state tests like evaluating teacher effectiveness and school building performance.This may not matter though because the report also casts doubt on whether the current tests (PSSA and Keystone Exams) do an adequate job of assessing teacher or building performance now or even if student tests can be accurately used to evaluate teachers and schools.

There’s a lot of information here. Let’s look at each finding in turn.

1) PA Educators Hate Standardized Tests

When it comes to the PSSAs, 67% of principals and 76% of teachers said the tests were ineffective indicators of student achievement.

There was slightly more support for the Keystone Exams. This time 45% of principals said the test was an ineffective indicator of student achievement (with 27% saying the tests were effective). Meanwhile, 60% of teachers said the test was ineffective.

Both principals and teachers said their curriculum had been narrowed to prepare students for PSSAs and Keystone Exams. Instead of going into more depth on regular classwork or learning new skills, the focus shifts to teaching to the tests.

Most principals (approximately 80-90%) said that students are taught test-taking skills, and their schools administered practice tests, bench-mark tests, and/or diagnostic tests to prepare students for the PSSA exams. This held for teachers, too, with 81-88% saying they teach test-taking skills and administer practice tests. Principals also said the costs of this additional test prep varied from $200 to more than $100,000.

Taking the tests also eats up valuable class time. Administering the assessments takes between 5.7 to 8 days for each kind of test – the PSSA and the Keystone Exams, according to Principals.

In addition, the report details the cost of giving these tests. In fiscal year 2017-2018, PDE paid $42.17 million for these tests. This is part of a national trend:

“Standardized tests and test preparation have subsequently become big business and that multibillion dollar business continued to grow since the enactment of NCLB and the subsequent enactment of ESSA. According to the Pew Center on the States, annual state spending on standardized tests increased from $423 million before the NCLB (enacted in 2002) to upwards of $1.1 billion in 2008 (to put this in perspective this reflects a 160 percent increase compared to a 19.22 percent increase in inflation during the same time period). A more recent study by the Brown Center on Education Policy at Brooking put the cost at upwards of $1.7 billion in 2011 related to state spending on standardized tests.”

2) Opt Outs on the Rise

Many states allow parents to opt their children out of standardized testing. Some do so in cases of a physical disability, medical reasons, or emergencies. A few allow opt-outs based on religious objection – like Pennsylvania. Some states allow opt-outs for any reason whatsoever.

The religious exemption is not used widespread throughout the state and most schools meet the 95% participation rate required by the federal government. However, use of the religious exemption is definitely on the rise – enough so that the authors of the report find it alarming:

“Meanwhile, as previously indicated in this section, schools throughout the country are experiencing and grappling with an increase in the number of parents seeking to have their children opt-out of standardized testing now that new state assessments have been implemented pursuant to the federal requirements. Pennsylvania is no exception to this trend and is also experiencing an increase in the number of parents utilizing the religious opt-out.”

For the PSSA tests, opt outs increased from 2013-14 to 2016-17. However, total numbers in school year 2017-18 decreased sightly.

Opt outs went from 1,886 to 6,425 to 15,644 to 19,012 to 16,961.

During the same time period for the Keystone Exams, opt outs steadily increased each year but were at lower overall rates.

For the high school test, opt outs went from 382 to 666 to 1,000 to 1,313 to 1,633.

These are vitally important figures because opt out data is rarely tabulated and released to the public. Many media accounts actually state the opposite of the data in this report – in particular that opting out has decreased since Congress passed the ESSA in 2015. Apparently the media got this one wrong.

Though the religious opt-out is the only reason specifically allowed in state Chapter 4 regulations, PDE reports there are five additional ways that students end up not taking the tests:

1) Other Parental Request – parents simply refusing to let their kids participate but not objecting based on specifically religious reasons.

2) No Attempt and No Exclusion Marked – students who are given the test but do not answer enough questions to receive a score.

3) No Test – no test record on file for unknown reasons.

4) Extended Absence – a student missed the testing and make-up window due to absences.

5) Other – does not fit any of the other categories.

Federal law – in particular No Child Left Behind (NCLB) and subsequent reauthorizations of that legislation – requires states to use student participation in standardized testing as a factor in a state’s accountability system. According to the report, any district with less than 95% of students taking the test should be “addressed.”

The report does not go into any further detail about what this means, other than to say that falling under 95% can:

“…ultimately result in a reduced achievement/proficiency measure… If the student participation rate falls below 95 percent, states are required to calculate student achievement/proficiency by dividing the number of students scoring proficiently by no less than 95 percent of the total students (which effectively assigns a score of “0” to all nonparticipants once the participation rate has fallen below 95 percent).”

In effect, the district gets a bad mark on a piece of paper. So what?

Under NCLB, schools with poor performance could receive sanctions like state takeover or lower funding. However, this is extremely unlikely – especially since the passing of ESSA. This newest reauthorization of the law gives states leeway in designing their accountability systems. It leaves the enforcement of this 95% participation rate up to the states, requiring them to develop an accountability plan in the event that a school or district fails to meet this standard.

So a school would only be punished if the state decided to do so. If a state legislature decided to allow parents to opt their children out for any reason at all, they would not have to take any punitive measures. Since the ESSA, the buck stops at the state house door on this one. California, for example, takes note of low participation rates but these rates are not factored into a school’s rating. On the other hand, Florida mandates direct intervention from the state’s Department of Education until participation rates are met.

3) Impact of New Reasons to Opt Out

This is where things get a bit sticky.

The report mentions the idea of expanding the options for opting-out of statewide assessments (e.g., PSSA and Keystone Exams) to include objections based on philosophical grounds or due to health issues.

On the one hand, the authors write “The impact of adding opt-out categories may be minimal.” They don’t know if more people would use the expanded options or if the same numbers who use the religious exemption today might simply divide themselves up among all three options.

The authors worry, however, that new pathways to opt out may increase the total number of people refusing the tests for their children and would reduce Pennsylvania’s participation rate in standardized testing.

This is a particularly troubling paragraph:

“The existence of opt-outs (religious or otherwise) has the potential to negatively impact a state’s participation rates and may potentially impact a state’s [Local Education Agency (LEAs)] and schools achievement/proficiency rate and ultimately the ability of a state to be in compliance with federally required assessments and accountability measures. Furthermore, providing opt-outs and giving parents notice of such has the potential to conflict with the message about the importance of standardized testing. Ultimately placing the state departments of education and local school districts in the potentially awkward position of having to explain why it is important for students to participate in testing (given the federal requirements), while also giving and notifying parents of the opt-out options for their children. In 2015, US Department of Education sent out letters to a dozen states flagging their low participation rates (statewide, or at the district or subgroup level) on the 2014-15 school year assessments and indicated that they needed to create a plan to reduce opt-outs due to low participation rates.”

This seems to be the order of the day at PDE. It’s why earlier this year, school administrators were advised by state officials to crack down on parents opting their children out of standardized tests.

For the first time in 8 years, I, myself, had to jump through several hoops to opt my own daughter out this year when in the past a simple phone call had sufficed.

I was asked to send in a letter, sign a confidentiality statement and go to the school to examine the test before they would excuse my little girl from the tests. It was an unnecessary hassle meant to discourage parents from doing what they thought was right and exercise their rights through state law.

And all of it is based on a cowardly and incomplete understanding of federal law. If Commonwealth schools fall below 95% participation in the test and get a bad mark on a worthless metric, it doest have to matter. No matter how many letters the federal government sends to the state legislature or PDE, the law is clear. The state is in charge here. Our legislature can choose to side with taxpayers, residents, and citizens or with civil servants and strongly worded letters.

4) Replacing the Keystone Exams

There’s not much more to add to this than the initial finding.

The authors of the report say there would be no problem with replacing the Keystone Exams with the ACT or SAT because these national tests would properly assess students’ college and career readiness.

The report is actually pretty shoddy in this regard not really examining the claims of the College Board which makes both tests. The authors just pretty much accepted the College Board’s word wholesale. Nor was their any evaluation of what teachers and principals thought about these tests like there had been for the PSSA and Keystone Exams.

However, the report does make a good point about test reduction. Many students already take the SAT or ACT test, so eliminating the Keystones would reduce the over all amount of tests they had to take.

Also the authors deserve credit for writing about how using student test scores to evaluate teachers and schools is seriously bad practice.

According to the report, 77 percent of principals and 93 percent of teachers said PSSA tests were not effective indicators for teacher evaluations, with similar figures for the Keystone Exams and building performance evaluations.

While everything in the report may not be 100% accurate, it includes important information that should be wider known.

In particular, it matters that the majority of teachers and principals throughout the state disapprove of standardized testing. If we trust our educators at all, we should take steps to reduce or abolish high stakes testing – not continue the same dismal policy that has achieved nothing positive in 20 years of NCLB.

In addition, the report has trustworthy data about opt outs throughout the Commonwealth. Unlike what has been reported in the media, opting out is not on the decline, it is on the rise.

If we value parents and their autonomy to make decisions for their own children, we should at very least expand their ability to refuse the test for their children without having to give anyone a reason. Being parents is reason enough.

The Keystone Exams should be thrown in the trash, because that’s what they are – trash. At very least they should be replaced with the SAT or ACT. Even better to remove any requirement for standardized tests wholesale – and that includes the PSSA.

The ESSA allows states a lot of leeway about how and what accountability system they use. There is no need to worry about some imperial federal power invading Pennsylvania to force our hand with standardized testing. We should call their bluff on this. I’ll bet that if we did so, many other states would do the same.

Standardized testing is another failed education policy. Our legislators would do good to read this report and make up their own minds about it.

Though a few years and disasters have happened since its publication, it doesn’t deserve to be forgotten by the very people who ordered it to be written in the first place.


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

A Private Equity Firm, The Makers of the MAP Test, and an Ed Tech Publisher Join Forces

 
 
Prepare to watch more of your tax dollars spiral down the drain of standardized testing. 


 
A year after being gobbled up by private equity firm Veritas Capital, ed tech company Houghton Mifflin Harcourt (HMH) is acquiring K-12 assessment giant Northwest Evaluation Association (NWEA). 

Let me put that in perspective – a scandal-ridden investment firm that made billions in the wars in Iraq and Afghanistan bought one of standardized testing’s big four and then added the Measures of Academic Progress (MAP) test to its arsenal.

This almost certainly means the cost of state testing is going to increase since the providers of the tests are shrinking. 

“It used to be if you put out a [Request for Proposal] RFP for state assessment, you get five, six, 10 bidders,” said Scott Marion, executive director of the Center for Assessment. “Now you’re lucky to get three. When you’re doing that, there’s maybe not as much expertise and certainly the cost will go up” (emphasis mine).

Under the proposed deal announced in January, the testing company’s assessments and the ed tech company’s test prep materials will become intimately entwined. 

NWEA, best known for its MAP assessment, will operate as a division of HMH. And NWEA’s tests will be aligned with HMH’s curriculum.

You can just imagine how this will affect the marketplace. 

NWEA serves about 10,000 school districts and HMH estimates it works with more than 50 million students and 4 million educators in 150 countries, according to a press release about the proposed acquisition. 

So we can expect districts and even entire states which rely heavily on the MAP test to be encouraged to buy as much HMH curriculum as possible. That way they can teach directly what is on their standardized tests.

That is assuming, of course, the acquisition agreement is approved after a 90-day regulatory review period. 

To be honest, I would be surprised if there are any objections. 


 
Such cozy relationships already exist with other education companies. For example, Curriculum Associates provides the aforementioned curriculum for its own i-Ready assessment.

It’s ironic that an industry built on standardization – one size fits all – continues to take steps to create books, software and courses aligned with specific tests. It’s almost like individuating information to specific student’s needs is beneficial or something. Weird!

After all, if these sorts of assessments can be gamed by increased access to materials created by the same corporate entities that create and grade the tests, are we really assessing knowledge? Aren’t we just giving students a score based on how many books and software packages their districts bought from the parent company? Is that really education

I remember a time when curriculum was determined by classroom teachers – you know, experts in their fields, not experts in the corporate entity’s test du jour. 

But I guess no one was getting rich that way…

NWEA used to be focused more on formative assessments – tests that you took several times a year before and sometimes even after the big summative state assessment to determine if you were progressing toward passing the high stakes goal. However, in 2021, the company acquired assessment-related technology from Educational Testing Service (ETS) and took over several state contracts from Questar Assessments. This includes contracts for New York, Georgia, Mississippi, and Missouri.

This made NWEA attractive to HMH which had, itself, consolidated into mostly educational technologies and sold off most of its interests in book publishing and assessments. In fact, various versions of the company from Harcourt to Houghton Mifflin Harcourt used to be considered one of the big 4 standardized testing companies until only a decade ago. With revenues of $1.37 billion in fiscal year 2014, for example, the company held a 44% market share including Common Core instructional resources.


 
However, in 2018 it divested its Riverside clinical and standardized testing (Riverside) portfolio to Alpine Investors, a private equity firm based in San Francisco, for a purchase price of $140 million, and then sold its publishing assets in 2021 to HarperCollins.


 
Then in February of 2022, New York-based private-equity firm Veritas Capital acquired HMH at a price of $21 per share, or about $2.8 Billion. And under Veritas, HMH acquired NWEA and the two companies will work together to do many of the things that HMH used to do by itself – like a golden dragon perched atop the standardized testing treasure trove.

All for the benefit of Veritas Capital.

Make no mistake, the investment firm wouldn’t have become involved if it couldn’t make a profit off the situation. That’s what it does – through scandal after scandal.

Founded in 1992 by the late investment banker Robert McKeon (who died by suicide after mounting improprieties came to light), Veritas Capital began its life buying up government contractors and forming close ties with former senior government officials. Of the company’s many defense-related investments, the most infamous was its 2005 purchase of DynCorp International, a shady company involved in the US’s Iraq and Afghanistan wars.


 
Under Veritas ownership, DynCorp benefited from lax oversightfrequently billed the government for work that was never requested, and was embroiled in a sex-trafficking scheme, according to reports. 

Veritas also made headlines when a company it bought in 2008, Global Tel-Link, a telecommunications company that provides telephone services for prison systems, racked up exorbitant fees on calls to inmates

In 2006, the firm acquired MZM Inc., an intelligence contractor, which was investigated for providing bribes to Rep. Duke Cunningham, R-Calif., in exchange for help obtaining Pentagon contracts. 

Throughout its history, Veritas has fostered close ties to government officials. Campaign finance records show executives at the investment firm have given over $100,000 to various politicians, mostly Republicans. In 2014, Veritas paid Bill Clinton $250,000 for a speech.

The New York Times reported in 2001 that numerous retired generals were on Veritas’ payroll and the company used such ties to the Pentagon and frequent appearances in the media to boost Veritas-owned military contractors, including DynCorp.

And now the little investment firm that could has its sights on the standardized testing game.

Why?  

Because there’s gold in them thar tests!

Taxpayer money, that is.

Current Veritas’ CEO and Managing Partner Ramzi Musallam has taken the firm from $2 billion in investments in 2012 to $36 billion in 2021 doing things just like this.

Musallam focuses on technology companies like HMH that operate in sectors dominated by the US federal government such as standardized testing. After all, the only reason public schools throughout the country have to give these assessments is federal law. It’s a captive market paid for by tax dollars.  

We could just let teachers teach and then assess their students in whatever ways seem most accurate and fair. Or we could continue to rely on corporations to do it for us without any real proof that their products are better or even as good as what your local neighborhood educator could provide.

Veritas is banking on the latter.


 
America spends $6.8 trillion a year on defense, health care and education – markets dominated by the government. 


 
 
“These are government-influenced markets, no doubt about it, and being close to how the government thinks about those markets enables us to understand how we can best invest,” Musallam said. 


 
So this merger of two of the most influential education companies in the US is great news for investors – and terrible news for taxpayers who will be paying the bill. 


 
For students and teachers – it’s more of the same


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

Standardized Test Scores are Incompatible with Your School’s Equity Plan  

 
 
The primary goal of public education is to teach all children fairly.  


 
But since its inception, the system has never been set up to actually accomplish this.  


 
So these days you hear a lot of talk about fixing the problem – of how we can ensure students of color and other historically underserved children get the same high-quality education racially and economically privileged kids always have received.


 
This almost always concludes with two types of plan.  


 
First, there is the serious venture made up of things like increasing spending to meet student need, wraparound services, early intervention, reducing class size, redistributive justice and cultural competence – a plan that looks the reality in the face and makes bold attempts to come to terms with it. 


 
Then there is the cheap knockoff proposition – a buzzword-laden scheme where someone is trying to convince you their half hearted proposal is actually a solution to the very real problem of educational inequality. 


 
 
And the number one thing you can use to tell the difference between the two is this – standardized test scores


 
 
The first plan that is centered around actually fixing disparities makes no mention of test scores – or at least relegates them to obstacles. The second is built all around them – as an essential component of the overall scheme. 


 
 
This is because the second feel-good-accomplish-nothing plan is essentially performative.  


 
 
Therefore, it is constructed around standardized test scores as a metric of success.  


 
Planners think: We’re going to do A, B and C to make our schools more equitable. And how will we know we’re doing it right? We’ll use our standardized test scores! 


 
That’s not accuracy. It’s ostentation. These scores don’t demonstrate anything at all about equity. True, they purport to show readily apparent increases or decreases in academics.  


 
However, even this is an illusion.  


 
A rise or fall in test scores is not, in fact, based on authentic academic success but merely success at taking standardized tests designed for very different purposes.  


 
And anyone who understands the history of these types of assessments and how they still work will know that this mirage is built at the cost of genuine equity.  


 
In fact, the inequalities plaguing our public school system are due in large part to our national insistence that standardized test scores be the ultimate measure of success.  


 
So constructing your plan to fix this problem around one of its root causes is like claiming you can fix a sinking ship by drilling more holes in its hull.  


 
At best, it’s naive. At worst, it’s self-defeating and disingenuous.  


 
 
The problem centers around the difference between standardized tests and assessments created by classroom teachers. 


 
 
Both types of assessment are supposed to measure what students have learned. But not all learning is equal


   
For example, a beginning chef needs to know how to use the stove, have good knife skills and how to chop an onion. But if you give her a standardized test, it instead might focus on how to make foie gras – something that would only come in handy at a high end French restaurant.


   
That’s not as important in your everyday life, but the tests make it important by focusing on it.  


   
The fact of the matter is that standardized tests do NOT necessarily focus on the most important aspects of a given task. They focus on obscurities – things that most students don’t know.  


   
This is implicit in the design of these exams and is very different from the kinds of tests designed by classroom teachers.  


   
When a teacher makes a test for her students, she’s focused on the individuals in her classes. She asks primarily about the most essential aspects of the subject and in such a way that her students will best understand. There may be a few obscure questions, but the focus is on whether the test takers have learned the material or not.  


   
When psychometricians design a standardized test, on the other hand, they aren’t centered on the student. They aren’t trying to find out if the test taker knows the most important facts or has the most essential skills in each field. Instead, there is a tendency to eliminate the most important test questions so that the test – not the student – will be better equipped to make comparisons between students based on a small set of questions. After all, a standardize test isn’t designed for a few classes – it is one size fits all.  


   
New questions are field tested. They are placed randomly on an active test but don’t count toward the final score. Test takers aren’t told which questions they’ll be graded on and which are just practice questions being tried out on students for the first time. So students presumably give their best effort to both types. Then when the test is scored, the results of the field test questions determine if they’ll be used again as graded questions on a subsequent test.  


   
According to W. James Popham, professor emeritus at the University of California and a former president of the American Educational Research Association, standardized test makers take pains to spread out the scores. Questions answered correctly by too many students – regardless of their importance or quality – are often left off the test.  


   
If 40 to 60 percent of test takers answer the question correctly, it might make it onto the test. But questions that are answered correctly by 80 percent or more of test takers are usually jettisoned.  


   
He writes:  

   “As a consequence of the quest for score variance in a standardized achievement test, items on which students perform well are often excluded. However, items on which students perform well often cover the content that, because of its importance, teachers stress. Thus, the better the job that teachers do in teaching important knowledge and/or skills, the less likely it is that there will be items on a standardized achievement test measuring such knowledge and/or skills.”  


   
Think about what this means.  


   
We are engaged in a system of assessment that isn’t concerned with learning so much as weeding people out. It’s not about who knows what, but about which questions to ask that will achieve the predetermined bell curve.  


 
This is important when it comes to equity.  


 
 
If we are guided in large part by standardized test scores, we aren’t guided by authentic learning. We’re guided by a false picture of learning. Therefore, the most effective way – perhaps the only practical way – of raising test scores is to teach directly to a specific test. And not only the test, but the specific version of the test being given that year.

So if we do somehow manage to raise test scores, we haven’t improved academics at all but a mere semblance of it. And thus the equity we might celebrate in such a situation would be just as false. 


 
You got a good score on the MAP test. Hurrah! But that doesn’t mean you know anything of real value except how to take this particular MAP test which, itself, will change after the next round of questions are field tested.


 
 
 
This has huge implications for the quality of education being provided at our schools. Since most administrators have drunk deep of the testing Kool-Aid, they now force teachers to educate in just this manner – to use test scores to drive instruction. So since the tests doesn’t focus on the most essential parts of Reading, Writing, Math, and Science, neither does much of our instruction. 

And if we insist on evaluating the equity of our schools on these test scores, we will only make things that much worse. 


   
We end up chasing the psychometricians. We try to guess which aspects of a subject they think most students don’t know and then we teach our students that to the exclusion of more important information. And since what students don’t know changes, we end up having to change our instructional focus every few years based on the few bread crumbs surreptitiously left for us by the state and the testing corporations.  


   
That is not a good way to teach someone anything. It’s like teaching your child how to ride a bike based on what the neighbor kid doesn’t know.  


   
It’s an endless game of catch up that only benefits the testing industry because they cash in at every level. They get paid to give the tests, to grade the tests and when students fail, they get paid to sell us this year’s remediation material before kids take the test again, and – you guessed it – the testing companies get another check!  


   
It’s a dangerous feedback loop, a cycle that promotes artificially prized snippets of knowledge over constructive wholes. 


 
And let’s not forget where these tests come from


 
They were created in the 1910s and 20s by eugenicists to prove the supremacy of white Europeans over other racial and ethnic groups.  


 
While these original tests are no longer in circulation, the assumptions behind them are an essential part of our modern day standardized tests. 
 


The very method of question selection in today’s tests builds economic and racial bias into the very fabric of the enterprise.  


   
According to Prof. Martin Shapiro of Emory University, when test makers select questions with the greatest gaps between high and low scorers, they are selecting against minorities. Think about it – if they pick questions based on the majority getting it right, which minority got it wrong? In many cases, it’s a racial or ethnic minority. In fact, this may explain why white students historically do better on standardized tests than black and Hispanic students.  


   
This process may factor non-school learning and social background into the questions. They are based on the experiences of white middle-to-upper class children.  


   
So when we continually push for higher test scores, not only are we ultimately dumbing down the quality of education in our schools, but we’re also explicitly lobbying for greater economic and racial bias in our curriculum trickling down from our assessments.  


   
As Ibram X. Kendi, author of “How to be an Antiracist” puts it:  


   
“Standardized tests have become the most effective racist weapon ever devised to objectively degrade Black minds and legally exclude their bodies.”  


 
This is incompatible with any enterprise aimed at increasing equity.  


 
You are engaged in a never-ending cycle of teaching to the test at the expense of authentic learning. You’re engaged in making minorities think like their privileged peers – of overcoming who they are just to be accepted into a game.

 
 
This is not education. It is assimilation, and it will always put the assimilated at a disadvantage to the majority – those they are being forced to imitate.  


 
Equity and standardized testing do not go together.  


 
 
They CANNOT go together. They are anathema.  


 
Those who suggest otherwise are either well-meaning fools or duplicitous malefactors.  


 
There is a multi-billion dollar standardized testing industry dependent on keeping us testing our kids.  


 
But we can no longer continue feeding that beast and pretending that we can somehow provide equity to our underserved children, too.  


 
We have to choose – equity or testing.  Fairness or unrestrained capitalism.


 
Do not believe anyone who tells you to support a plan built on both. 

It does not exist.


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

The Racist Origins of Standardized Testing Still Matter

Would you walk across a bridge that was designed to break?

Of course you wouldn’t.

But what if someone told you the bridge had been fixed?

Would you trust it – especially if people were still falling off of it all the time?

That’s the situation we’re in with standardized testing.

The tests were explicitly created more than a century ago to fail minorities and the poor.

And today, after countless revisions and new editions, they still do exactly the same thing.

Yet we’re exhorted to keep using them.

A BRIEF HISTORY LESSON

Modern testing comes out of U.S. Army IQ tests developed during World War I.


 In 1916, a group of psychologists led by Robert M. Yerkes, president of the American Psychological Association (APA), created the Army Alpha and Beta tests. These were specifically designed to measure the intelligence of recruits and help the military distinguish those of “superior mental ability” from those who were “mentally inferior.” 


These assessments were based on explicitly eugenicist foundations – the idea that certain races were distinctly superior to others.

Colleague Lewis Terman made the goal clear in his book, The Measurement of Intelligence, that these “experimental” tests will show “enormously significant racial differences in general intelligence, differences which cannot be wiped out by any scheme of mental culture.” 

In 1923, another psychologist, Carl Brigham, took these ideas further in his seminal work A Study of American Intelligence. In it, he used data gathered from these IQ tests to argue the following: 


 
“The decline of American intelligence will be more rapid than the decline of the intelligence of European national groups, owing to the presence here of the negro. These are the plain, if somewhat ugly, facts that our study shows. The deterioration of American intelligence is not inevitable, however, if public action can be aroused to prevent it.”


 
 Thus, Yerkes, Terman and Brigham’s pseudoscientific tests were used to justify Jim Crow laws, segregation, and even lynchings. Anything for “racial purity.” 


People took this research very seriously. States passed forced sterilization laws for people with “defective” traits, preventing between 60,000 and 70,000 people from “polluting” America’s ruling class. 

The practice was even upheld by the US Supreme Court in the 1927 Buck v. Bell decision. Justices decided that mandatory sterilization of “feeble-minded” individuals was, in fact, Constitutional.


 Of the ruling, which has never been explicitly overturned, Justice Oliver Wendell Holmes wrote, “It is better for all the world, if instead of waiting to execute degenerate offspring for crime, or to let them starve for their imbecility, society can prevent those who are manifestly unfit from continuing their kind…. Three generations of imbeciles are enough.” 


Eventually Brigham took his experience with Army IQ tests to create a new assessment for the College Board – the Scholastic Aptitude Test – now known as the Scholastic Assessment Test or SAT. It was first given to high school students in 1926 as a gatekeeper. Just as the Army intelligence tests were designed to distinguish the superior from the inferior, the SAT was designed to predict which students would do well in college and which would not. It was meant to show which students should be given the chance at a higher education and which should be left behind. 


And unsurprisingly it has always – and continues to – privilege white students over children of color. The same as nearly every standardized test still does.

HAS IT CHANGED?

None of this can be challenged. These are historical facts. They are simply what happened justified in the words of the people who perpetrated them.

However, champions of continuing the practice of standardized testing most often defend the practice by appealing to time.

This was all a long time ago, they say. Much has changed between now and then.

But has it? Really?

We certainly don’t use the editions of the tests written by the original eugenicists, but the practices used to create them and the results of these assessments are extremely similar.

In 1964, a Department of Education report found that the average black high school senior scored below 87% of white seniors (in the 13 percentile) on standardized assessments. Fifty years later, the National Assessment of Educational Progress (NAEP) found that black seniors had narrowed the gap until they were merely behind 81% of white seniors (scoring in the 19th percentile).

Is that really the kind of progress you want to champion?

The reason for the disparity has nothing to do with the learning students of color (and the poor whose scores are similar) achieve nor their worth as human beings.

It is in the very concept of standardized testing.

Discrimination is purposefully built in to the standardization process, according to W. James Popham, PhD, Professor Emeritus at the University of California at Los Angeles and former test maker. He explained in an interview with Frontline:

“Traditionally constructed standardized achievements, the kinds that we’ve used in this country for a long while, are intended chiefly to discriminate among students … to say that someone was in the 83rd percentile and someone is at 43rd percentile. And the reason you do that is so you can make judgments among these kids. But in order to do so, you have to make sure that the test has in fact a spread of scores. One of the ways to have that test create a spread of scores is to limit items in the test to socioeconomic variables, because socioeconomic status is a nicely spread out distribution, and that distribution does in fact spread kids’ scores out on a test.”

The scores have to fall into categories – Below Basic, Basic, Proficient and Advanced, for instance. If too many students cluster in the middle, the results are invalid. We need the scores spread out – even if we must resort to non-educational factors to get there.

Family income is not something the tests ignore, says Popham. It is an essential component specifically tested for in question construction. In fact, he claims that between 15-80% of the questions (depending on the subject area) on norm-referenced exams are linked to socio-economic status (SES).

Thus minorities with higher percentages of impoverished people are selected against. Not because of any explicit racist ideology – but to get the pretty bell curve standardized assessments require.

Young Whan Choi, Manager of Performance Assessments at Oakland Unified School District in Oakland, California, agreed.

“Too often, test designers rely on questions which assume background knowledge more often held by White, middle-class students. It’s not just that the designers have unconscious racial bias; the standardized testing industry depends on these kinds of biased questions in order to create a wide range of scores.”

For example, Choi recalled a 10th grade student in his class asking him about a standardized test question. “With a puzzled look, she pointed to the prompt asking students to write about the qualities of someone who would deserve a “key to the city.” Many of my students, nearly all of whom qualified for free and reduced lunch, were not familiar with the idea of a ‘key to the city.’”

So when they get such a question wrong, it isn’t necessarily because they don’t know the concept being tested, but they don’t understand what was being asked in the first place.

Test makers could work to eliminate such instances but that would reduce the spread of answers. It would destroy the bell curve – and thus invalidate the goal of the test which ultimately is not assessing learning but sorting and ranking students.

Jay Rosner, a national admissions test expert, explained how this bias is built-in to the process for each revision of assessments like the SAT:


“Compare two 1998 SAT verbal [section] sentence-completion items with similar themes: The item correctly answered by more blacks than whites was discarded by the Educational Testing Service, whereas the item that has a higher disparate impact against blacks became part of the actual SAT. On one of the items, which was of medium difficulty, 62% of whites and 38% of African-Americans answered correctly, resulting in a large impact of 24%…On this second item, 8% more African-Americans than whites answered correctly…”


 In other words, the criteria for whether a question is chosen for future tests is if it replicates the outcomes of previous exams – specifically tests where students of color score lower than white children. And this is still the criteria test makers use to determine which questions to use on future editions of nearly every assessment in wide use in the US.

Public schools have no control over these factors. That’s why schools serving poor and minority students invariably have lower test scores. Popham concludes there will always be a testing gap because that’s the way the system is designed.

He says it’s “A game without winners.” Or more likely a game where the poor and minorities cannot win.

And that’s how the system was designed.

Whether it’s the 1920s or the 2020s.

Standardized tests came from racists assumptions about human intelligence.

And that still matters today.

We no longer profess eugenicist ideas of racial purity embedded in our assessments as self evident or based on science. But they’re there none-the-less.

Today, the very concept of intelligence being quantifiable remains in question.

In “The Mismeasurement of Man,” evolutionary biologist Stephen Jay Gould challenged many of these ideas – in particular those of Terman. Rather than see intelligence as a genetic trait, Gould envisioned it more abstractly and thus shattered the idea that any mere number could capture human value.

Complex instances of learning cannot be accurately standardized. They have to be measured in context of the students and the learning community where they were acquired.

But this is a relatively new idea. Accepting it requires us to turn the page on a rather dark passage of our national history.

We must move on from the original test makers narrow-minded, racist ideas about intelligence and human worth.

And to do that we must leave standardized testing far, far behind.

We can’t just give a faulty bridge a new coat of paint. We must demolish it and rebuild an entirely new structure to carry us into the future.


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

Lawmakers Backing Standardized Tests Should Practice What They Preach

When it comes to the whip, one side is definitely better than the other.

Everyone wants to hold it by the stock. No one wants to get hit by the lash. 

That’s why politicians as diverse as Donald Trump and Joe Biden have struggled so desperately to defend standardized testing.

They want to keep control of the torture device they’ve inherited from their predecessors without feeling its sting, themselves.

Take the current Covid crisis in our public schools.


 
Educators are scrambling to teach safely and most lawmakers stand aside unsure how to help.

We can’t figure out which students to assist, they say, without first giving them all a batch of standardized tests.


 


It’s absurd, like paramedics arriving at a car crash, finding one person in a pool of blood and another completely unscathed – but before they know which person needs first aid, they have to take everyone’s blood pressure. 


 
I mean come on! We’re living through a global pandemic.  


 
Nearly every single class has been majorly disrupted by it. 


 
So just about every single student needs helpBUT SOMEHOW WE NEED DATA TO NARROW THAT DOWN!?  


 

Our duly-elected decision-makers seem to be saying they can only make decisions based on a bunch of numbers


 


The fact that they have so little imagination that they can’t visualize the problem without a bar graph is truly disturbing. 


 
But this isn’t rocket science. They don’t HAVE TO be creative thinkers.  


 


Just use class attendance to see which students have received consistent instruction and which have been absent all year.


 
Look at classroom grades, which outline students’ academic performance from day to day.  


 
Those are numbers. And they clearly show which kids have been impacted the most by Covid-19. 


 
But for some reason actually using the data we already have is just crazy talk! 


 


Scores on a standardized test are the ONLY data that counts


 
Okay.

Then I have a suggestion for these legislators. 


 
Why don’t you practice what you preach? 


 
If the only logical way to make decisions is based on test scores, you should provide those scores to the greatest decision-making body in the country: voters.  


 
Every lawmaker who CHAMPIONS standardized tests should have to TAKE standardized tests.  


 
I don’t mean the same tests as the students.  


 
That would be silly.  


 
After all, student tests are designed to favor answers from privileged white people. Most of these lawmakers are the target demographic already. They passed a standardized test (or paid someone to pass the test for them) as a smokescreen getting into whichever prep school or ivy league college where they were legacy enrollments, anyway.  


 
I’m talking about a new series of standardized tests designed to show how much these lawmakers adhere to the principles of their respective political parties. 


 
So there’d be two versions – one for Republicans and one for Democrats.  


 
A high score means the test taker is a bona fide example of their party’s ideals. A low score means they should probably be booted out on their butts. 


 
For example, a question for Democrats might be: 


 


Which policy is progressive? 


 
A) School privatization 
B) Fracking on native lands 
C) Drone strikes 
D) Universal healthcare 


 


And an example for Republicans: 


 
Which policy is fiscally responsible? 


 
A) School privatization 
B) Tax cuts for billionaires 
C) More unnecessary wars  
D) Investing in infrastructure  


 
The answers are both D and that’s because this test would be in high De-mand! Get it? 


 
Think of what we could do with these scores! 


 
Lawmakers could tout their assessment achievements as they campaign. 


 
They could say, “Vote for Sam Smith. He got an Advanced Score on the Democratic System of Statesperson Assessments (DSSA).”  


 
Or “Don’t vote for Megan Mission. She only scored a Satisfactory on the Partnership for Assessment of Republicanism for Congress or Klan (PARCK).” 


 
What an improvement that would be! 


 
Finally, we wouldn’t have to rely on a politician’s voting record or campaign contributions or platform….  We could just look at the score and vote accordingly. 


 
But who would we get to make and grade the tests? 


 
It couldn’t be the politicians, themselves, or even their respective political parties. That wouldn’t be standardized somehow.  


 
If we can’t let teachers create tests for their own students, we certainly can’t trust politicians to do the same for their fellow campaigners. 


 
I guess we could task the testing corporations with making these assessments, but that’s a conflict of interests. We should instead rely on the educational experts, people with the credentials and the most experience actually giving standardized tests. 


 
And that would be…. Classroom teachers


 
So these tests should be written by the National Education Association (NEA) and American Federation of Teachers (AFT).  
 


But, of course, this isn’t free. We’ll have to pay these test-creators, and pay them handsomely.  


 
That’s billions more dollars spent on assessment. What an expense! What a waste of tax dollars! 


 
Still, can we really afford not to?  


 
I’m sure would-be lawmakers would like a leg up on the competition, so the teachers’ unions could make workbooks and software packages and apps and teach remedial courses to help folks pass the tests. That would probably bring in more money than the tests, themselves.  


 
And since the teachers would get to grade the assessments, they could make sure the scores are curved so only a very limited number pass each year. We can’t have grade inflation, after all.  


 
What would the teachers do with this money, I wonder?  


 
Well, they could reinvest it in our schools.  


 
See? We’ve just solved two problems at once.  


 
No more under-resourced schools. No more educational inequality. Every school in the country could be like the Taj Mahal!  


 
And all of this just because of standardized testing! 


 
Maybe the lawmakers have the right idea in prioritizing high stakes testing! 


 
Or maybe they understand the value of benefiting from the testing industrial complex and not being subjected to it. 


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!


 


 
 
 
 
 
 
 
 

School Accountability Begins With the People Who Make the Rules: A Code of Conduct for Politicians and Test Makers

thumbnail_Screen Shot 2019-03-18 at 1.17.54 PM

 

Standardized testing is all about accountability.
 

We’ve got to keep schools accountable for teaching.
 

We’ve got to keep students accountable for learning.

 
It’s kind of a crazy idea when you stop to think about it – as if teachers wouldn’t teach and students wouldn’t learn unless someone was standing over them with a big stick. As if adults got into teaching because they didn’t want to educate kids or children went to school because they had no natural curiosity at all.
 

So we’ve got to threaten them into getting in linestudents, teachers: march!

 
But that’s not even the strangest part. It’s this idea that that is where accountability stops.

 
No one has to keep the state or federal government accountable for providing the proper resources.

 
No one has to keep the testing companies accountable for creating fair and accurate assessments.

 
It’s just teachers and students.
 

So I thought I’d fix that with a “Code of Conduct for Politicians and Test Makers.”

 
After all, that’s what we do when we want to ensure someone is being responsible – we remind them of their responsibilities.
 

You see, the state and federal government are very concerned about cheating.

 
Not the kind of cheating where the super rich pay off lawmakers to rig an accountability system against the poor and minorities. No. Just the kind of cheating where teachers or students try to untie their hands from behind their backs.

 
They’re very concerned about THAT.

 
When you threaten to take away a school’s funding and fire teachers based on test scores, you tend to create an environment that encourages rampant fraud and abuse.

 
So the government requires its public servants to take on-line courses in the ethics of giving standardized tests. We have to sit through canned demonstrations of what we’re allowed to do and what we aren’t allowed to do. And when it’s all over, we have to take a test certifying that we understand.
 

Then after we proctor an exam, we have to sign a statement swearing that we’re abiding by these rules to ensure “test security.”
 

This year, for the first time, I’m supposed to put my initials on the answer sheets of all of my students’ Pennsylvania System of School Assessment (PSSA) tests to prove….  I don’t know. That I was there and if anything went wrong, it’s my fault. Burn the witch. That sort of thing.

 
Even our students have to demonstrate that they’re abiding by the rules. Children as young as five have to mark a bubble on their test signifying that they’ve read and understood the Code of Conduct for Test Takers.
 

I still don’t understand how that’s Constitutional.

 
Forcing children to sign a legal document without representation or even without their parents or guardians present – it sure looks like a violation of their civil rights.
 

But that’s what accountability looks like when you only require certain people to be accountable.

 
So back to my crazy idea.
 

Perhaps the corporate flunkies actually designing and profiting off these tests should be held accountable, too. So should lawmakers requiring all this junk.
 

Maybe they should have to sign a “Code of Conduct for Politicians and Test Makers” modeled after the one the rest of us peons have to use to sign our lives away.
 

Here’s how it might look:

 

CODE OF CONDUCT FOR POLITICIANS AND TEST MAKERS:

 

Do…

 

 

-Listen to the complaints, concerns and criticisms of parents, teachers and students about the questions and assessments you’re creating.

 
Ask advice from education researchers and all stakeholders to ensure the questions you’re designing are backed up by psychological, neurological, sociological and all associated research on child development.

 
-Read each question you create carefully to ensure it is not simply multiple choice and instead assesses deeper understanding of concepts and skills. Also be sure that all open ended items and writing prompts allow for a multitude of answers and don’t simply ask the test taker to guess what the test maker is thinking.

-Be careful when writing your questions to make sure you have NOT left misspellings or grammatical mistakes in place that would unnecessarily increase confusion for test takers and thereby invalidate the results.

 
Check and double check to make sure you have created a fair and accurate assessment before giving it to students to evaluate their learning.

 
-Report any suspected cheating to a certified watchdog group and the media if you find any evidence or have any suspicion that anyone has created test items purely to enrich the corporation you work for or the privatization-testing-prison industrial complex.

 
-If you’re a lawmaker who’s voted for annual testing, take the assessment annually yourself to prove that it is an adequate test of basic student knowledge of which as a duly elected representative you should clearly pass. Publish your score prominently in the media to prove the test’s efficacy.
 

DO NOT…

 

 

-Have notes in your possession from special interests such as (but not limited to) the testing corporations, the publishing industry and/or the ed tech industry before, during or after voting for legislation that promotes the very same standardized testing and testing remediation on which these industries profit.
 

-Have any (approved or otherwise) electronic devises that tabulate previous test questions and prescribe reusing those that have resulted in answer curves consistent with previous tests thereby continuing the trend of selecting against students of color, the poor and other groups and/or subgroups.

 
-Share inside information about the test or previous test questions with anyone that you do not also make freely available to the public. It is not your job to create a remediation market and/or cash in on the testing apparatus you are creating.
 

-Dissuade students from talking with others about  questions after the test. They are human beings with rights. It is perfectly natural for them to talk and harmless for them to do so after a testing session is over.

 

 
-Take notes on individuals criticizing or opting out of testing with the purpose of punishing them for their dissent. This is a democratic process and you will welcome discussion, criticism and dissent.
 
-Use the bubbles in the answer booklet for anything at all. In fact, throw them away. It’s 2019. Surely we can find a better way to assess children than multiple choice questions answered by filling in bubbles on a sheet of paper with a number 2 pencil!

 
Conduct an online testing session unless you are 100% positive that the information input by the students and collected about the students is secure, will be secure and cannot be shared with advertisers, corporations or any other entity, and only with a certainty that this data will not be put in any database in a manner that could identify individual test takers or otherwise violate privacy laws.
 
-In fact, you know what? Don’t use standardized tests at all to assess student learning – especially not connected to high stakes. Instead rely on classroom grades and teacher observations for student assessment. Use indexes and audits of school resources to determine whether they are doing their best to teach students and whether lawmakers have done enough to ensure they are receiving fair and equitable resources.
 

 

What do you think? Would any of them sign off on this?

 


 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-2