Standardized Tests Lie

Whom do you trust?  


 
So much in life comes down to that simple question. 


When two groups disagree, which one do you believe? 


If it’s a matter of fact, you can look at the raw information yourself and come to your own conclusions. But often the matter under discussion is so complicated and the field so rarefied that you can’t hope to make a rational decision alone.


 
So we appeal to the experts.  


 
In education, the experts are basically classroom teachers and standardized testing companies.

Sure there are students who experience all of their own educations. But that experience is by definition subjective and applies only to them. Something similar can be said of parents who experience the process second hand through their children. They can make decisions about the individuals in question but don’t have enough information to fully generalize about the entire system.

Those with the most exposure to the most diverse educational experiences are teachers and testing companies. 


 
On the one side you have teachers who instruct students for at least 180 days a year, giving formal and informal assessments throughout to provide a classroom grade. On the other you have the testing companies that give students a single assessment over a period of hours or days. 


 
And often they come to different conclusions.  


 
Many times children get high classroom grades but low scores on the standardized test.  


 
So let us ask the question that the media never does: which should we believe?  
 


News sources almost always act as if there was no question in the first place. They invariably go with the test as if it were a pure matter of fact. But it isn’t. There are economic reasons for this sleight of hand – not academic ones. After all, the huge media conglomerate that ultimately pays the journalist’s salary often owns the standardized testing company or the publishing house or technology company that provides remediation for that particular assessment.  


 
It’s also more interesting to write about failing test scores than kids doing well in school. An alarmist narrative certainly sells more papers. Would there even be a story if a reporter wrote “Majority of Kids Pass Courses and Graduate Again This Year”? 


 
So we’re bombarded with doomsayer stories about failing schools, failing teachers and failing students.

 
 
Education Week ran a story last week titled “U.S. Parents Think Reading Instruction Is Going OK—Until They See National Test Results.”  


 
And another called “Students’ Grades May Not Signal Actual Achievement, Study Cautions.” 


 
It’s too bad the article never explains why we should take standardized test scores over classroom grades. 

The first story even centers on a misreading of test scores.

The test in question is the National Assessment of Educational Progress (NAEP) . Sometimes called the Nations Report Card, the assessment is given to a random sampling of elementary, middle and high school students in participating countries to compare the education systems of nations.

According to the latest NAEP results, about 2/3 of US students read below “proficient.” And when parents are told this, a new survey finds they lower their opinions of students’ reading abilities.

However, what the article fails to mention is that “proficient” on the NAEP is a misleading benchmark and always has been.

On the NAEP, “proficiency” does not mean students can read at grade level. Being able to do that would actually earn them a “basic” score.

If you read the NAEP’s own Website about how to interpret the scores, you’d see that:

“The NAEP Proficient achievement level does not represent grade-level proficiency, but rather competency over challenging subject matter. NAEP achievement levels are to be used on a trial basis and should be interpreted and used with caution.”

So why are journalists continually spreading false claims about the tests that the test makers, themselves, dispute? And why have they been doing so for decades?

Part of the problem is the NAEP has not revised a purposefully misleading grading scale since it was first given in 1969. As much as representatives will dispute the interpretation of scores if pressed, they could do something about it if they cared to do so. They could even put out press releases about how the organizations’ scores are being misread. But that never happens. They remain quiet unless you ask them specifically about the scores and – surprise – education journalists are not very curious about this issue. It would ruin their stories!

Only about 1/3 of US students were below NAEP’s Basic score. In other words 2/3 of US students read at or above grade level – the exact opposite of what journalists are reporting based on their interpretation of the results! However, even the meaning behind that is debatable because each state has a different definition of reading at grade level. A more accurate metric might be reading at age level, but NAEP scores don’t really correlate with it. Good luck getting anyone interested in reading about that.

Then we have the article about student grades not showing actual learning achievement.

The story is about schools in Washington state where students earned increasingly higher classroom grades but lower end-of-the-year standardized tests scores.


Why did the education journalists decide the standardized test scores were accurate and the classroom grades were not?

Good question, but you won’t find the answer in the story. This is taken as an article of faith.

Obviously the standardized tests scores are better. They were given by a corporation. Classroom grades were given by teachers.

This just goes to show the media’s glaring bias against educators and in favor of big business.

According to the U.S. Bureau of Labor Statistics, the average salary of public school teachers in Pennsylvania (my home state) is between $53,000 and $59,000 per year.

Meanwhile, more than $1.7 billion is spent on standardized testing in the US each year, according to a study by the Brown Center on Education Policy at Brookings. Another $669 million is spent on elementary assessments. Between $34-65 per student per year is spent by the states on standardized testing.

To put that in perspective, perhaps the biggest standardized testing corporation, Pearson, reported revenues of $5.511 billion and profits of $762 million in 2018. That doesn’t include $89 million in additional profit for Pearson from its ownership stake in Penguin Random House Publishers, a major world school textbook publishing company.

Pearson’s main competitor, Educational Testing Services (ETS), reported revenues of $2.1 billion for the same time period. And the College Board, maker of the SAT test, reported another $1.068 billion in revenue in 2017.

Standardized testing companies want people to believe there is a crisis in our public schools and that children are not learning well unless they are held accountable by the same standardized tests these companies make and manufacture. These companies make the tests, grade the tests and then sell school remediation materials when kids don’t pass.

There are certainly real problems with our educational system.

For instance, the U.S. is one of the only countries in the world – if not probably the ONLY country – that funds schools based largely on local taxes. Other developed nations either equalize funding or provide extra money for kids in need. In the Netherlands, for example, national funding is provided to all schools based on the number of pupils enrolled. But for every guilder allocated to a middle-class Dutch child, 1.25 guilders are allocated for a lower-class child and 1.9 guilders for a minority child – exactly the opposite of the situation in the U.S.

If we want to compare the US to other countries, this is a perfect place to start.

But a focus on test scores obscures the differences.

Virtually all of the top scoring countries taking the NAEP exam have much less child poverty than the U.S. If they had the same percentage of poor students that we do, their scores would be lower than ours. Likewise, if we had the same percentage of poor students that they do, our scores would go through the roof! We would have the best scores in the world!

NAEP scores just mirror back to us our child poverty rate – that more than 1/3 of our students live below the poverty line and more than half of public school students qualify for free or reduced lunches.

But this myopic focus on standardized tests also blinds us to the ways our system is superior to that of many other countries.

We do something that many international systems do not. We educate everyone! Foreign systems often weed children out by high school. They don’t let every child get 13 years of grade school (counting kindergarten). They only school their highest achievers.

So when we compare ourselves to these countries, we’re comparing ALL of our students to only SOME of theirs – their best academic pupils, to be exact. Yet we still hold our own given these handicaps!

This suggests that the majority of problems with our public schools are monetary. Pure and simple.

A 2018 review by Northwestern University found that in 12 out of 13 studies increased spending had a positive effect on student outcomes. And that result has been verified by studies since then in California, Texas, Wisconsin and other states.

Money makes a difference.

Money spent on students – not more testing.

The bottom line is that standardized tests are not accurate assessments of student learning. They are corporate propaganda.

Standardized tests lie, and the corporate friendly education media feed us those same lies as if they were fact.


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

School Directors Shouldn’t Double Down on PA’s Keystone Exam Circus 

 
Ladies and Gentlemen, children of all ages, welcome to the Commonwealth of Pennsylvania’s Keystone Exam Circus! 


 
Here you will see children of 14 to 18-years-old perform death defying stunts just in order to graduate! 
 


They’ll jump through the flaming hoop of the Algebra I Exam! 


 
They’ll hop through the spiked hoop of the Literature Exam! 


 
And they’ll even bound through the nitroglycerine filled hoop of the Biology Exam! 


 
All this just so they can qualify for a diploma they’ve already earned by passing 12 years or more of coursework
 
 


Now isn’t that the greatest show on Earth!!!!!!? 
 


 
Apparently, some school directors must think so. Because they’ve decided to force all the students in their districts into the center ring.  


 
 
Because as stupid as the state law is – and it is very, very stupid – it doesn’t require all students to pass these tests to graduate. Kids don’t even have to take the tests if they don’t want.  


 
If they so choose, they may skip one or more of these ridiculous assessments in favor of an alternative
 


They can take a different test like the SAT, ACT, etc., achieve an industry-based competency certification, successfully complete a service-learning project, or finish an internship or cooperative education program, among other metrics.  
 


Sure! It’s a glorified fetch quest full of unnecessary complications and anxiety, but it’s better than being forced to pass a cockamamie fill-in-the-bubble corporate boondoggle


 
Unfortunately some school board members don’t see it that way.  
 


It’s not that they want to remove this senseless hurdle from students who have already proven they’ve learned the prerequisite skills to graduate. They still want kids to go on a wild goose chase, but they can’t stomach the idea of kids picking their own goose.  


 
To switch back to the metaphor with which I started this piece, they would rather students jump through the standardized testing hoop – the one made by Data Recognition Corp (DRC), the Minnesota corporation that writes the Keystone Exams and has been gorging on $533 million in Commonwealth tax dollars for the last decade. Not the hoop that pays the College Board or one that – God forbid – doesn’t make a huge corporation any richer.


 
Why?  
 


It’s beyond me.  


 
Maybe they think forcing students down the DRC path will help improve district academics.  


 
Maybe they love fill-in-the-bubble tests.  


 
Or maybe they just hate kids…  
 

I don’t know. 
 


But one thing is certain – the Keystone Exams are a costly mistake the state forces taxpayers to fund and kids to endure unnecessary gatekeeping and narrowed classroom curriculum.  
 


The whole mess started when the federal government reauthorized its education law formerly called No Child Left Behind (NClB). That law required kids to take standardized tests in middle school and once in high school. When Congress changed the name to the Every Student Succeeds Act (ESSA), it allowed more flexibility in the high school test. It didn’t just have to be a standardized test. The state could pick from all kinds of options. Pennsylvania chose one of almost everything including new standardized tests – the Keystones!

But the state legislature couldn’t decide whether to make it a graduation requirement until just last year.
 


Students who graduated in May (2023) were the first required to pass these exams or qualify with an alternate assessment, and the data is still out on its full impact. 


 
A report conducted by The Philadelphia Education Research Consortium estimated that only about one third of city students would meet graduation requirements by passing the Keystone Exams. Specifically, nearly 50 Philadelphia high schools had less than 25% of their students with Keystone proficiency rates sufficient to graduate. The report concluded that some additional percentage of students would graduate with alternate assessments but there was no way to estimate what percentage that would be. Would fewer graduate? The same? More? No one knows yet.  

Given this uncertainty, it’s difficult to fathom why school board members  would want to require tests that may stand in the way of students’ future success. 

This is especially true in districts serving poorer families. 

Kids in wealthier districts almost always do better on the Keystone Exams than those in poorer districts, according to a report by State Auditor General Eugene DePasquale and State Sen. Andy Dinniman

In fact, the report notes that of the 100 state schools with the highest scores, only five were located in impoverished districts —where the average household income is below $50,000. 


 
Why would any district – especially those serving students with lower socioeconomics – feed kids into such a system, especially when they don’t have to play that game? 


 
“The Department of Education itself said they [the Keystone Exams] are not an accurate or adequate indicator of career or academic readiness,” Dinniman said. “…These tests have faced opposition from almost every educational organization that exists.” 

He’s right. 

A 2019 report conducted by the state Legislative Budget and Finance Committee found that state educators (both principals and classroom teachers) overwhelmingly disapprove of the state’s standardized tests. That includes the Pennsylvania System of School Assessment (PSSA) tests given in grades 3-8 and Keystone Exams given in high school. Educators think these tests are ineffective, expensive and harmful to district curriculum and students. 

When it comes to the PSSAs, 76% of teachers and 67% of principals said the tests were bad assessments. 


For the Keystone Exams, 60% of teachers and 45% of principals said the tests were ineffective indicators of student achievement. 

 
Both principals and teachers said their curriculum had been narrowed to prepare students for PSSAs and Keystone Exams. Instead of going into more depth on regular classwork or learning new skills, the focus shifts to teaching to the tests. 


 
Taking the tests also eats up valuable class time. Administering the assessments takes between 5.7 to 8 days for each kind of test – the PSSA and the Keystone Exams, according to principals. 

In addition, the report details the cost of giving these tests. In fiscal year 2017-2018, the state Department of Education paid $42.17 million for these tests.  

This is part of a national trend

“Standardized tests and test preparation have subsequently become big business and that multibillion dollar business continued to grow since the enactment of NCLB and the subsequent enactment of ESSA. According to the Pew Center on the States, annual state spending on standardized tests increased from $423 million before the NCLB (enacted in 2002) to upwards of $1.1 billion in 2008 (to put this in perspective this reflects a 160 percent increase compared to a 19.22 percent increase in inflation during the same time period). A more recent study by the Brown Center on Education Policy at Brooking put the cost at upwards of $1.7 billion in 2011 related to state spending on standardized tests.” 

 


In just one year (2019) the state paid DRC $17.6 million to administer and score the Keystone Exams, said DePasquale. Between 2015 and 2021, the state spent nearly $100 million on the exams. And if we add in the PSSA, the corporation has collected $533 million from the Commonwealth over the last decade, DePasquale said
 
 


Why are some school board members so dead set on making sure we keep paying them?  

 


Federal law requires some kind of accountability measure before graduation whether it be a standardized test or something else. Why can’t the state simply use classroom grades for this measure? These are the daily assessment of student learning. How does it help students by inserting a corporation to make more money off of taxpayers?  

 


The whole process is a complicated, unnecessary circus with our kids in the role of trained monkeys spinning plates so big business can slurp up more of our money. 


 
I hope school directors will begin to understand this and not give in to the standardized testing spectacle. 
 


It’s time for someone to send the clowns back home. 


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

What Can Educators Learn from “Zelda: Tears of the Kingdom”?

So there I was, stranded at the bottom of a pit in the depths.

Shadows all around me, puddles of glowing purple gloom everywhere, the burbles of monsters slowly approaching…

No time to climb out – let’s build a hover bike!

And before you know it, I was zooming up and outta there!

Until I ran out of battery and went careening back to the ground. But I was out of the pit!

“The Legend of Zelda: Tears of the Kingdom” is a really great game – even for a nearly 50-year-old public school teacher like me.

As classes dwindled down in June and the summer approached, I noticed some of my students who had finished their work bringing the game in on their portable Nintendo Switch consoles.

Like me, they were enthralled by the level of choice the newly released game presents.

Rarely is there one answer to a problem.

The previous Zelda game in the series, “Breath of the Wild” (2017), threw the doors wide by giving players an open world to explore. No longer did you have to go down a linear path of which dungeons to complete in which order to defeat the bad guy. You could go in whatever direction you wanted, doing almost anything in whatever order you pleased.

The new game takes that even further. “Tears of the Kingdom” gives you three open worlds to explore and offers you the ability to build a wide range of contraptions to create your own solutions to problems.

For example, when I was stuck in that pit, I could have tried to climb out, I could have stood my ground, or I could have built almost anything imaginable that might help.

It’s that kind of increased choice that makes this game special and of particular interest to educators.

After all, this is something many of our students enjoy doing in their free time. The game sold 10 million copies in its first three days, becoming the fastest selling Nintendo game in history. That’s roughly $700 million and growing.

This doesn’t mean edtech companies should rush in to take over. Teachers and public schools are still the best way to educate students.

But the way I see it, if teachers can make learning more intrinsic and exciting, it’s a plus. These are my three major takeaways from the experience:

1) Power of the Sandbox

There are many types of video games.

Some are focused on action – such as shooting down the most enemies. Some focus more on puzzles to solve. Yet others are focused on building things like farms or homes or even civilizations.

Sandbox games are more self-directed. The idea is to create a space where gamers can do pretty much whatever they want. There’s no imposed objective. You’re given simple tools that you can easily see how to manipulate and you’re left to decide how to use them.

It’s based on the metaphor of leaving small children in a sandbox and just letting them play.

The most popular model is the game Minecraft. In it, players are thrust into a world made entirely of blocks that can be combined and recombined to build anything they want. It’s almost like a virtual world of LEGO bricks.

Players build structures like dream homes or space ships. Some tell stories. Some recreate real or imagined structures like the Eiffel Tower or the Death Star from “Star Wars.”

While there are also dungeons you can fight through to get more materials for your creations, the main emphasis seems to be on building.

Minecraft, in itself, is a very popular game and has been so since 2011.

However, “Tears of the Kingdom” takes this a step further by making the sandbox a tool in a world with a specific objective.

Like most Zelda games, you play as a character, Link, who has to save the princess, Zelda, and the kingdom of Hyrule from a bad guy, Gannondorf. The difference is that one of your tools to do that in this game is an ability to combine certain items together into structures.

These aren’t just blocks. They can be as complex as fans or lasers.

You can try to build a flying machine, but you have to make sure the fans or rockets or whether you’re using to propel them are pointing exactly where you want them, don’t consume too much battery, etc.

It takes design, testing, a knowledge of basic physics, etc.

For example, one of my first attempts at a plane kept flipping over. The reason – my fans were placed in opposite directions so that the lift given by one was counteracted by the other. Another device only went straight up. The reason – rockets only provide lift in one direction and quickly give out.

Players can easily get lost in building things. Sometimes that can seem way more interesting than the overall objective of beating the bad guy and winning the game.

However, there are certain game objectives that help you become a better builder – give you longer battery life, etc. So the game rewards you for progressing along each route – the story objective and the sandbox.

It’s a fascinating game loop that may keep this adventure fresh with replayability long after the main objective is complete.

So how does that impact education?

We know students like self-directed learning. If they are at all interested in the subject, giving them the power of following their natural curiosity can lead to amazing results.

This is often used in STEM lessons, where kids are given an objective and various tools and told to try to figure out how to achieve that objective. Who can build the highest tower that won’t fall over? Who can build the fastest race car on this track? Who can build a boat out of cardboard and duct tape that will float longest in a swimming pool? Etc.

However, it can also be done in other disciplines. You might study how the writer Langston Hughes communicates his message in a poem like “Mother to Son” and then ask students to do the same kind of thing in their own poem. You might read several stories and poems by a single author like Edgar Allan Poe and then ask students to find similarities between the author’s work and life.

In each instance, it’s not about just giving students tools and leaving them alone to discover what to do with them. It’s up to the teacher to provide a goal or a direction in which to go. The students take it from there.

The freedom of the sandbox by itself can be thrilling to some students in certain disciplines. But it can also be terrifying. Both aspects are necessary to reach the most students. When learning can be both intrinsic but directed, that’s when students get the greatest results.

We often pretend that students can do just as well without instruction – and there can be marvelous gains by some students in this way. However, teachers are there for a reason. We know the curriculum and many avenues to understanding it. We can point students many ways to understanding that they might not discover on their own.

Games like “Tears of the Kingdom” show the importance of both choice and direction.

2) Importance of a Learning Community

One of the things I was surprised about the most in “Breath of the Wild” and this new Zelda game is the way each created an online gaming community.

In particular with “Tears”, I found several YouTubers who focused on the game and made videos about nearly every aspect of it.

There were walk-throughs of various parts of the game: how to find different armor, defeat bosses and mini-bosses, build the best things, etc. However, there were also videos focused just on individual’s personal experiences with the game and even conjectures on the lore.

It is unclear how some of the elements from the first game impact the second that the developers kept intentionally vague. The community of players stepped in to fill in these gaps with theories that would put the best literary analysis to shame.

For example, the first game was full of Sheika Shrines. In the second game, the shrines were gone from most of the same locations. Instead there were new Zonai shrines in disparate locations. Why the discrepancy? There seems to be a growing consensus that the Sheika shrines were either dismantled by the Hyrulians and/or destroyed by Gannondorf when he reawakened to begin the current upheaval.

All of this really enhances the gaming experience. Not only do you feel less isolated, but you feel validated. You’re part of the act of making meaning out of the whole experience – listening to others, adding to the conversation, etc.

For example, there are certain enemies that just scared the heck out of me – chief among them were Gloom Hands. These are puddles of slime that come out of nowhere and shoot hands out at your character that can squeeze you to death in seconds.

Then I saw several videos where YouTubers explained how Gloom Hands freaked them out, too, (some complete with funny videos of them screaming when being ambushed by these creatures) and how to deal with them.

By watching these videos, I got to be much better at the game than I would have been otherwise. Some vloggers were so calm and reassuring when they said these sorts of creatures were easy to deal with and nothing to panic over that I felt way more confident. Moreover, if I did come across something that gave me trouble, I knew where to turn for help and guidance.

How important this is in the classroom!

Teachers often fill this role, but if we can create a community in the classroom, itself, that is even better. When students can discuss assignments and help each other through obstacles, that is so much better than the teacher being the only person in a position to help.

I try to foster as much discussion as possible in my classes through Socratic Seminars and informal groups. However, if you can get small group work to function while still being focused and productive, you can increase this aspect, too.

It’s all about the classroom you can create. You need shared values, empathy and students who understand how to best interact with each other. It’s easier said than done but a worthy goal for sure.

3) The Danger of Outside Assessment

This may be the most overlooked lesson from games to the classroom.

One of the biggest differences between the gaming and school experience is whether someone is looking over your shoulder or not.

In a video game, the player decides what he or she wants to get out of the experience. Do you want to simply beat the game? Or do you want to 100% it – achieve every goal the programmers put into it.

How long you take and how much you complete is up to you.

Sometimes the gaming community can contribute to this by giving opinions about which goals are worthy of completion, etc. However, whether you have achieved everything you want and the ultimate assessment of such things are really up to the individual.

Things are different in class.

On one level, students are assessed by their teachers. They grade assignments, give tests, etc. However, this is similar to the game, itself. When you fight Gannondorf, the game tells you whether you’ve beaten him and sometimes how well this is accomplished.

For example, there are a few different endings to the game that you can get depending on how well (or completely) you achieved certain objectives.

I think that’s similar to what the classroom teacher does. It’s part of the experience taken in context and (hopefully) well understood by the student.

The difference comes from forces outside the classroom.

Students don’t just achieve grades. They are also subject to standardized tests. These are assessments created out of context of the classroom, graded by hired hands, that are used to determine how well the curriculum has been learned.

They are artificial, biased and politically motivated.

Imagine if after playing a video game someone from the government had to come in and give you a score. Imagine if they made you play another (different) game to determine how well you did on this one. Maybe you feel like you aced “Tears of the Kingdom” but they said you didn’t do so well on “MarioKart” and thus failed the experience.

Outside assessment can kill intrinsic learning. It can make everything extrinsic – will this be on the test? What do I need to pass the test? Etc.

It would poison the video game experience as it poisons the classroom one.

We only allow it because of strange outdated ideas about learning and psychology. We pretend it’s all behaviorism – students given this stimuli should produce this response. We know that’s not how the human mind works, but politics and capitalism refuse to let us move beyond it.

Someone is making money off of this and we can’t disrupt that with real reform.

Perhaps if we looked more closely at how things function in the world of video games, we’d have a better idea of how to change things for the better in the classroom.

To better understand learning, we should look to the whole child – and the whole child’s experience outside of school.

This includes Zelda, Gannondorf and Link.


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

Forgotten Pre-Covid Report Reveals Standardized Testing Weaknesses in PA

The majority of teachers and principals in Pennsylvania hate standardized tests.

An increasing number of parents are refusing to allow their kids to take the tests.

And there may be better alternatives to the state’s Keystone Exams.

These were just some of the key findings of a blockbuster report from June 2019 by the state General Assembly’s Legislative Budget and Finance Committee.

The report, “Standardized Tests in Public Education” was published about 9 months before the Covid-19 pandemic hit.

It effectively got lost in the chaos that followed the global pandemic.

However, now that things are returning to some semblance of normalcy, it seems that bureaucrats from the state Department of Education (PDE) are taking the wrong lessons from the report while the legislature seems to have forgotten it entirely.

The report was conducted because of legislation written by state Sen. Ryan P. Aument (R-Lancaster County). It directed the Legislative Budget and Finance Committee to “study the effectiveness of standardized testing, including the Keystone Exams and SATs, and their use as indicators of student academic achievement, school building performance, and educator effectiveness.”

The key findings are as follows:

1)The majority of principals and teachers disapprove of the state’s standardized tests – both the Pennsylvania System of School Assessment (PSSA) tests given in grades 3-8 and Keystone Exams given in high school. They think these tests are ineffective, expensive and harmful to district curriculum and students.

2) State law allows parents to opt their children out of testing for one reason only – religious grounds. Parents are using this religious exemption in increasing numbers. This puts districts in danger of violating federal participation and accountability standards.

3) It has been suggested that the state allow two additional reasons for parents to opt their children out of testing – philosophical grounds and health concerns. It is unclear whether doing so would increase overall opt outs or not.

4) The federal Every Student Succeeds Act (ESSA) passed in 2015 allows the use of the SAT and/or ACT test to take the place of high school standardized testing. It has been suggested the Commonwealth replace the Keystone Exams with these tests. The report finds the ACT and/or SAT would successfully determine college readiness and reduce the overall amount of standardized testing. However, this would not allow other uses of current state tests like evaluating teacher effectiveness and school building performance.This may not matter though because the report also casts doubt on whether the current tests (PSSA and Keystone Exams) do an adequate job of assessing teacher or building performance now or even if student tests can be accurately used to evaluate teachers and schools.

There’s a lot of information here. Let’s look at each finding in turn.

1) PA Educators Hate Standardized Tests

When it comes to the PSSAs, 67% of principals and 76% of teachers said the tests were ineffective indicators of student achievement.

There was slightly more support for the Keystone Exams. This time 45% of principals said the test was an ineffective indicator of student achievement (with 27% saying the tests were effective). Meanwhile, 60% of teachers said the test was ineffective.

Both principals and teachers said their curriculum had been narrowed to prepare students for PSSAs and Keystone Exams. Instead of going into more depth on regular classwork or learning new skills, the focus shifts to teaching to the tests.

Most principals (approximately 80-90%) said that students are taught test-taking skills, and their schools administered practice tests, bench-mark tests, and/or diagnostic tests to prepare students for the PSSA exams. This held for teachers, too, with 81-88% saying they teach test-taking skills and administer practice tests. Principals also said the costs of this additional test prep varied from $200 to more than $100,000.

Taking the tests also eats up valuable class time. Administering the assessments takes between 5.7 to 8 days for each kind of test – the PSSA and the Keystone Exams, according to Principals.

In addition, the report details the cost of giving these tests. In fiscal year 2017-2018, PDE paid $42.17 million for these tests. This is part of a national trend:

“Standardized tests and test preparation have subsequently become big business and that multibillion dollar business continued to grow since the enactment of NCLB and the subsequent enactment of ESSA. According to the Pew Center on the States, annual state spending on standardized tests increased from $423 million before the NCLB (enacted in 2002) to upwards of $1.1 billion in 2008 (to put this in perspective this reflects a 160 percent increase compared to a 19.22 percent increase in inflation during the same time period). A more recent study by the Brown Center on Education Policy at Brooking put the cost at upwards of $1.7 billion in 2011 related to state spending on standardized tests.”

2) Opt Outs on the Rise

Many states allow parents to opt their children out of standardized testing. Some do so in cases of a physical disability, medical reasons, or emergencies. A few allow opt-outs based on religious objection – like Pennsylvania. Some states allow opt-outs for any reason whatsoever.

The religious exemption is not used widespread throughout the state and most schools meet the 95% participation rate required by the federal government. However, use of the religious exemption is definitely on the rise – enough so that the authors of the report find it alarming:

“Meanwhile, as previously indicated in this section, schools throughout the country are experiencing and grappling with an increase in the number of parents seeking to have their children opt-out of standardized testing now that new state assessments have been implemented pursuant to the federal requirements. Pennsylvania is no exception to this trend and is also experiencing an increase in the number of parents utilizing the religious opt-out.”

For the PSSA tests, opt outs increased from 2013-14 to 2016-17. However, total numbers in school year 2017-18 decreased sightly.

Opt outs went from 1,886 to 6,425 to 15,644 to 19,012 to 16,961.

During the same time period for the Keystone Exams, opt outs steadily increased each year but were at lower overall rates.

For the high school test, opt outs went from 382 to 666 to 1,000 to 1,313 to 1,633.

These are vitally important figures because opt out data is rarely tabulated and released to the public. Many media accounts actually state the opposite of the data in this report – in particular that opting out has decreased since Congress passed the ESSA in 2015. Apparently the media got this one wrong.

Though the religious opt-out is the only reason specifically allowed in state Chapter 4 regulations, PDE reports there are five additional ways that students end up not taking the tests:

1) Other Parental Request – parents simply refusing to let their kids participate but not objecting based on specifically religious reasons.

2) No Attempt and No Exclusion Marked – students who are given the test but do not answer enough questions to receive a score.

3) No Test – no test record on file for unknown reasons.

4) Extended Absence – a student missed the testing and make-up window due to absences.

5) Other – does not fit any of the other categories.

Federal law – in particular No Child Left Behind (NCLB) and subsequent reauthorizations of that legislation – requires states to use student participation in standardized testing as a factor in a state’s accountability system. According to the report, any district with less than 95% of students taking the test should be “addressed.”

The report does not go into any further detail about what this means, other than to say that falling under 95% can:

“…ultimately result in a reduced achievement/proficiency measure… If the student participation rate falls below 95 percent, states are required to calculate student achievement/proficiency by dividing the number of students scoring proficiently by no less than 95 percent of the total students (which effectively assigns a score of “0” to all nonparticipants once the participation rate has fallen below 95 percent).”

In effect, the district gets a bad mark on a piece of paper. So what?

Under NCLB, schools with poor performance could receive sanctions like state takeover or lower funding. However, this is extremely unlikely – especially since the passing of ESSA. This newest reauthorization of the law gives states leeway in designing their accountability systems. It leaves the enforcement of this 95% participation rate up to the states, requiring them to develop an accountability plan in the event that a school or district fails to meet this standard.

So a school would only be punished if the state decided to do so. If a state legislature decided to allow parents to opt their children out for any reason at all, they would not have to take any punitive measures. Since the ESSA, the buck stops at the state house door on this one. California, for example, takes note of low participation rates but these rates are not factored into a school’s rating. On the other hand, Florida mandates direct intervention from the state’s Department of Education until participation rates are met.

3) Impact of New Reasons to Opt Out

This is where things get a bit sticky.

The report mentions the idea of expanding the options for opting-out of statewide assessments (e.g., PSSA and Keystone Exams) to include objections based on philosophical grounds or due to health issues.

On the one hand, the authors write “The impact of adding opt-out categories may be minimal.” They don’t know if more people would use the expanded options or if the same numbers who use the religious exemption today might simply divide themselves up among all three options.

The authors worry, however, that new pathways to opt out may increase the total number of people refusing the tests for their children and would reduce Pennsylvania’s participation rate in standardized testing.

This is a particularly troubling paragraph:

“The existence of opt-outs (religious or otherwise) has the potential to negatively impact a state’s participation rates and may potentially impact a state’s [Local Education Agency (LEAs)] and schools achievement/proficiency rate and ultimately the ability of a state to be in compliance with federally required assessments and accountability measures. Furthermore, providing opt-outs and giving parents notice of such has the potential to conflict with the message about the importance of standardized testing. Ultimately placing the state departments of education and local school districts in the potentially awkward position of having to explain why it is important for students to participate in testing (given the federal requirements), while also giving and notifying parents of the opt-out options for their children. In 2015, US Department of Education sent out letters to a dozen states flagging their low participation rates (statewide, or at the district or subgroup level) on the 2014-15 school year assessments and indicated that they needed to create a plan to reduce opt-outs due to low participation rates.”

This seems to be the order of the day at PDE. It’s why earlier this year, school administrators were advised by state officials to crack down on parents opting their children out of standardized tests.

For the first time in 8 years, I, myself, had to jump through several hoops to opt my own daughter out this year when in the past a simple phone call had sufficed.

I was asked to send in a letter, sign a confidentiality statement and go to the school to examine the test before they would excuse my little girl from the tests. It was an unnecessary hassle meant to discourage parents from doing what they thought was right and exercise their rights through state law.

And all of it is based on a cowardly and incomplete understanding of federal law. If Commonwealth schools fall below 95% participation in the test and get a bad mark on a worthless metric, it doest have to matter. No matter how many letters the federal government sends to the state legislature or PDE, the law is clear. The state is in charge here. Our legislature can choose to side with taxpayers, residents, and citizens or with civil servants and strongly worded letters.

4) Replacing the Keystone Exams

There’s not much more to add to this than the initial finding.

The authors of the report say there would be no problem with replacing the Keystone Exams with the ACT or SAT because these national tests would properly assess students’ college and career readiness.

The report is actually pretty shoddy in this regard not really examining the claims of the College Board which makes both tests. The authors just pretty much accepted the College Board’s word wholesale. Nor was their any evaluation of what teachers and principals thought about these tests like there had been for the PSSA and Keystone Exams.

However, the report does make a good point about test reduction. Many students already take the SAT or ACT test, so eliminating the Keystones would reduce the over all amount of tests they had to take.

Also the authors deserve credit for writing about how using student test scores to evaluate teachers and schools is seriously bad practice.

According to the report, 77 percent of principals and 93 percent of teachers said PSSA tests were not effective indicators for teacher evaluations, with similar figures for the Keystone Exams and building performance evaluations.

While everything in the report may not be 100% accurate, it includes important information that should be wider known.

In particular, it matters that the majority of teachers and principals throughout the state disapprove of standardized testing. If we trust our educators at all, we should take steps to reduce or abolish high stakes testing – not continue the same dismal policy that has achieved nothing positive in 20 years of NCLB.

In addition, the report has trustworthy data about opt outs throughout the Commonwealth. Unlike what has been reported in the media, opting out is not on the decline, it is on the rise.

If we value parents and their autonomy to make decisions for their own children, we should at very least expand their ability to refuse the test for their children without having to give anyone a reason. Being parents is reason enough.

The Keystone Exams should be thrown in the trash, because that’s what they are – trash. At very least they should be replaced with the SAT or ACT. Even better to remove any requirement for standardized tests wholesale – and that includes the PSSA.

The ESSA allows states a lot of leeway about how and what accountability system they use. There is no need to worry about some imperial federal power invading Pennsylvania to force our hand with standardized testing. We should call their bluff on this. I’ll bet that if we did so, many other states would do the same.

Standardized testing is another failed education policy. Our legislators would do good to read this report and make up their own minds about it.

Though a few years and disasters have happened since its publication, it doesn’t deserve to be forgotten by the very people who ordered it to be written in the first place.


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

Standardized Tests Hurt Asian-American Students, Too, Though Many Get High Scores

Standardized tests are one of America’s most racist institutions.

Year after year, decade after decade, the poor and people of color get fewer school resources, larger class sizes, narrowed curriculum and lower acceptance to colleges.

And all this simply because they tend to score lower on these types of assessments than richer, whiter people.

That’s no accident.

Yet, as defenders of standardized testing (and racist practices in general) love to point out, not all minorities consistently fail these tests.

In particular, Asian-Americans – taken as a whole – score better than white Americans.

So the tests are totally fair, right? Case closed?

Wrong.

Asian-Americans, who make up roughly 5 percent of public school enrollment nationally, are just as much victimized by standardized testing as any other minority. The only difference is their success is held up as an excuse for upholding this deeply inequitable practice.

It’s kind of like if two people were pitted against each other in a race, and one had to run a mile, and the other had to run 1.5 miles – and the second person actually won. Would that make the race fair?

No. Not at all. But the organizers point to the result as proof that running that extra distance in the same amount of time was nondiscriminatory. So stop complaining!

Weighted practices like these have impacts that go far beyond numbers on a page.

Take the SAT. Asian-American students typically score higher than other students on America’s most popular college gatekeeper as they do on other standardized tests. For instance, among high school students who graduated in 2020, Asian students scored an average of 632 on the SAT math section, compared with 547 for white students. The average math score overall was 523 (out of 800).

What does this really mean?

ASIAN AMERICANS ARE NOT A MONOLITH

First of all, when we talk about Asian-American students doing well on standardized tests, we’re generalizing. We don’t mean all Asians – only a certain percentage of certain kinds of these people. After all, Asia is a pretty big continent.

According to the US Census Bureau, there are roughly 23 million Americans of Asian descent, and the largest subgroups are people of Chinese and Indian ancestry with populations of approximately 5 million each. Next comes people of Filipino (4.2 million), Vietnamese (2.2 million), Korean (1.9 million) and Japanese descent (1.5 million). 

But those are just the biggest subgroups. When you add in all Asian-Americans including Pacific Islanders, you get more than 50 different ethnic groups with varying languages, immigration histories and educational experiences. 

Any generalization about such a diverse group will leave out important details, including test scores.

ALL ASIANS DON’T GET HIGH TEST SCORES

For example, high test achievement is not something attained universally by all people who can trace their parentage through that part of the world. It’s actually much more common for East Asians than others. In particular, we’re talking about people of Chinese, Korean and similar heritages.

If you know anything about those countries, it’s easy to understand why this is so. Historically, these areas have had their own kinds of standardized exams for centuries.

In these countries, college admission often is decided on a single high-stakes test – the gaokao in China or the suneung in South Korea. People whose cultures trace back to these parts of the world are used to engaging in intense test prep as a regular feature of teenage life. So many Asian immigrant parents with ties to these countries often see the SAT or ACT as the equivalent of Asia’s admissions tests and thus engage in test prep as a matter of course, regardless of cost or effort.

This goes far in explaining why Chinese- and Korean-Americans have the highest rate of participation in SAT/ACT test prep – even more than people from other Asian ethnicities.

In one study, more than half of Korean-Americans and 42 percent of Chinese-Americans took an SAT prep course before college compared to 35.6 percent of white students, 32.4 percent of Hispanic students and 40.4 percent of black students. This is true regardless of household income. Affluent Asian Americans were more likely to take test prep, but 46.7 percent of low-income Korean-Americans still took a prep course.

Test prep is a double edged sword. The companies providing such services claim to increase test scores hundreds of points, but average gains are more often in the range of 10-30 points.

East Asian-Americans show statistically significant gains from test prep much more often than others. This is partially due to having better access to adequately funded K-12 schools than other minority groups. They are less likely to attend racially segregated, poorly resourced schools, unlike their Black and Hispanic peers. Even Asians from lower socio-economic backgrounds tend to get more out of test prep than others because they are more likely to attend well-resourced schools than their counterparts in the same socio-economic bracket.

And let’s not forget that test prep companies target Asian-American communities. You’ll find them in urban centers like Koreatown in Los Angeles or heavily Asian suburbs such as the San Gabriel Valley. Advertising material for these services are often in multiple languages or displayed in Asian-language newspapers and ethnic media.

Most of New York City’s 411 prep centers are based in Queens and Brooklyn, “with over a quarter of them… most notably in the boroughs’ Asian enclaves of Flushing and Sunset Park in Brooklyn,” The New York Times reported.

“On the opposite coast, 861 such tutoring centers exist in California’s Orange, Santa Clara and Los Angeles counties, all heavy with Asian-American families,” the article states.

So it’s no wonder why certain Asian-American communities – especially East Asian communities – tend to favor test prep and achieve high standardized test scores.

ASIANS ARE HELD TO UNFAIR STANDARDS

But let us not forget that East Asians are not ALL ASIANS. If you’re unlucky enough to be from other parts of that massive continent or the island chains of the Pacific, the US will still paint you with the same broad brush.

All Asian-Americans – whether of East Asian descent or not – are held to a higher standard in things like college admissions where overachievement is considered the norm and little else is tolerated.

A National Study of College Experience led by Espenshade and Radford (2009) showed that a student who self-identifies as Asian will need 140 SAT points higher than whites, 320 SAT points higher than Hispanics, and 450 SAT points higher than African Americans.

This is unfair to East Asians because it expects them to jump through more hoops than white people or other ethnic groups just to be accepted, but it is even worse for other Asian subgroups.

A 2022 study of the nine-campus University of California – the state with the country’s largest Asian-American population – concluded that Filipino, Thai, Native Hawaiian/Pacific Islander and Laotian students were admitted at below-average rates and that many ethnicities including Samoans and Chamorros, were underrepresented in the system.

Why? They had lower test scores than admissions officials expected.

Such an emphasis on standardized testing is not healthy for students of any nationality. The College Board makes millions of dollars every year with assessments like the SAT and ACT holding the scores up as proof that certain students have what it takes to excel in college or universities.

However, standardized tests do not assess things like critical thinking or even consistent academic effort. As such, those admitted mostly because of standardized achievement have a tendency to fizzle out in certain fields that require more creativity or originality to succeed.

This is a rarely mentioned side effect of Asian-American’s standardized testing overachievement. And it may help to explain why – despite scoring well on standardized tests – Asians don’t complete college as often as students from other ethnicities.

According to an analysis of the 23-campus California State University System, all Asian subgroups were less likely than whites to complete their degrees in four years. There were roughly 78,000 Asians attending the university system in 2016, yet their four-year completion rate was 3% below that of all students. Only a few subgroups – Japanese and Asian Indians – had four-year completion rates that exceeded the average.

If test scores and admissions were all it took to achieve post secondary success, you’d expect college completion to be shared by Asian-Americans across the board.

In reality, college attainment varies significantly within the Asian community. While more than half of Japanese and Korean Americans (and nearly 3/4 of Asian Indian Americans) age 24 or older had a bachelor’s degree or higher in 2019, the same was true for less than 1/5 of their Laotian, Hmong and Cambodian counterparts.

CONCLUSIONS

Therefore, it is highly suspect when standardized testing apologists point to Asian-American test scores as proof the system is fair and balanced.

First of all, it conflates the achievements of mostly East Asians with all Americans of eastern heritage. Second, it demands more of one minority group to be accepted as equal to a white majority.

If standardized assessments were fair tests of academic achievement or ability, there would be no need for such contrivances. If they really showed who would de best in colleges or universities, that would be borne out in graduation rates.

Instead, a closer look at the data shows just how unfairly discriminatory these tests and this system is. Standardized tests of this sort were invented in America as a way to privilege white Europeans from other ethnic groups, and even after a century of revisions, they still function the same way.

Standardized testing should be abolished in favor of more accurate assessments of learning such as classroom grades. Teachers should be unshackled from the need to cater to the testing companies and allowed to emphasize critical thinking, originality and creativity in the classroom.

After all, these are the skills necessary for the jobs of the future – as well as for students to self actualize into the adults they want to be.

In any case, the standardized testing industry can no longer hide behind the myth of the Asian-American model minority to justify their shady business practices.


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

A Private Equity Firm, The Makers of the MAP Test, and an Ed Tech Publisher Join Forces

 
 
Prepare to watch more of your tax dollars spiral down the drain of standardized testing. 


 
A year after being gobbled up by private equity firm Veritas Capital, ed tech company Houghton Mifflin Harcourt (HMH) is acquiring K-12 assessment giant Northwest Evaluation Association (NWEA). 

Let me put that in perspective – a scandal-ridden investment firm that made billions in the wars in Iraq and Afghanistan bought one of standardized testing’s big four and then added the Measures of Academic Progress (MAP) test to its arsenal.

This almost certainly means the cost of state testing is going to increase since the providers of the tests are shrinking. 

“It used to be if you put out a [Request for Proposal] RFP for state assessment, you get five, six, 10 bidders,” said Scott Marion, executive director of the Center for Assessment. “Now you’re lucky to get three. When you’re doing that, there’s maybe not as much expertise and certainly the cost will go up” (emphasis mine).

Under the proposed deal announced in January, the testing company’s assessments and the ed tech company’s test prep materials will become intimately entwined. 

NWEA, best known for its MAP assessment, will operate as a division of HMH. And NWEA’s tests will be aligned with HMH’s curriculum.

You can just imagine how this will affect the marketplace. 

NWEA serves about 10,000 school districts and HMH estimates it works with more than 50 million students and 4 million educators in 150 countries, according to a press release about the proposed acquisition. 

So we can expect districts and even entire states which rely heavily on the MAP test to be encouraged to buy as much HMH curriculum as possible. That way they can teach directly what is on their standardized tests.

That is assuming, of course, the acquisition agreement is approved after a 90-day regulatory review period. 

To be honest, I would be surprised if there are any objections. 


 
Such cozy relationships already exist with other education companies. For example, Curriculum Associates provides the aforementioned curriculum for its own i-Ready assessment.

It’s ironic that an industry built on standardization – one size fits all – continues to take steps to create books, software and courses aligned with specific tests. It’s almost like individuating information to specific student’s needs is beneficial or something. Weird!

After all, if these sorts of assessments can be gamed by increased access to materials created by the same corporate entities that create and grade the tests, are we really assessing knowledge? Aren’t we just giving students a score based on how many books and software packages their districts bought from the parent company? Is that really education

I remember a time when curriculum was determined by classroom teachers – you know, experts in their fields, not experts in the corporate entity’s test du jour. 

But I guess no one was getting rich that way…

NWEA used to be focused more on formative assessments – tests that you took several times a year before and sometimes even after the big summative state assessment to determine if you were progressing toward passing the high stakes goal. However, in 2021, the company acquired assessment-related technology from Educational Testing Service (ETS) and took over several state contracts from Questar Assessments. This includes contracts for New York, Georgia, Mississippi, and Missouri.

This made NWEA attractive to HMH which had, itself, consolidated into mostly educational technologies and sold off most of its interests in book publishing and assessments. In fact, various versions of the company from Harcourt to Houghton Mifflin Harcourt used to be considered one of the big 4 standardized testing companies until only a decade ago. With revenues of $1.37 billion in fiscal year 2014, for example, the company held a 44% market share including Common Core instructional resources.


 
However, in 2018 it divested its Riverside clinical and standardized testing (Riverside) portfolio to Alpine Investors, a private equity firm based in San Francisco, for a purchase price of $140 million, and then sold its publishing assets in 2021 to HarperCollins.


 
Then in February of 2022, New York-based private-equity firm Veritas Capital acquired HMH at a price of $21 per share, or about $2.8 Billion. And under Veritas, HMH acquired NWEA and the two companies will work together to do many of the things that HMH used to do by itself – like a golden dragon perched atop the standardized testing treasure trove.

All for the benefit of Veritas Capital.

Make no mistake, the investment firm wouldn’t have become involved if it couldn’t make a profit off the situation. That’s what it does – through scandal after scandal.

Founded in 1992 by the late investment banker Robert McKeon (who died by suicide after mounting improprieties came to light), Veritas Capital began its life buying up government contractors and forming close ties with former senior government officials. Of the company’s many defense-related investments, the most infamous was its 2005 purchase of DynCorp International, a shady company involved in the US’s Iraq and Afghanistan wars.


 
Under Veritas ownership, DynCorp benefited from lax oversightfrequently billed the government for work that was never requested, and was embroiled in a sex-trafficking scheme, according to reports. 

Veritas also made headlines when a company it bought in 2008, Global Tel-Link, a telecommunications company that provides telephone services for prison systems, racked up exorbitant fees on calls to inmates

In 2006, the firm acquired MZM Inc., an intelligence contractor, which was investigated for providing bribes to Rep. Duke Cunningham, R-Calif., in exchange for help obtaining Pentagon contracts. 

Throughout its history, Veritas has fostered close ties to government officials. Campaign finance records show executives at the investment firm have given over $100,000 to various politicians, mostly Republicans. In 2014, Veritas paid Bill Clinton $250,000 for a speech.

The New York Times reported in 2001 that numerous retired generals were on Veritas’ payroll and the company used such ties to the Pentagon and frequent appearances in the media to boost Veritas-owned military contractors, including DynCorp.

And now the little investment firm that could has its sights on the standardized testing game.

Why?  

Because there’s gold in them thar tests!

Taxpayer money, that is.

Current Veritas’ CEO and Managing Partner Ramzi Musallam has taken the firm from $2 billion in investments in 2012 to $36 billion in 2021 doing things just like this.

Musallam focuses on technology companies like HMH that operate in sectors dominated by the US federal government such as standardized testing. After all, the only reason public schools throughout the country have to give these assessments is federal law. It’s a captive market paid for by tax dollars.  

We could just let teachers teach and then assess their students in whatever ways seem most accurate and fair. Or we could continue to rely on corporations to do it for us without any real proof that their products are better or even as good as what your local neighborhood educator could provide.

Veritas is banking on the latter.


 
America spends $6.8 trillion a year on defense, health care and education – markets dominated by the government. 


 
 
“These are government-influenced markets, no doubt about it, and being close to how the government thinks about those markets enables us to understand how we can best invest,” Musallam said. 


 
So this merger of two of the most influential education companies in the US is great news for investors – and terrible news for taxpayers who will be paying the bill. 


 
For students and teachers – it’s more of the same


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

Top 11 Education Articles of 2022 Hidden by Facebook, Buried by Twitter, and Written by a Gadfly

If you’ve stumbled across this article on social media, congratulations!

You’re one of the few people allowed to read it!

This blog, Gadfly on the Wall, used to be read by at least half a million people each year. Now it’s seen by barely 100,000.

The reason? Poor writing? Flagging interest in the subject?

I don’t think so.

Education is still as important today as it was in 2014 when I started this venture. And as to my writing ability, it’s no worse now than it was 8 years ago.

The difference it seems to me is the rise of social media censorship – not in the name of fact checking or peer review. After all, I’m a nationally board certified classroom teacher with a masters in education writing about the field where I’ve been employed for two decades.

However, the tech bros who gate keep what could have been the free exchange of information on the Internet insist they get paid for access.

You want your voice to be heard? You’ve got to pay like any other advertiser – even if your product is simply your opinion backed by facts.

So this year, my blog had the fewest hits since I started – 124,984 in 2022. By comparison, last year I had 222,414.

I’d write an article, post it on social media and see it reposted again and again. You’d think that would mean it was popular, but no. The people who saw it liked it enough to suggest it to others, but it went little further. With each share, fewer people saw it. Like someone put up a wall in front of it.

In truth, I’m lucky as many people had the opportunity to read my work as did.

The question is where do I go from here?

Should I continue, knowing only a select few will get to hear me? Should I try paying the billionaire tech bros to let more readers in?

My work isn’t a product and no one is paying me to do it.

Oh well…

In any case, here’s a look back at my most popular articles from the year that was and one honorable mention:

HONORABLE MENTION

11) WPIAL is Wrong! Racist Taunts at a Football Game are NOT a Matter of Both Sides

Published: Feb. 4

Views: 301

Description: My school’s football team is mostly black. They played a mostly white football team and were greeted by racial slurs and an allegedly intentional injury to one of our players. However, the Western Pennsylvania Interscholastic Athletic League (WPIAL) blamed both sides for the incident.

Fun Fact: It’s one of those decidedly local stories that community newspapers used to cover before almost all went bankrupt or were sold to the media giants. Having this platform allowed me to call out an injustice when most voices were silenced. The injured player’s mother thanked me for doing so. Stories like this keep me going.

10) Federal or State Legislature May Raise Teacher Salaries so Schools Have Enough Staff to Reopen

Published: June 8

 Views: 1,468

 Description: At the beginning of the summer, governments were so shaken by the exodus of teachers from the classroom that they were discussing raising our salaries or giving us bonuses. Parents were so adamantly against distance learning they demanding in-person classes with real, live human teachers. What a shock to the super elite education “experts” who had been pushing ways to eliminate teachers for decades and ignoring our consistent march out of the field under these conditions.

 Fun Fact: The federal government is still discussing pay raises with a bill to increase the minimum salary nationwide. Will this lead to any action? Who knows? It’s actually surprising that legislators even recognize the issue exists.

9) Why Even the Best Charter Schools are Fundamentally Inequitable

Published: Sept. 17

 Views: 1,514

 Description: Charter schools are inequitable because they have charters. These are special agreements that they don’t have to follow all the rules other authentic public schools funded by tax dollars must follow. That’s unfair and it applies to EVERY charter school because every one has a charter. Hence, the name.


 Fun Fact: Criticism of charter schools in general usually degrades to defense of individual charter schools avoiding whatever general criticism is leveled against the industry. The argument in this article has the benefit of avoiding any such evasion. All charter schools are guilty of this (and many are guilty of much more). All of them.

8) Every Teacher Knows

Published: March 17

 Views: 1,675

 Description: Just a list of many things classroom teachers know about schools and education but that the general public often ignores. These are the kinds of things missing from the education debate because we rarely include teachers in the discussion about the field where they are the experts.


 Fun Fact: For a few hours people were talking about this article far and wide. And then – boom – it got shut down with a bang. This one was so universal it should have been popular for weeks. But it just disappeared.

7) With the Death of Queen Elizabeth II, the US Should End Its Biggest Colonial Enterprise – Charter Schools

Published: Sept. 10

 Views: 1,817

 Description: Charter schools are colonial enterprises. They loot and pillage the local tax base but without having to be governed by school boards made up of community members – otherwise known as local taxpayers. They can be run by appointed boards often made up of people who do not come from the community in question. They are outsiders come merely for personal profit. These invaders are quite literally taking local, community resources and liquidating them for their own use – the maximization of personal profit. The public is removed from the decision-making process about how its own resources are utilized and/or spent.

 Fun Fact: It’s an argument from consistency. If we’re against the colonial enterprise, we must be against charter schools, too. I’m particularly proud of the graphic (above) I created to go with this article.

6) Holtzman Resigns as MASD Superintendent After Questions Over Contract Shenanigans

Published: May 26

 Views: 1,933

 Description: Dr. Mark Holtzman, the Superintendent from the district where I live, left under strange circumstances. He resigned and took a new contract in a matter of hours so he could get a raise from a lame duck school board without having to wait for the people the community elected to decide the matter to take office first. Then when it all came to light, he left the district for greener pastures.


 Fun Fact: More than any other news source, I documented what happened in detail. Without a series of articles I wrote on this, most people would have had very little idea what happened. It would have just been rumors. This is why we need local journalism. It shouldn’t be left to bloggers like me.

5) Silencing School Whistleblowers Through Social Media 

Published: Feb. 12

 Views: 2,065

 Description: This was social media’s latest crackdown on edu-bloggers and other truth tellers. I used to get 1,000 readers a week. Now I’m lucky to get a few hundred. There’s a strict algorithm that determines what people get to see on their Facebook pages. And if it says you’re invisible, then POOF! You’re gone and the people who would most enjoy your writing and want to pass it on don’t get the chance. It’s undemocratic in the extreme but totally legal because Facebook is a for-profit company, not a public service. Money wins over free exchange of ideas. 

 Fun Fact: There used to be so many other education bloggers like me out there. Now there are just a handful. This is why.

4) If Standardized Tests Were Going to Succeed, They Would Have Done So By Now

Published: April 7

 Views: 2,478

 Description: Standardized tests were supposed to improve our public schools. They were supposed to ensure all students were getting the proper resources. They were supposed to ensure all teachers were doing their best for their students. But after more than four decades, these assessments have not fulfilled a single one of these promises. In fact, all they’ve done is make things worse at public schools while creating a lucrative market for testing companies and school privatization concerns.  

 Fun Fact: Pundits still talk about standardized testing as if it were innovative. It’s not. It’s the status quo. Time to end this failed experiment.

3) Top 5 Charter School Myths Debunked 

Published: April 15

 Views: 3,604

 Description: Let’s examine some charter school propaganda – one piece at a time – and see if there’s any truth to these marketing claims. Charter schools are actually not public schools in the same way as other taxpayer funded schools. They do not save money – they waste it. Their students do not outperform authentic public school students. They are not innovative – they are regressive. They do not protect children’s civil rights – they violate them.


 Fun Fact: I designed the title and picture to trick readers into thinking this was a pro-charter school article. So many people were butt hurt when they read it! I just hope it helped clarify the matter to those who were undecided.

2) The MAP Test – Selling Schools Unnecessary Junk at Student Expense

Published: Aug 27

 Views: 3,937

 Description: The Measures of Academic Progress (MAP) test is an assessment made by Northwest Evaluation Association (NWEA), a so-called non-profit organization out of Portland, Oregon. Some states require the MAP as part of their standardized testing machinery. However, in my home state of Pennsylvania, the MAP is used as a pre-test or practice assessment by districts that elect to pay for it. What a waste! Why do we need a test BEFORE the test? The assessment’s job is to show how our students are doing in Reading, Math and Science compared with an average test taker. How does that help? I don’t teach average test takers. I teach human beings. Students learn at their own rates – sometimes faster, sometimes slower. We don’t quicken the timescale with needless comparisons.

 Fun Fact: I think this article was as popular as it was because people could relate. So many teachers told me how relieved they were to hear someone else expressing all the frustrations they were experiencing in their own districts with the MAP and other tests like it. If administrators and school boards would just listen to teachers! If they’d even bother asking them!

1) Posting Learning Objectives in the Classroom is Still a Dumb Idea

Published: Nov. 25

 Views: 7,285

 Description: When it comes to dumb ideas that just won’t go away, there is a special place in the underworld for the demand that teachers post their learning objectives prominently in the classroom. It presupposes that teachers control everything their students learn in the classroom and can offer it to them on a silver platter. It’s not just a useless waste of time but a dangerous misunderstanding of what actually happens in the learning process.


 Fun Fact: This isn’t exactly news, but teachers were relieved to hear their truth finally given voice. So many of us still have to abide by this nonsense when we could be doing something that actually makes a difference. It’s nice to have your sanity and frustration confirmed. If only administrators could admit they were wrong and stop demanding this crap!


Gadfly’s Other Year End Round Ups

This wasn’t the first year I’ve done a countdown of the year’s greatest hits. I usually write one counting down my most popular articles and one listing articles that I thought deserved a second look. Here are all my end of the year articles since I began my blog in 2014:

 

2021:

Gadfly’s Most Outrageous Articles in 2021 That You May Have Missed or Been Too Polite to Share

Gadfly’s Top 10 Articles of 2021 – Shouts in the Dark

2020:

The Most Important Education Articles (By Me) That You Probably Missed in 2020

Outrunning the Pandemic – Racing Through Gadfly’s Top 10 Stories of 2020

 

2019:

Sixteen Gadfly Articles That Made Betsy DeVos Itch in 2019


Screen Shot 2019-12-28 at 3.51.03 PM

 

2018:

A Gadfly’s Dozen: Top 13 Education Articles of 2018 (By Me)

thumbnail_IMG_8445

 

 

2017:

 

What’s the Buzz? A Crown of Gadflies! Top 10 Articles (by Me) in 2017

 

thumbnail_Screen shot 2017-12-26 at 3.44.17 PM

 

Hidden Gadfly – Top 5 Stories (By Me) You May Have Missed in 2017

 

7fd6a56c2ffc7a03c9fd2f431a543e92

 

2016

Worse Than Fake News – Ignored News. Top 5 Education Stories You May Have Missed in 2016

 

ignoring-wisdom

 

Goodbye, 2016, and Good Riddance – Top 10 Blog Post by Me From a Crappy Year

 

screen-shot-2016-12-27-at-3-29-49-am

 

 

2015

 

Gadfly’s Choice – Top 5 Blogs (By Me) You May Have Missed from 2015

 

Screen shot 2016-01-02 at 11.01.09 PM

 

Who’s Your Favorite Gadfly? Top 10 Blog Posts (By Me) That Enlightened, Entertained and Enraged in 2015

 

Screen shot 2015-12-30 at 12.57.49 AM

 

2014

 

 

Off the Beaten Gadfly – the Best Education Blog Pieces You Never Read in 2014

 

Wonderfull illusion art painting

 

Top 10 Education Blog Posts (By Me) You Should Be Reading Right Now!

 

computer-people-png-300x202


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

Standardized Test Scores are Incompatible with Your School’s Equity Plan  

 
 
The primary goal of public education is to teach all children fairly.  


 
But since its inception, the system has never been set up to actually accomplish this.  


 
So these days you hear a lot of talk about fixing the problem – of how we can ensure students of color and other historically underserved children get the same high-quality education racially and economically privileged kids always have received.


 
This almost always concludes with two types of plan.  


 
First, there is the serious venture made up of things like increasing spending to meet student need, wraparound services, early intervention, reducing class size, redistributive justice and cultural competence – a plan that looks the reality in the face and makes bold attempts to come to terms with it. 


 
Then there is the cheap knockoff proposition – a buzzword-laden scheme where someone is trying to convince you their half hearted proposal is actually a solution to the very real problem of educational inequality. 


 
 
And the number one thing you can use to tell the difference between the two is this – standardized test scores


 
 
The first plan that is centered around actually fixing disparities makes no mention of test scores – or at least relegates them to obstacles. The second is built all around them – as an essential component of the overall scheme. 


 
 
This is because the second feel-good-accomplish-nothing plan is essentially performative.  


 
 
Therefore, it is constructed around standardized test scores as a metric of success.  


 
Planners think: We’re going to do A, B and C to make our schools more equitable. And how will we know we’re doing it right? We’ll use our standardized test scores! 


 
That’s not accuracy. It’s ostentation. These scores don’t demonstrate anything at all about equity. True, they purport to show readily apparent increases or decreases in academics.  


 
However, even this is an illusion.  


 
A rise or fall in test scores is not, in fact, based on authentic academic success but merely success at taking standardized tests designed for very different purposes.  


 
And anyone who understands the history of these types of assessments and how they still work will know that this mirage is built at the cost of genuine equity.  


 
In fact, the inequalities plaguing our public school system are due in large part to our national insistence that standardized test scores be the ultimate measure of success.  


 
So constructing your plan to fix this problem around one of its root causes is like claiming you can fix a sinking ship by drilling more holes in its hull.  


 
At best, it’s naive. At worst, it’s self-defeating and disingenuous.  


 
 
The problem centers around the difference between standardized tests and assessments created by classroom teachers. 


 
 
Both types of assessment are supposed to measure what students have learned. But not all learning is equal


   
For example, a beginning chef needs to know how to use the stove, have good knife skills and how to chop an onion. But if you give her a standardized test, it instead might focus on how to make foie gras – something that would only come in handy at a high end French restaurant.


   
That’s not as important in your everyday life, but the tests make it important by focusing on it.  


   
The fact of the matter is that standardized tests do NOT necessarily focus on the most important aspects of a given task. They focus on obscurities – things that most students don’t know.  


   
This is implicit in the design of these exams and is very different from the kinds of tests designed by classroom teachers.  


   
When a teacher makes a test for her students, she’s focused on the individuals in her classes. She asks primarily about the most essential aspects of the subject and in such a way that her students will best understand. There may be a few obscure questions, but the focus is on whether the test takers have learned the material or not.  


   
When psychometricians design a standardized test, on the other hand, they aren’t centered on the student. They aren’t trying to find out if the test taker knows the most important facts or has the most essential skills in each field. Instead, there is a tendency to eliminate the most important test questions so that the test – not the student – will be better equipped to make comparisons between students based on a small set of questions. After all, a standardize test isn’t designed for a few classes – it is one size fits all.  


   
New questions are field tested. They are placed randomly on an active test but don’t count toward the final score. Test takers aren’t told which questions they’ll be graded on and which are just practice questions being tried out on students for the first time. So students presumably give their best effort to both types. Then when the test is scored, the results of the field test questions determine if they’ll be used again as graded questions on a subsequent test.  


   
According to W. James Popham, professor emeritus at the University of California and a former president of the American Educational Research Association, standardized test makers take pains to spread out the scores. Questions answered correctly by too many students – regardless of their importance or quality – are often left off the test.  


   
If 40 to 60 percent of test takers answer the question correctly, it might make it onto the test. But questions that are answered correctly by 80 percent or more of test takers are usually jettisoned.  


   
He writes:  

   “As a consequence of the quest for score variance in a standardized achievement test, items on which students perform well are often excluded. However, items on which students perform well often cover the content that, because of its importance, teachers stress. Thus, the better the job that teachers do in teaching important knowledge and/or skills, the less likely it is that there will be items on a standardized achievement test measuring such knowledge and/or skills.”  


   
Think about what this means.  


   
We are engaged in a system of assessment that isn’t concerned with learning so much as weeding people out. It’s not about who knows what, but about which questions to ask that will achieve the predetermined bell curve.  


 
This is important when it comes to equity.  


 
 
If we are guided in large part by standardized test scores, we aren’t guided by authentic learning. We’re guided by a false picture of learning. Therefore, the most effective way – perhaps the only practical way – of raising test scores is to teach directly to a specific test. And not only the test, but the specific version of the test being given that year.

So if we do somehow manage to raise test scores, we haven’t improved academics at all but a mere semblance of it. And thus the equity we might celebrate in such a situation would be just as false. 


 
You got a good score on the MAP test. Hurrah! But that doesn’t mean you know anything of real value except how to take this particular MAP test which, itself, will change after the next round of questions are field tested.


 
 
 
This has huge implications for the quality of education being provided at our schools. Since most administrators have drunk deep of the testing Kool-Aid, they now force teachers to educate in just this manner – to use test scores to drive instruction. So since the tests doesn’t focus on the most essential parts of Reading, Writing, Math, and Science, neither does much of our instruction. 

And if we insist on evaluating the equity of our schools on these test scores, we will only make things that much worse. 


   
We end up chasing the psychometricians. We try to guess which aspects of a subject they think most students don’t know and then we teach our students that to the exclusion of more important information. And since what students don’t know changes, we end up having to change our instructional focus every few years based on the few bread crumbs surreptitiously left for us by the state and the testing corporations.  


   
That is not a good way to teach someone anything. It’s like teaching your child how to ride a bike based on what the neighbor kid doesn’t know.  


   
It’s an endless game of catch up that only benefits the testing industry because they cash in at every level. They get paid to give the tests, to grade the tests and when students fail, they get paid to sell us this year’s remediation material before kids take the test again, and – you guessed it – the testing companies get another check!  


   
It’s a dangerous feedback loop, a cycle that promotes artificially prized snippets of knowledge over constructive wholes. 


 
And let’s not forget where these tests come from


 
They were created in the 1910s and 20s by eugenicists to prove the supremacy of white Europeans over other racial and ethnic groups.  


 
While these original tests are no longer in circulation, the assumptions behind them are an essential part of our modern day standardized tests. 
 


The very method of question selection in today’s tests builds economic and racial bias into the very fabric of the enterprise.  


   
According to Prof. Martin Shapiro of Emory University, when test makers select questions with the greatest gaps between high and low scorers, they are selecting against minorities. Think about it – if they pick questions based on the majority getting it right, which minority got it wrong? In many cases, it’s a racial or ethnic minority. In fact, this may explain why white students historically do better on standardized tests than black and Hispanic students.  


   
This process may factor non-school learning and social background into the questions. They are based on the experiences of white middle-to-upper class children.  


   
So when we continually push for higher test scores, not only are we ultimately dumbing down the quality of education in our schools, but we’re also explicitly lobbying for greater economic and racial bias in our curriculum trickling down from our assessments.  


   
As Ibram X. Kendi, author of “How to be an Antiracist” puts it:  


   
“Standardized tests have become the most effective racist weapon ever devised to objectively degrade Black minds and legally exclude their bodies.”  


 
This is incompatible with any enterprise aimed at increasing equity.  


 
You are engaged in a never-ending cycle of teaching to the test at the expense of authentic learning. You’re engaged in making minorities think like their privileged peers – of overcoming who they are just to be accepted into a game.

 
 
This is not education. It is assimilation, and it will always put the assimilated at a disadvantage to the majority – those they are being forced to imitate.  


 
Equity and standardized testing do not go together.  


 
 
They CANNOT go together. They are anathema.  


 
Those who suggest otherwise are either well-meaning fools or duplicitous malefactors.  


 
There is a multi-billion dollar standardized testing industry dependent on keeping us testing our kids.  


 
But we can no longer continue feeding that beast and pretending that we can somehow provide equity to our underserved children, too.  


 
We have to choose – equity or testing.  Fairness or unrestrained capitalism.


 
Do not believe anyone who tells you to support a plan built on both. 

It does not exist.


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

 

The Racist Origins of Standardized Testing Still Matter

Would you walk across a bridge that was designed to break?

Of course you wouldn’t.

But what if someone told you the bridge had been fixed?

Would you trust it – especially if people were still falling off of it all the time?

That’s the situation we’re in with standardized testing.

The tests were explicitly created more than a century ago to fail minorities and the poor.

And today, after countless revisions and new editions, they still do exactly the same thing.

Yet we’re exhorted to keep using them.

A BRIEF HISTORY LESSON

Modern testing comes out of U.S. Army IQ tests developed during World War I.


 In 1916, a group of psychologists led by Robert M. Yerkes, president of the American Psychological Association (APA), created the Army Alpha and Beta tests. These were specifically designed to measure the intelligence of recruits and help the military distinguish those of “superior mental ability” from those who were “mentally inferior.” 


These assessments were based on explicitly eugenicist foundations – the idea that certain races were distinctly superior to others.

Colleague Lewis Terman made the goal clear in his book, The Measurement of Intelligence, that these “experimental” tests will show “enormously significant racial differences in general intelligence, differences which cannot be wiped out by any scheme of mental culture.” 

In 1923, another psychologist, Carl Brigham, took these ideas further in his seminal work A Study of American Intelligence. In it, he used data gathered from these IQ tests to argue the following: 


 
“The decline of American intelligence will be more rapid than the decline of the intelligence of European national groups, owing to the presence here of the negro. These are the plain, if somewhat ugly, facts that our study shows. The deterioration of American intelligence is not inevitable, however, if public action can be aroused to prevent it.”


 
 Thus, Yerkes, Terman and Brigham’s pseudoscientific tests were used to justify Jim Crow laws, segregation, and even lynchings. Anything for “racial purity.” 


People took this research very seriously. States passed forced sterilization laws for people with “defective” traits, preventing between 60,000 and 70,000 people from “polluting” America’s ruling class. 

The practice was even upheld by the US Supreme Court in the 1927 Buck v. Bell decision. Justices decided that mandatory sterilization of “feeble-minded” individuals was, in fact, Constitutional.


 Of the ruling, which has never been explicitly overturned, Justice Oliver Wendell Holmes wrote, “It is better for all the world, if instead of waiting to execute degenerate offspring for crime, or to let them starve for their imbecility, society can prevent those who are manifestly unfit from continuing their kind…. Three generations of imbeciles are enough.” 


Eventually Brigham took his experience with Army IQ tests to create a new assessment for the College Board – the Scholastic Aptitude Test – now known as the Scholastic Assessment Test or SAT. It was first given to high school students in 1926 as a gatekeeper. Just as the Army intelligence tests were designed to distinguish the superior from the inferior, the SAT was designed to predict which students would do well in college and which would not. It was meant to show which students should be given the chance at a higher education and which should be left behind. 


And unsurprisingly it has always – and continues to – privilege white students over children of color. The same as nearly every standardized test still does.

HAS IT CHANGED?

None of this can be challenged. These are historical facts. They are simply what happened justified in the words of the people who perpetrated them.

However, champions of continuing the practice of standardized testing most often defend the practice by appealing to time.

This was all a long time ago, they say. Much has changed between now and then.

But has it? Really?

We certainly don’t use the editions of the tests written by the original eugenicists, but the practices used to create them and the results of these assessments are extremely similar.

In 1964, a Department of Education report found that the average black high school senior scored below 87% of white seniors (in the 13 percentile) on standardized assessments. Fifty years later, the National Assessment of Educational Progress (NAEP) found that black seniors had narrowed the gap until they were merely behind 81% of white seniors (scoring in the 19th percentile).

Is that really the kind of progress you want to champion?

The reason for the disparity has nothing to do with the learning students of color (and the poor whose scores are similar) achieve nor their worth as human beings.

It is in the very concept of standardized testing.

Discrimination is purposefully built in to the standardization process, according to W. James Popham, PhD, Professor Emeritus at the University of California at Los Angeles and former test maker. He explained in an interview with Frontline:

“Traditionally constructed standardized achievements, the kinds that we’ve used in this country for a long while, are intended chiefly to discriminate among students … to say that someone was in the 83rd percentile and someone is at 43rd percentile. And the reason you do that is so you can make judgments among these kids. But in order to do so, you have to make sure that the test has in fact a spread of scores. One of the ways to have that test create a spread of scores is to limit items in the test to socioeconomic variables, because socioeconomic status is a nicely spread out distribution, and that distribution does in fact spread kids’ scores out on a test.”

The scores have to fall into categories – Below Basic, Basic, Proficient and Advanced, for instance. If too many students cluster in the middle, the results are invalid. We need the scores spread out – even if we must resort to non-educational factors to get there.

Family income is not something the tests ignore, says Popham. It is an essential component specifically tested for in question construction. In fact, he claims that between 15-80% of the questions (depending on the subject area) on norm-referenced exams are linked to socio-economic status (SES).

Thus minorities with higher percentages of impoverished people are selected against. Not because of any explicit racist ideology – but to get the pretty bell curve standardized assessments require.

Young Whan Choi, Manager of Performance Assessments at Oakland Unified School District in Oakland, California, agreed.

“Too often, test designers rely on questions which assume background knowledge more often held by White, middle-class students. It’s not just that the designers have unconscious racial bias; the standardized testing industry depends on these kinds of biased questions in order to create a wide range of scores.”

For example, Choi recalled a 10th grade student in his class asking him about a standardized test question. “With a puzzled look, she pointed to the prompt asking students to write about the qualities of someone who would deserve a “key to the city.” Many of my students, nearly all of whom qualified for free and reduced lunch, were not familiar with the idea of a ‘key to the city.’”

So when they get such a question wrong, it isn’t necessarily because they don’t know the concept being tested, but they don’t understand what was being asked in the first place.

Test makers could work to eliminate such instances but that would reduce the spread of answers. It would destroy the bell curve – and thus invalidate the goal of the test which ultimately is not assessing learning but sorting and ranking students.

Jay Rosner, a national admissions test expert, explained how this bias is built-in to the process for each revision of assessments like the SAT:


“Compare two 1998 SAT verbal [section] sentence-completion items with similar themes: The item correctly answered by more blacks than whites was discarded by the Educational Testing Service, whereas the item that has a higher disparate impact against blacks became part of the actual SAT. On one of the items, which was of medium difficulty, 62% of whites and 38% of African-Americans answered correctly, resulting in a large impact of 24%…On this second item, 8% more African-Americans than whites answered correctly…”


 In other words, the criteria for whether a question is chosen for future tests is if it replicates the outcomes of previous exams – specifically tests where students of color score lower than white children. And this is still the criteria test makers use to determine which questions to use on future editions of nearly every assessment in wide use in the US.

Public schools have no control over these factors. That’s why schools serving poor and minority students invariably have lower test scores. Popham concludes there will always be a testing gap because that’s the way the system is designed.

He says it’s “A game without winners.” Or more likely a game where the poor and minorities cannot win.

And that’s how the system was designed.

Whether it’s the 1920s or the 2020s.

Standardized tests came from racists assumptions about human intelligence.

And that still matters today.

We no longer profess eugenicist ideas of racial purity embedded in our assessments as self evident or based on science. But they’re there none-the-less.

Today, the very concept of intelligence being quantifiable remains in question.

In “The Mismeasurement of Man,” evolutionary biologist Stephen Jay Gould challenged many of these ideas – in particular those of Terman. Rather than see intelligence as a genetic trait, Gould envisioned it more abstractly and thus shattered the idea that any mere number could capture human value.

Complex instances of learning cannot be accurately standardized. They have to be measured in context of the students and the learning community where they were acquired.

But this is a relatively new idea. Accepting it requires us to turn the page on a rather dark passage of our national history.

We must move on from the original test makers narrow-minded, racist ideas about intelligence and human worth.

And to do that we must leave standardized testing far, far behind.

We can’t just give a faulty bridge a new coat of paint. We must demolish it and rebuild an entirely new structure to carry us into the future.


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

When Good Students Get Bad Standardized Test Scores 

 
 
Ameer is a good student.  


 
He takes notes in class, does all his homework and participates in discussions.  


 
He writes insightful essays and demonstrates a mastery of spelling and grammar.  


 
He reads aloud with fluency and inflection. He asks deep questions about the literature and aces nearly all of his classroom reading comprehension tests. 


 
However, when it is standardized test time, things are very different.  


 
He still arrives early, takes his time with the questions and reviews his work when he’s done – but the results are not the same.  


 
His grades are A’s. His test scores are Below Basic. 


 
How is that?  


 
How can a student demonstrate mastery of a subject in class but fail to do the same on a standardized test?  


 
And which assessment should I, his teacher, take seriously?  


 
After all, they can’t BOTH be correct. 


 
This is a problem with which most classroom teachers are forced to contend.  


 
Bureaucrats at the administrative or state level demand teachers assess students with standardized tests but the results often contradict a year or more of observation. 


 
Take the Measures of Academic Progress (MAP) test.  


 
This year at my Western Pennsylvania district, administration decided to use this computer-based standardized assessment as a pre-test or practice assessment before the state mandated Pennsylvania System of School Assessment (PSSA). 


 
I’ve already written about what a waste of time and money this is. A test before the test!? 


 
But after reluctantly subjecting my classes to the MAP and being instructed to analyze the results with my colleagues, we noticed this contradiction. 


 
In many cases, scores did not match up with teacher expectations for our students.  


 
In about 60-80% of cases, students who had demonstrated high skills in the subject were given scores below the 50th percentile – many below the 25th percentile.  


 
These were kids with average to high grades who the MAP scored as if they were in the bottom half of their peers across the state. 


 
 Heck! A third of my students are in the advanced class this year – but the MAP test would tell me most of them need remediation! 


 
If we look at that data dispassionately, there are possible explanations. For one, students may not have taken the test seriously. 


 
And to some degree this is certainly the case. The MAP times student responses and when they are input fast and furious, it stops the test taker until the teacher can unlock the test after warning them against rapid guessing. 


 
However, the sheer number of mislabeled students is far too great to be accounted for in this way. Maybe five of my students got the slow down sloth graphic. Yet so many more were mislabeled as failures despite strong classroom academics. 


 
The other possibility – and one that media doom-mongers love to repeat – is that districts like mine routinely inflate mediocre achievement so that bad students look like good ones.  


 
In other words, they resolve the contradiction by throwing away the work of classroom teachers and prioritizing what standardized tests say


 
Nice for them. However, I am not some rube reading this in the paper. I am not examining some spreadsheet for which I have no other data. I am IN the classroom every day observing these very same kids. I’ve been right there for almost an entire grading period of lessons and assessments – formative and summative. I have many strong indications of what these kids can do, what they know and what they don’t know.  


 
Valuing the MAP scores over weeks of empirical classroom data is absurd.  


 
I am a Nationally Board Certified Teacher with more than two decades experience. But Northwest Evaluation Association (NWEA), a testing company out of Portland, Oregon, wants me to believe that after 90 minutes it knows my students better than I do after six weeks! 


 
Time to admit the MAP is a faulty product. 


 
But it’s not just that one standardized test. We find the same disparity with the PSSA and other like assessments.  


 
Nationally, classroom grades are better than these test scores.  


 
In the media, pundits tell us this means our public school system is faulty. Yet that conclusion is merely an advertisement for these testing companies and a host of school privatization enterprises offering profit-making alternatives predicated on that exact premise.  


 
So how to resolve the contradiction? 


 
The only logical conclusion one can draw is that standardized assessments are bad at determining student learning.  


 
In fact, that is not their primary function. First and foremost, they are designed to compare students with each other. How they make that comparison – based on what data – is secondary.  


 
The MAP, PSSA and other standardized tests are primarily concerned with sorting and ranking students – determining which are best, second best and so on. 


 
By contrast, teacher-created tests are just the opposite. They are designed almost exclusively to assess whether learning has taken place and to what degree. Comparability isn’t really something we do. That’s the province of administrators and other support staff.  


 
The primary job of teaching is just that – the transfer of knowledge, offering opportunities and a conducive environment for students to learn.  


 
That is why standardized tests fail so miserably most of the time. They are not designed for the same function. They are about competition, not acquisition of knowledge or skill. 


 
That’s why so many teachers have been calling for the elimination of standardized testing for decades. It isn’t just inaccurate and a waste of time and money. It gets in the way of real learning.  


 
You can’t give a person a blood transfusion if you can’t accurately measure how much blood you’re giving her. And comparing how much blood was given to a national average of transfusions is not helpful. 


 
You need to know how much THIS PERSON needs. You need to know what would help her particular needs.  


 
When good students get bad test scores, it invariably means you have a bad test.  


 
 
An entire year of daily data points is not invalidated by one mark to the contrary.  


 
Until society accepts this obvious truth, we will never be able to provide our students with the education they deserve.  

Good students will continue to be mislabeled for the sake of a standardized testing industry that is too big to fail.


Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!