Public Schools Can Recover from the COVID-19 Quarantine by Skipping High Stakes Tests

Screen Shot 2020-03-14 at 7.40.21 PM

 
There is one plus from being sick during a global pandemic.

 

You get perspective.

 

While all the schools in Pennsylvania are closed for at least the next two weeks to help stop the spread of COVID-19 (colloquially known as the Coronavirus), I self-quarantined a day early.

 

No, I don’t think I have the virus, but I’m not taking any chances.

 

Still, sitting here at my laptop with a steaming mug of tea, I’m filled with optimism.

 

My symptoms don’t match those of the virus – no fever, no dry cough, no difficulty breathing, no runny nose or sore throat. I just sneeze occasionally, have an intermittent wet cough and feel a bone deep fatigue.

 

Probably not the culprit sending the world into shutdown mode. But best to rest up anyway.

 

I’m also filled with a deep sense of gratitude that I’m a public school teacher.

 

My last class was a rough one – 7th graders running around the room with half written poetry demanding instruction, guidance, reassurance. My morning 8th graders were likewise rushing to complete a poetry assignment – frantically asking for help interpreting Auden, Calvert, Henley, Poe, Thomas.

 

What a privilege it has been to be there for them! How much I will miss that over the few next weeks!

 

Who would ever have thought we’d go into self quarantine to stop people from getting infected?

 

It says something about us that what seemed impossible just a few days ago has become a reality. We actually saw a problem and took logical steps to avoid it!

 

I know – we could have done a better job. We could have acted more quickly and in many areas we haven’t done nearly enough (New York, I’m looking at you).

 

But what we have done already shows that human beings aren’t finished. We have massive problems waiting to be solved – global climate change, social and racial inequality, the corrupting influence of money in politics, etc. However, we CAN do the logical thing and solve these problems!

 

No matter how crazy it seems now, tomorrow could be filled with rational solutions. If only we allow ourselves that chance.

 

So my spirits are high here in my little hollow nestled in with my family.

 

But being a teacher I can’t help thinking about what’s to come next.

 

Eventually this whole ordeal will be over.

 

Schools will reopen. Things will get back to normal. Or try to, anyway.

 

The challenge will be attempting to overcome the month or more of lost schooling.

 

Some will be thankful they relied on virtual schooling to fill in the gaps. When this whole crisis began, officials chided us to make preparations for “teleschool” in case of just this eventuality.

 

I’m glad we didn’t.

 

Frankly, (1) it would have been a huge cost that schools don’t have the money to meet and (2) it would have been money down the drain.

 

There is nothing innovative about sending kids on-line to do their assignments. The majority of work that can be done that way is of the lowest quality.

 

That’s workbook nonsense that the laziest and most checked out educators of generations past gave to their students to keep them quiet.

 

We see students in China who are being educated that way finding ways around it – giving their education apps low star reviews in the app store so that they’ll be removed, etc.

 

Here in the USA, all children don’t even have access to the Internet. They rely on the local libraries to get online – not a good idea in a pandemic.

 

So most schools have had to do without.

 

School is cancelled for about a month or so, and then – hopefully – it will return.

 

The question remains – what do we do when we get back to class?

 

We could extend the school year, but families have vacations planned and other obligations. This wouldn’t solve much and frankly I don’t think it will happen unless we’re out for longer than expected.

 

I anticipate being back in school by mid April or so. That would leave about a month and a half left in the year.

 

This really leaves us with only two options: (1) hold our end of the year standardized tests and then fit in whatever else we can, or (2) forgo the tests and teach the curriculum.

 

If we have the tests, we could hold them shortly after school is back in session. That at least would give us more time to teach, but it would reduce the quality of the test scores. Kids wouldn’t be as prepared and the results would be used to further dismantle the public school network.

 

Much better I think is option two: skip the tests altogether.

 

Frankly, we don’t need them. Teachers observe students every day. We give formal and informal assessments every time we see our kids. We’re like scientists engaged in a long-term study taking daily measurements and meticulously recording them before coming to our year end conclusions called classroom grades.

 

In my classes, I think I could teach just about the same material in the remaining time if I didn’t have to worry about the high stakes tests.

 

In 7th grade, this would mean finishing up our almost completed poetry unit – having kids put together their poetry portfolios and sharing them. Then we’d begin our final novel of the year, “Silent to the Bone” by E.L. Konigsburg, talk about mystery stories, reader perspectives and how truth impacts fiction.

 

In 8th grade, we could likewise finish up poetry with some presentations on students’ favorites from the assigned group. Then we could read the play version of “The Diary of Anne Frank,” and selections from Harper Lee’s “To Kill a Mockingbird.”We could discuss propaganda, prejudice and compare the historical perspective of Europe and the United States.

 

In both cases, we might have to forgo a year-end project, but at least we’d cover the majority of what we proposed at the beginning of the year.

 

Students would leave their respective grades with just about everything we set out to give them. They’d be prepared and ready to meet the challenges of the coming grade.

 

That seems a worthy goal to me.

 

But I hear someone ask – what about the standardized testing? Won’t students be less prepared having skipped over those assessments?

 

The answer is no. They would not be less prepared.

 

They would be better educated without a sword of Damocles hanging over their heads.

 

The shame is that this alteration in schedule would probably only last one year.

 

In 2020-21, we’d probably reinstate these standardized assessments.

 

This is at least a month of wasted schooling. If we got rid of all the pretests and administrator required teaching-to-the-test, we could clear up a good 9-weeks of extra class time.

 

Imagine what teachers could do with those surplus days!

 

My 8th graders could read the whole of “Mockingbird,” for one. instead of just selections. My 7th graders could read another entire novel – probably Paul Zindel’s “The Pigman.” Not to mention the addition of more women and writers of color, the extra time for creative writing, an emphasis on finding your own point of view.

 

And for me that’s the benefit of this COVID-19 crisis. It shows us what could be – what we could do if we were only brave enough to try.

 

Happy self-quarantine, everyone!


 

Like this post?  You might want to consider becoming a Patreon subscriber. This helps me continue to keep the blog going and get on with this difficult and challenging work.

Plus you get subscriber only extras!

Just CLICK HERE.

Patreon+Circle

I’ve also written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-2

Teachers Are Not Responsible for Student Growth or Achievement

thumbnail_Screen Shot 2019-11-21 at 8.55.01 AM

 
Earlier this week, I was rushed to another urgent early morning staff meeting at my school.

 

I had my laptop with me and was frantically trying to get everything ready that I’d need for the day.

 

Text dependent analysis question? Check.

 

Discussion guide to introduce the concept of science fiction? Check.

 

Questions on literacy, analogy, vocabulary and sentence structure suitable for 7th grade? Check.

 

The same suitable for 8th grade? Check.

 

And as I was anxiously trying to get all this together in time for me to rush to my morning duty when the meeting was over, I quickly took a sip of my tea and tried to listen to what my administrator was saying from the front of the room.

 

He handed out two white sheets of paper with a compilation of standardized test scores – last year’s and those from the year before.

 

He asked us what we noticed about these two sets of scores and I almost spit out my tea.

 

“THIS IS WHAT YOU BROUGHT US HERE FOR!?” I wanted to shout.

 

“THIS IS WHAT YOU’RE STOPPING US FROM DOING OUR WORK TO DISCUSS!?”

 

But I choked down my response and waited for someone to tell him what he wanted to hear.

 

The scores have gone down in the preceding year.

 
 
Nothing drastic but enough.

 

When he got his answer – actually he had to say it himself because none of us were ready to play this game so early in the morning – he offered us an olive branch.

 

Isn’t that the way of it? Shame then reconciliation. Blame then peace.

 

Those are just the achievement scores, he said. Admin. generously doesn’t expect us to be able to do much about those. They go up one year and down the next.

 

But look at these growth scores!

 

That’s where we can have an impact!

 

And again I felt my throat convulse and a mouthful of Earl Grey came back up my gullet.

 

Growth!?

 

It doesn’t make that much difference whether you look at growth or achievement. If you’re holding teachers accountable for either, you’re expecting us to be able to do things beyond our powers as mere mortal human beings.

 

I hate to break it to you, but teachers are not magical.

 

We cannot MAKE things happen in student brains.

 

Nothing we say or do can cause a specific reaction inside a human mind.

 

That’s just not how learning and teaching works.

 

We can INFLUENCE learning.
 
We can try to create some kind of optimum condition that is most likely to spark learning.

 

But we cannot make it happen like turning on a switch or lighting a candle.

 

Let me give you a real world example.

 

The day before the meeting I was conferencing with a student about his essay on Charles Dickens’ “A Christmas Carol.” I pointed out that he had misspelled Christmas as “Crismist.”

 

He refused to fix it.

 

Literally refused.
 
I pointed out that the word was already typed out and spelled correctly in the prompt. All he had to do was erase what he had written and rewrite it correctly.

 

He said he didn’t care – that it didn’t matter.

 

So I tried to explain how people who don’t know him would read this paper and make snap judgments about him based on simple mistakes like this.

 

I told him that I knew he was smart, that I had heard his verbal discussion of the story and was impressed by his arguments about Scrooge’s character. He had made good points about Scrooge’s guilt being motivated by fear and that once the ghosts were gone he might return to his old ways.

 

But no one was going to get that far or give him the benefit of the doubt if he didn’t even try to spell Christmas correctly!
 
And he still wouldn’t do it.

 

That is literally where I was yesterday – yet today my administrator wanted to hold ME accountable for this kid’s growth!

 

As this child’s teacher, it IS my responsibility to try to reach him.

 

I am responsible for providing him with every tool I know how that can help him succeed.

 

I am responsible for trying to motivate, inspire and explain. I am responsible for knowing what are best practices and using them.

 

By all means – evaluate me on that.

 

But I can do nothing about what a student actually does with all I give him.

 

To paraphrase the old adage about horses, I can lead a student to knowledge, but I can’t make him think.

 

And, moreover, I shouldn’t be forced, myself, only to be able to acknowledge certain kinds of thinking. If a student’s ideas don’t fit neatly into a multiple choice framework, I shouldn’t be impelled to ignore or constrain them.

 

That may seem simple or even obvious with reflection, but it also goes counter to nearly every teacher evaluation system in practice in the United States.

 

Because that’s really what’s motivating my administrator’s directives here.
 
He’s just being real, he said. This is what we’ll be evaluated on and it’s something we can impact.

 

Then he asked us what each of us can do to better impact student growth.

 

Hands went flying into the air to offer suggestions about how administration could help us better accomplish these goals.

 

How about some consistency in which courses we’re instructed to teach from year-to-year?

 

How about not splitting up classes so that students leave one room to have a special and then return to finish a course already in progress?

 

How about mandating fewer diagnostic tests so there’d be more instruction time?

 

Well that last one was just too much. We were told that Admin. planned to do just the opposite – to make the Classroom Diagnostic Tools (CDT) tests MORE invasive by changing the schedule to make them appear more like the end of the year state mandated tests.

 

He said eventually we could look at some of these other ways to change things administratively, but he wanted to put the onus on us. What can WE do to increase growth?

 

A hand went up.
 
If we help a student grow this year, won’t there be less room for him to grow next year – at least within a given academic standard? Don’t we reach a point of diminishing returns?

 

To which I wanted to add – where are we measuring growth from? One standardized test to another? That’s not authentic learning – it’s assessing how well students take a test and how well they think like the corporation that makes and grades it.

 

But the meeting was already over.

 

The bell rang and we had to rush to our duties.

 

I scrambled back to my classroom to deposit my computer before getting to the cafeteria just as student breakfast began.

 

This is madness, I thought.

 

Growth and achievement. It’s all just gas lighting educators for not being superhuman.

 

The decision makers either don’t understand how learning works or they don’t care to understand.

 

They are putting everything on teachers and students without providing either of us with the tools we need to succeed.

 

Students need more than another standardized test. And they need more than another teacher who only cares about their test scores – regardless of whether you measure them in growth or achievement.

 

These kids are stressed out, living under immense pressure, coping with poverty, prejudice, an unstable society, climate change, an uncertain future and an economy that promises them little more than crushing debt as a best case scenario.

 

Educators are supposed to wade into all that, say a few incantations and it will all just go away?

 

Many parents are struggling so much to provide for their kids they don’t have time to help with homework, provide guidance or support. And you think I’ve somehow got the secret sauce in my teacher’s bag?

 

Wake up, America.

 

It’s time we faced a truth about our schools.

 

Teachers can’t do it all alone.
 
Growth, achievement, whatever.

 

Until society commits to supporting its children with equitable resources, social justice and an evaluation system that’s more valid than standardized testing, the next generation will continue to struggle.

 

If you want to make an impact, a good place to start would be a realistic conception of what it means to be a teacher and what we actually can and should be held responsible for.

 


 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-2

Are Teachers Allowed to Think for Themselves?

thumbnail_Screen Shot 2019-10-30 at 3.35.07 PM

 
As a public school teacher, I am often told what to do and how to do it.

 

Go teach this class.

 

Report to lunch duty at this time.

 

Monitor this student’s progress in this way, that student’s progress in another way, differentiate the following, document this medical condition, write up this behavior, check for that kind of hall pass, post and teach these academic standards, etc., etc., etc.

 

Some of these directives I agree with and others I do not. But that is treated as an irrelevance because the one thing I’m never told to do is to think for myself.  The one thing that seems to be expressly forbidden – is that I think for myself.

 

 

 

In fact, it’s such a glaring omission, I often wonder if it’s actually prohibited or so obviously necessary that it goes without saying.

 

 

 

Am I expected to think or just follow directions?

 

 

 

Does society want me to be a fully conscious co-conspirator of student curiosity or a mindless drone forcing kids to follow a predetermined path to work-a-day conformity?

 

Most days, it feels like the later.

 

Every last detail of my job is micromanaged and made “foolproof” to the degree that one wonders if the powers that be really consider teachers to be fools in need of proofing.

 

Teaching may be the only profession where you are required to get an advanced degree including a rigorous internship only to be treated like you have no idea what you’re doing.

 

And the pay is entirely uncompetitive considering how much you had to do to qualify for the position and how much you’re responsible for doing once you get hired.

 

It makes me wonder – why did I take all those courses on the history of education if I was never supposed to have the autonomy to apply them? Why did I have to learn about specific pedagogies if I was never to have the opportunity to create my own curriculum? Why was I instructed how to assess student learning if I was never meant to trust my own judgment and rely instead solely on prepackaged, canned standardized tests?

 

And now after 16 years in the classroom, I’m routinely told by my principal to use student testing data to drive my instruction. And, moreover, to document how I am doing so in writing.

 

But what if I don’t trust the student testing data in the first place?

 

What if – in my professional opinion – I don’t agree that the state should have purchased this standardized assessment from some corporate subsidiary? What if I don’t think it does a good job evaluating a child’s aptitude as a prediction of subsequent achievement on the next test? What if I don’t think the test provides valuable data for actual, authentic learning? What if I want to do more than just improve test scores from one standardized assessment to another? What if I want to actually teach something that will affect students’ whole lives? What if I want to empower them to think for themselves? What if my goals are higher for them than the expectations thrown on me as shackles on an educator’s waist, hands and feet?

 

Because it seems to me that there is a bit of a mixed message here.

 

On the one hand, teachers are given so many directives there’s no room for thought. On the other, teachers can’t do their jobs without it.

 

So what exactly do they want from me?

 

The principal can’t educate classes from his desk in the administrative office. The school board director can’t do it from his seat in council chambers. Lawmakers can’t do it from Washington, DC, or the state capital. Only the teacher can do it from her place in the classroom, itself.

 

You have to see, know and interact with your students to be able to tell what their needs are. No standardized test can tell you that – it requires human interaction, knowledge and – dare I say it – discernment.

 

You need to gauge student interest, background knowledge, life skills, special needs, psychology and motivation. And you need to design a curriculum that will work for these particular students at this particular time and place.

 

That can’t be done at a distance through any top-down directive. It must be accomplished in the moment using skill, empiricism and experience.

 

The fact that so many lawmakers, pundits, and administrators don’t know this, itself, has a devastating impact on the education kids actually receive.

 

Instead of helping teachers do their jobs, policymakers are accomplishing just the opposite. They are standing in the way and stopping us from getting things done.

 

We’re given impossible tasks and then impeded from doing them. At least get out of the way and leave us to it.

 

It’s ironic. The act of removing teacher autonomy results in dampening our effectiveness.

 

So as many of these same bureaucrats complain about “failing schools” and “ineffective teachers,” it is these very same complaints and the efforts taken in their name that result in ineffectiveness.

 

If we trusted teachers to do their jobs, they would be empowered to accomplish more. And I don’t mean blind trust. I don’t mean closing our eyes and letting teachers do whatever they want unimpeded, unadvised and unappraised. I mean letting teachers do the work in the full light of day with observation by trained professionals that know the same pedagogy, history and psychology we do – trained administrators who are or were recently teachers, themselves.

 

That would be both accountable and effective instead of the present situation, which is neither.

 

Moreover, it might incentivize policymakers to realize teachers can’t do everything themselves. Hold us accountable for what we do – not what you’d like us to do but over which we have no control.

 

After all, home life has a greater impact on students than anything that happens in class. And helping students to self-actualize into mature, productive members of society requires we equip them with the ability to work things out independently.

 

However, that does not seem to be the goal.

 

We don’t want free thinking students just as we don’t want free thinking teachers.

 

We don’t want a school system that produces independent thinkers. We want it to simply recreate the status quo. We want the lower classes to stay put. We want social mobility and new ideas to be tightly controlled and kept only within certain boundaries.

 

And that is why our school system keeps teachers so tightly constrained – because we want status quo students.

 

Educators have always been the enemy of standardization, privatization and conformity. We are on the side of liberty, emancipation and release.

 

Which side are you on?

 


 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-1

NAEP Test Scores Show How Stupid We Are… To Pay Attention to NAEP Test Scores

thumbnail_Taking-a-test-567860523df78ccc15365b27
 
Brace yourselves!

 

America’s NAEP test scores in 2019 stayed pretty much the same as they were in 2018!

 

And the media typically set its collective hair on fire trying to interpret the data.

 

Sometimes called the Nations Report Card, the National Assessment of Educational Progress (NAEP) test is given to a random sampling of elementary, middle and high school students in member countries to compare the education systems of nations.

 

And this year there was one particular area where US kids did worse than usual!

 

Our scores went down in 8th grade reading!

 

To be honest, scores usually go up or down by about one or two points every year averaging out to about the same range.

 

But this year! Gulp! They went down four points!

 

FOUR POINTS!

 

What does that mean?

 

Absolutely nothing.

 

They’re standardized test scores. They’re terrible assessments of student learning.

 

You might as well compare the relative body temperatures of randomly selected students and wonder why we aren’t bridging the body warmth gap with the somber hummingbird! I mean it has an average  temperature of 114 F! And the best we can do is a measly 98.6 F! Why won’t enough kids get a fever for America!?

 

If test scores have any meaning at all – it’s parental wealth. Rich kids tend to score higher than poor kids. That’s partially because of the inequality of resources each receive, but also because of racial, cultural and economic bias embedded in the questions.

 

So the NAEP shows us what any study of parental income would show. America has a lot of poor kids and underfunded schools.

 

Thanks, NAEP! There’s no way we could ever have figured that out without you!

 

But having this information come to us via test scores allows us to deflect from the real problem and instead continually blame the victim.

 

Why can’t these poor kids from impoverished schools score as well as kids from richer countries with more well-funded schools?

 

I can’t imagine!

 

Typically politicians used the results to push their pet policies.

 

Education Secretary Betsy DeVos used the scores to wash her hands of the entire public education system. I know – isn’t her job to safeguard public schools? It’s like a zoo keeper complaining that the penguins aren’t bringing in enough visitors and then refusing to feed them.

 

DeVos proposed we improve test scores by cutting $4.8 billion from public schools in 2020 and instead pumping $5 billion to a tax credit school voucher scheme that props up private schools.

 

I know that sounds dumb, but before you judge her, realize she also proposed cutting federal funding for afterschool programs, teacher professional development, student support and enrichment programs.

 

So there.

 

Education Blogger Peter Greene claims that this move is based on a reading comprehension problem the Education Secretary is having, herself.

 

She says that the NAEP results mean that 2/3 of American students read below grade level. However, Greene points out that she is conflating two different things – grade level proficiency and NAEP proficiency.

 

Here’s what the NAEP wrote:

 

“The NAEP Proficient achievement level does not represent grade-level proficiency, but rather competency over challenging subject matter. NAEP Achievement levels are to be used on a trial basis and should be interpreted and used with caution.”

 
Which kind of begs the question of why we need these scores in the first place.

 

There is much clearer data out there.

 

A study by the Center on Budget and Policy Priorities concluded that 29 states spent less per student in 2015 than they had before the Great Recession.

 

And the federal government has done little to help. Since 2011, spending on major K-12 programs – including Title I grants for underprivileged students and special education – has been basically flat.

 

According to the Economic Policy Institute in Washington, today’s public schools employ at least 250,000 fewer people than they did before the recession of 2008–09. Meanwhile enrollment has increased by at least 800,000 students.

 

So to ensure our students had the same quality of service children received only a decade ago, we’d need to hire almost 400,000 more teachers!

 

That’s how you cut class size down from the 20, 30, even 40 students packed into a room that you can routinely find in some districts today.

 

If we looked at realities like these instead of test scores – which at best provide us data at several removes – we might actually be motivated to reach solutions.

 

For instance, the U.S. is one of the only countries in the world – if not probably the ONLY country – that funds schools based largely on local taxes. Other developed nations either equalize funding or provide extra money for kids in need. In the Netherlands, for example, national funding is provided to all schools based on the number of pupils enrolled. But for every guilder allocated to a middle-class Dutch child, 1.25 guilders are allocated for a lower-class child and 1.9 guilders for a minority child – exactly the opposite of the situation in the U.S.

 

If we want to compare the US to other countries, this is a perfect place to start.

 

But a focus on test scores obscures the differences.

 

Virtually all of the top scoring countries taking these exams have much less child poverty than the U.S. If they had the same percentage of poor students that we do, their scores would be lower than ours. Likewise, if we had the same percentage of poor students that they do, our scores would go through the roof! We would have the best scores in the world!

 

These scores just mirror back to us our child poverty rate – that more than 1/3 of our students live below the poverty line and more than half of public school students qualify for free or reduced lunches.

 

But this myopic focus on standardized tests also blinds us to the ways our system is superior to that of many other countries.

 

We do something that many international systems do not. We educate everyone! Foreign systems often weed children out by high school. They don’t let every child get 13 years of grade school (counting kindergarten). They only school their highest achievers.

 

So when we compare ourselves to these countries, we’re comparing ALL of our students to only SOME of theirs – their best academic pupils, to be exact. Yet we still hold our own given these handicaps!

 
This suggests that the majority of problems with our public schools are monetary. Pure and simple.

 

At least House Democrats passed a Labor-HHS-Education funding bill to increase public school funding by $3.5 billion. Even if it were somehow passed by the Republican controlled Senate, that’s a drop in the bucket after decades of neglect – but it’s something!

 

It’s certainly better than DeVos who claims that funding somehow doesn’t matter for public schools – only for her pet charter and voucher schools.

 

A 2018 review by Northwestern University found that in 12 out of 13 studies increased spending had a positive effect on student outcomes. And that result has been verified by studies since then in California, Texas, Wisconsin and other states.

 
Money makes a difference.

 

Money spent on students – not more testing.

 

So why the drop in this year’s 8th grade reading scores?

 

Who knows? It could be a spike in the rate or effect of child poverty in the middle school years.

 

It could be the impact of decades of high stakes testing on middle school curriculum – narrowing what is taught and muscling out authentic instruction.

 

Frankly it doesn’t matter because the data is suspect.

 

Standardized testing will never give us an accurate picture of what is going on with our students or our schools.

 

And until we, as a society, finally realize that and focus on things that actually matter, we will continue to fail the only test that matters – how well we provide for our children.

 

 


 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-4

Greater Test Scores Often Mean Less Authentic Learning

Screen Shot 2019-10-04 at 4.25.32 PM

 
The main goal of schooling is no longer learning.

 

It is test scores.

 

Raising them. Measuring growth. Determining what each score means in terms of future instruction, opportunities, class placement, special education services, funding incentives and punishments, and judging the effectiveness of individual teachers, administrators, buildings and districts.

 

We’ve become so obsessed with these scores – a set of discrete numbers – that we’ve lost sight of what they always were supposed to be about in the first place – learning.

 

In fact, properly understood, that’s the mission of the public school system – to promote the acquisition of knowledge and skills. Test scores are just supposed to be tools to help us quantify that learning in meaningful ways.

 
Somewhere along the line we’ve misconstrued the tool for the goal. And when you do that, it should come as no surprise that you achieve the goal less successfully.

 

There are two kinds of standardized assessment – aptitude and achievement tests. Both are supposed to measure scholarship and skill – though in different ways.

 

Aptitude tests are designed to predict how well a student will do in the future. Achievement tests are designed to determine how much a student knows now.

 

There is, of course, intense overlap between these two types because aptitude tests base their predictions on assessment of achievements. So they’re basically achievements tests that go one step further. They ask questions designed to give more information than just the present state but also about whether a student has progressed to a state which is most likely to then give way to another state in the future.

 

Either way, standardized assessments are supposed to be based on what students have learned. But the problem is that not all learning is equal.

 

For example, a beginning chef needs to know how to use the stove, have good knife skills and how to chop an onion. But if you give her a standardized test, it instead might focus on how long to stir the risotto.

 

That’s not as important in your everyday life, but the tests make it important by focusing on it.

 

The fact of the matter is that standardized tests do NOT necessarily focus on the most important aspects of a given task. They focus on obscurities – things that most students don’t know.

 

This is implicit in the design of these exams and is very different from the kinds of tests designed by classroom teachers.

 

When a teacher makes a test for her students, she’s focused on the individuals in her classes. She asks primarily about the most essential aspects of the subject and in such a way that her students will best understand. There may be a few obscure questions, but the focus is on whether the test takers have learned the material or not.

 

When psychometricians design a standardized test, on the other hand, they aren’t centered on the student. They aren’t trying to find out if the test taker knows the most important facts or has the most essential skills in each field. Instead, there is a tendency to eliminate the most important test questions so that the test – not the student – will be better equipped to make comparisons between students based on a small set of questions. After all, a standardize test isn’t designed for a few classes – it is one size fits all.

 

New questions are field tested. They are placed randomly on an active test but don’t count toward the final score. Test takers aren’t told which questions they’ll be graded on and which are just practice questions being tried out on students for the first time. So students presumably give their best effort to both types. Then when the test is scored, the results of the field test questions determine if they’ll be used again as graded questions on a subsequent test.

 

According to W. James Popham, professor emeritus at the University of California and a former president of the American Educational Research Association, standardized test makers take pains to spread out the scores. Questions answered correctly by too many students – regardless of their importance or quality – are often left off the test.

 

If 40 to 60 percent of test takers answer the question correctly, it might make it onto the test. But questions that are answered correctly by 80 percent or more of test takers are usually jettisoned.

 

He writes:

 

“As a consequence of the quest for score variance in a standardized achievement test, items on which students perform well are often excluded. However, items on which students perform well often cover the content that, because of its importance, teachers stress. Thus, the better the job that teachers do in teaching important knowledge and/or skills, the less likely it is that there will be items on a standardized achievement test measuring such knowledge and/or skills.”

 

Think about what this means.

 

We are engaged in a system of assessment that isn’t concerned with learning so much as weeding people out. It’s not about who knows what, but about which questions to ask that will achieve the predetermined bell curve.

 

We talk about leaving no child left behind, and making sure all students do better on standardized tests, but these tests are norm-referenced. By definition, all students cannot score well no matter how great their knowledge or skills. If you gave a standardized test to a class of genius-level intellects, there would still be the same percentage of failures and outstanding scores with the majority clustered in the middle. That’s how the tests are designed.

 

And if this highly suspect method of question selection, alone, doesn’t achieve that end, the test companies have a way to correct the scores at the end of the process through the way they grade them.

 

These tests are graded with cut scores. In other words, the state or the testing company or the graders, themselves, decide anew each year which scores are passing and which failing.

 

One year a 1200 might be proficient. Another year it’s basic. It all depends on what the decision makers come up with on a given year.

 

What do they base this on? No one has ever given a definitive answer. In fact, I doubt there is one. In each case, the deciding body just makes it up.

 

We’ve seen countless times when state scores are criticized for being too low one year, and then they miraculously bounce up the next. It’s not that students score differently, it’s that the cut score was raised. Why? Perhaps to stifle questions about the test’s validity. After all, people are less angry when more students pass.

 

The goal is always getting the bell curve. That is what validates the tests. But it’s a human construction, not a function of assessment. It says less about the test takers than the test makers and their enablers.

 

This has huge implications for the quality of education being provided at our schools. Since most administrators have drunk deep of the testing Kool-Aid, they now force teachers to use test scores to drive instruction. So since the tests don’t focus on the most essential parts of Reading, Writing, Math, and Science, neither does much of our instruction.

 

We end up chasing the psychometricians. We try to guess which aspects of a subject they think most students don’t know and then we teach our students that to the exclusion of more important information. And since what students don’t know changes, we end up having to change our instructional focus every few years based on the few bread crumbs surreptitiously left for us by the state and the testing corporations.

 

That is not a good way to teach someone anything. It’s like teaching your child how to ride a bike based on what the neighbor kid doesn’t know.

 

It’s an endless game of catch up that only benefits the testing industry because they cash in at every level. They get paid to give the tests, to grade the tests and when students fail, they get paid to sell us this year’s remediation material before kids take the test again, and – you guessed it – the testing companies get another check!

 

It’s a dangerous feedback loop, a cycle that promotes artificially prized snippets of knowledge over constructive wholes. But this degradation of education isn’t even the worst part.

 

The same method of question selection also builds economic and racial bias into the very fabric of the enterprise.

 

According to Prof. Martin Shapiro of Emory University, when test makers select questions with the greatest gaps between high and low scorers, they are selecting against minorities. Think about it – if they pick questions based on the majority getting it right, which minority got it wrong? In many cases, it’s a racial minority. In fact, this may explain why white students historically do better on standardized tests than black and Hispanic students.

 

This process may factor non-school learning and social background into the questions. They are based on the experiences of white middle-to-upper class children.

 

So when we continually push for higher test scores, not only are we ultimately dumbing down the quality of education in our schools, but we’re also explicitly lobbying for greater economic and racial bias in our curriculum trickling down from our assessments.

 

As Ibram X. Kendi, author of “How to be an Antiracist” puts it:

 

“Standardized tests have become the most effective racist weapon ever devised to objectively degrade Black minds and legally exclude their bodies.”

 

 

71087927_10157069943303860_6347601423106048000_n

Popham is less critical of high stakes testing. He sees more of a problem in using student test scores to assess teacher performance. But even he thinks the tests and the scores are being over valued and misunderstood in a wider context.

 

He writes:

 

“Merely because these test scores are reported in numbers (sometimes even with decimals!) should not incline anyone to attribute unwarranted precision to them. Standardized achievement test scores should be regarded as rough approximations of a student’s status with respect to the content domain represented by the test.”

 

I’d go even further.

 

Standardized test scores are tools used by big business to make money. That is as far as their validity goes.

 

And the fact that we make so many vital educational decisions on them is nothing less than criminal.

 

The tests are bogus nonsense at best and a conspiracy against the poor and minorities at worst.

 

When well-meaning people let themselves get wrapped up in knots over low scores and what that means for student learning, they are actually hurting the very thing that they value.

 

Student learning is not bettered by higher test scores. It is often made worse by them.

 

High test scores don’t mean greater learning. They often mean learning the knowledge du jour to the detriment of what’s really important. They mean biased education against the poor and minorities.

 

And they make those with real concerns complicit in a sham being perpetrated on our children and our society.

 


 

 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-4

 

The Absurdity of Standardized Testing: Caught Between Prediction and Assessment

thumbnail_Screen Shot 2019-09-19 at 2.07.03 PM

 
Standardized testing is truly absurd.

 
It’s both a prediction and an assessment.

 

You take a test to determine what you’ve learned and that will in turn predict what you will be able to learn in the future.

 

We hardly ever do this anywhere else in life.

 

We don’t measure babies’ leg muscles to predict whether they’re ready to walk. We let them do what they do, possibly with some encouragement and positive models of locomotion, and they do it.

 

There are cognitive and developmental benchmarks we look for, and if children don’t hit them, we provide help. But no further prediction is necessary – certainly not based on artificial markers put together by corporate interests.

 

In most situations, predictions are superfluous. We just assume that everyone can learn if they so desire – unless something happens to make us think otherwise. And whether someone actually learns something is demonstrated by doing the thing, itself.

 

The only time we link prediction and assessment so closely is when the consequences of failure are irreversible – like when you’re going solo skydiving for the first time. If you jump out of an airplane and don’t know how to pull the ripcord to get your parachute to work, you probably won’t get a second chance to try again.

 

But most things in life aren’t so dire.

 

The world of standardized testing is very different. The high stakes nature of the assessments are what ramp out the consequences and thus the severity.

 

Testing looks at learning like two points on a map and sets up a gate between points A and B.

 

In order to cross, you have to determine if you’ve passed through the previous gate. And only then can you be allowed to progress on to point C.

 

But this is wrong on so many levels.

 

First, you don’t need a test to determine which point you’re at. If Point B is the ability to add, you can simply add. If it’s the ability to write a complete sentence, you can simply write a sentence.

 

There is no need to fill out a formal multiple-choice assessment that – depending on the complexity of the task being considered – is completely inadequate to capture the subtleties involved. The task, itself, is enough.

 

Imagine if you were testing whether someone had learned how to drink a glass of water. You could just give them a cup filled with H2O and see if they can gulp it down. Or you could have them sharpen their number 2 pencil and answer questions about how their throat works, their digestive and excretory systems and the chemical composition of agua – all answers predetermined to A, B, C or D.

 

Observation of a skill, we are told, is not enough to determine success because it relies on the judgment of an observer. A standardized test replaces the observer with an impersonal, distant testing corporation which then assesses only predetermined markers and makes decisions devoid of any situational context.

 

This is done to remove observational bias but it doesn’t avoid bias altogether. In setting up the markers and deciding which elements of the task are to be assessed (or in fact can be assessed in such a distant manner), the testing corporation is inserting its own biases into the process. In fact, in any assessment conducted by human beings, this would be inevitable. So going through this maze of perceived objectivity is really just a matter of subterfuge meant to disguise the biases of the corporation.

 

Second, assessing people in this way is extremely unnatural because very few fields of knowledge can be divided and subdivided into two or more discrete points.

 

When writing a complex sentence, for example, you need to know not just spelling and grammar but logic, handwriting, subject matter, colloquialisms, literary devices, and a plethora of other cultural and linguistic artifacts.

 

Moreover, there is not always a natural progression from Point A to B to C. Sometimes A jumps directly to C. Sometimes B leads directly to A. Sometimes A leads to Z.

 

Knowledge, skills and human cognition are far too complex a web to ever hope to be captured by such a reductive enterprise. But by insisting that we make this complexity fit into such a small box, we end up depriving people of the right to move on. We say predictive models show they aren’t ready to move forward and so we bury them in remediation. Or we deny them access to important opportunities like advanced classes, electives, field trips, extracurricular clubs or even post-secondary education.

 

Third, this emphasis on knowledge as discrete bits of information or skills (often called standards) leads to bad teaching.

 

Assessment expert W. James Popham provides a helpful distinction: “curriculum teaching” vs. “item teaching.” Curriculum teachers focus on the full body of knowledge and skills represented by test questions. For instance, if the test is expected to include questions about decimals, the teacher will cover the full range of knowledge and skills related to decimals so students understand what they are, know how to manipulate them, understand how to use them to solve more complex problems, and are able to communicate about them.

 

By contrast, item teaching involves narrowing instruction, organizing lessons around look-a-like questions that are taken directly from the test or represent the kinds of questions most likely to be found on the test. In this way, the teacher only provides the chunks of knowledge students are most likely to encounter on exams. For instance, item teachers might drill students on a certain set of vocabulary words that are expected to be assessed rather than employing instructional strategies that help students build a rich vocabulary that best contributes to strong reading comprehension.

 

A focus on standardized testing or even trying to educate in a system where these tests are attached to high stakes, results in an increase in item teaching. We often call it teaching to the test.

 

I’m not saying that item teaching is always bad. But curriculum teaching is to be much preferred. It is a best practice. The problem is when we resort to endless drills and give students innumerable questions of the exact type we expect to be on the test.

 

So when we find students who have made dramatic improvements on standardized tests, we often don’t find equal improvements in their over all knowledge or ability.

 

Test scores are often a false positive. They show students have mastered the art of taking the test but not necessarily the knowledge or skills it was meant to assess.

 

They are more like trained circus animals who can jump through flaming hoops but would be lost in the wild.

 

That’s why certain computer modeled artificial intelligences are able to pass standardized tests but would fail preschool.

 

These reflections have troubling implications for our system of standardized testing.

 

The false curtain of objectivity we’ve set up in our assessments may also be hiding from us what authentic learning is taking place and it may even hinder such learning from taking place at all.

 

Any sane society would halt such a system with these drawbacks. It would stop, regroup and devise a better alternative.

 

To continue with such a pedagogical framework truly would be the most absurd thing of all!


 

 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-2

PA Officials Want to Replace Bad Keystone Exams with Bad College Entrance Exams

Screen Shot 2019-07-15 at 8.34.43 AM

 
Pennsylvania officials are scandalized that the Commonwealth is wasting more than $100 million on unnecessary and unfair Keystone Exams.

 
They’d rather the state spend slightly less on biased college entrance exams.

 
State Auditor General Eugene DePasquale and State Sen. Andy Dinniman held a joint press conference last week to introduce a new report compiled by DePasquale’s office on the subject which concludes with this recommendation.

 

Replacing bad with bad will somehow equal good?

 
Under the proposal, elementary and middle school students would still take the Pennsylvania System of School Assessment (PSSA) tests. However, instead of requiring all high school students to take the Keystone Exams in Algebra I, Literature and Science, the report proposes the same students be required to take the SAT or ACT test at state expense.

 

This is certainly an improvement over what the state demands now, but it’s really just replacing one faulty test with another – albeit at about a $1 million annual cost savings to taxpayers.

 

The report does a good job of outlining the fiscal waste, lack of accountability and dubious academic merits of the Keystone Exams, but it fails to note similar qualities in its own proposal.

 

From 2008 to 2019, the state already paid Minnesota-based Data Recognition Corp. more than $426 million for the PSSAs, Keystone Exams and Classroom Diagnostic Tools (an optional pretesting program). The federal government paid the company more than an additional $106 million. Officials wonder if this money couldn’t have been better spent elsewhere, like in helping students actually learn.

 

DePasquale, who recently launched a congressional bid, puts it like this:

 

“When the federal law changed in 2015, why didn’t Pennsylvania begin to phase out Keystone Exams? I could understand if they use them for a short period of time after that, but it’s been four years, and will cost taxpayers nearly $100 million by the end of the contract for tests our students do not even need to take.”

 

The federal government dropped its mandate four years ago and the state legislature did the same last year.

 

Originally, state lawmakers intended to make the Keystone Exams a graduation requirement, but in 2018 they passed legislation to make the assessments one of many avenues to qualify for graduation starting in 2021-22. Students can instead pass their core courses and get into college among other things.

 

“The Department of Education itself said they [the Keystone Exams] are not an accurate or adequate indicator of career or academic readiness,” Dinniman said. “So what I’m always surprised about is, they said it and then they continue to use it. These tests have faced opposition from almost every educational organization that exists. And when we got rid of the requirement and put in [more] pathways to graduation, this was passed unanimously by both the Senate and the House.”

 

The federal government also changed its testing mandate. It used to require all public school students to take state-specific assessments in grades 3-8 and once in high school.

 

When Congress reauthorized the federal law overseeing education in 2015, it offered states more flexibility in this regard. Elementary and middle school students still have to take a state-specific test. But now the high school portion can be fulfilled with college admissions tests – and, in fact, a dozen other states legislate just such a requirement.

 
Democrats DePasquale and Dinniman think the SAT and ACT test are an improvement because students who taken them are more likely to go to college. But that’s a classic case of confusing correlation and causation.

 

Students motivated to go to college often take these exams because they are required to get in to a lot of these schools. Taking these tests doesn’t make students MORE motivated and determined to enroll in post-secondary education. They’re ALREADY motivated and determined.

 

Moreover, one of the faults the report finds with the Keystone Exams is that the assessments measure student’s parental income more than children’s academics.

 

Kids in wealthier districts almost always do better on the Keystone Exams than those in poorer districts. In fact, the report notes that of the 100 state schools with the highest scores, only five were located in impoverished districts —where the average household income is below $50,000.

 

Yet the report fails to note that this same discrepancy holds for the SAT and ACT tests. Poor kids tend to get low scores and rich kids get the highest scores.

 

In fact, the College Board – the corporation that makes and distributes the SAT – recently started adjusting scores on its test in an attempt to counteract this effect thereby accounting for high schools and neighborhoods “level of disadvantage.”

 

Does this creative scoring actually work? Who knows – but it’s kind of like being forced to swallow poison and an antidote at the same time when any sensible person would simply refuse to swallow poison in the first place.

 

And that’s the best solution state officials have for our children.

 

They’re suggesting we replace discriminatory Keystone Exams with discriminatory college entrance exams.

 

To be fair, DePasquale and Dinniman are somewhat constrained by boneheaded federal law here.

 

Though the Every Student Succeeds Act (ESSA) is an improvement over No Child Left Behind, it still requires all high school students to take standardized tests.

 

Given what we know about the limits and biases of these assessments, policymakers should remove that hurdle altogether. But until the federal government gets its act together, one could argue that DePasquale and Dinniman’s policy suggestion may be the best available.

 

When you can’t do right, maybe it’s best to do less wrong.

 

But we must acknowledge that this isn’t the ultimate solution, it’s only a stopgap. We must continue to push for intelligent assessment policy that’s best for our children.

 

Standardized testing should be eliminated altogether – especially in high stakes situations. Instead we should rely on classroom grades, portfolios of student work and/or other authentic measures of what children have learned in school.

 

Accountability – the typical reason given behind these assessments – should be determined by the resources provided to students, not a highly dubious score given by a corporation making a profit off of its testing, test prep and ed tech enterprises.

 

The most we can expect from DePasquale and Dinniman’s program if it is even considered by the legislature is a band-aid on a gaping wound.

 


Read the full report, Where Did Your Money Go? A Special Report on Improving Standardized Testing in Pennsylvania.


 

Like this post? I’ve written a book, “Gadfly on the Wall: A Public School Teacher Speaks Out on Racism and Reform,” now available from Garn Press. Ten percent of the proceeds go to the Badass Teachers Association. Check it out!

book-1