START A PETITION 25,136,189 members: the world's largest community for good
START A PETITION
x
760,800 people care about Education

Standardized Test Flaws Fail Students

Standardized Test Flaws Fail Students

In New York State, standardized tests are a big deal. Students started preparing for the 2012 English Language Arts and Math exams at the end of last school year. Teachers — at least at my school — are required to attend endless professional development sessions to help them better prepare their students for these rather daunting assessments. If students don’t pass, they’re likely to either be held over or forced to attend summer school.

The recent buzz surrounding standardized tests suggests all this pressure and preparation may have been undermined by some rather perplexing test flaws.

The 8th grade ELA test contained an odd question about an even odder fable involving a talking pineapple that apparently had no correct answer. According to WNYC’s and The New York Times’ joint website, Schoolbook, a 4th grade ELA question involved a passage about a talking yam that had previously been required reading for some schools and not for others. Hardly fair.

The New York State Math exam wasn’t free from criticism either. One 8th grade math question had no correct answer, so students were told at the beginning of the test that if they bubbled in any answer, they would still receive credit. In another case, one 4th grade math question had two correct answers, but teachers were advised only to let the students know about the flaw if they specifically asked about the question. Not exactly consistent test protocol.

Elizabeth Phillips, Principal of PS 321 in New York City, wrote a letter to John B. King Jr., education commissioner of New York State, enumerating her many concerns. In it, she states that even adults in her building were unable to decode some questions on the 5th grade ELA exam and asserts that such questions were more of a trick than a test. She also accuses test maker Pearson of putting urban students at an unfair disadvantage by including a large number of questions set in rural and suburban areas on the most heavily-weighted section of the 4th grade ELA exam. Principal Phillips:

“I have been principal for 13 years and have read the tests each year. Although there are always issues with selected questions, generally it is only one or two per test that the assistant principals and I can’t quite agree on. I am genuinely shocked that with the increased importance of state testing, there are so many more flawed questions than ever before.”

She goes on to hammer home the true significance of these problematic tests, not just for students, but for schools and teachers as well:

“The idea that teachers may lose their jobs and schools (at least in New York City) may be closed based on how children do on these problematic exams is incredibly upsetting and demoralizing to educators…I hope that you will consider recommending to the State Legislature that given the flaws in the tests, we are not yet ready to use them for high stakes decision making.”

So why weren’t mistakes fixed and unfair questions tossed out ahead of time? It seems test-maker Pearson and that familiar root-of-all-evil, money, are at least partially to blame.

It’s not the first time that oddities like the — let’s say, interesting — pineapple question have popped up on standardized tests. According to Diane Ravitch, an education professor at NYU, Pearson’s test questions have varying price tags. For states like Texas that are willing to slap down $500 million, Pearson is willing to provide nice, new, high-quality questions that haven’t previously appeared on other states’ standardized tests. New York, however, a state that had only a measly $32 million for Pearson, gets the old, recycled, sometimes flawed questions, even if other states have already used them in standardized tests and found them lacking.

Fred Smith’s article in the Washington Post sheds more light on Pearson’s money-driven strategy. He writes that according to their contract, they have to include “20-25 nationally-normed multiple-choice questions per grade.” That means that they’re spitting out between 120 and 150 nationally-normed questions in both ELA and Math — questions that they don’t have to spend money on developing from scratch. They embed them in state tests, then turn around and sell them to other states with data showing how kids do on them. The result? Exponential profits for minimal work.

Again from Principal Phillips:

“I know that the state already has a long-term contract with Pearson, but there is something seriously wrong with a testing company that has such inappropriate questions and passages on such a high stakes test.”

If companies like Pearson are all about the bottom line, how can we guarantee that the quality of work they produce is fit to measure our students’ progress? Why should students, teachers and support staff go through extensive efforts for exams that won’t even give them an accurate measure of improvement?

It’s called high-stakes testing for a reason. The fact that these tests, particularly in New York State, can be the difference between a student moving on to the next grade or being held back means that test-providers have a duty to make sure that they are providing high-quality, accurate materials. Anything less is a waste of schools’ scarce resources and essentially renders the entire testing process moot.

I guess for those opposed to standardized testing, Pearson’s recent mistakes are just one more piece of evidence to ditch standardized tests and move toward a more informative, comprehensive way of assessing our students.

What do you think?

 

Related Stories:

Michelle Rhee’s Potential DC Cheating Scandal

Low-Income Housing Tied To Low School Success

Nature and Test Scores Blooming At This Urban L.A. School

Read more: , , , , ,

Photo Credit: Hans Gerwitz via Flickr

quick poll

vote now!

Loading poll...

have you shared this story yet?

some of the best people we know are doing it

19 comments

+ add your own
2:44AM PST on Jan 21, 2013

This is horrific.

12:30AM PDT on May 9, 2012

You know who, you really are becoming obsessive, and now you're resorting to thread snatching.

10:49PM PDT on May 8, 2012

Funny, I've taught university in the US & Canada--in Canada, we don't have all these fill in the bubble standardized tests in secondary & primary school, but we do have students who are better readers, writers, and analytical thinkers. Could there be a connection?

10:11PM PDT on May 8, 2012

Yes, the contract should be revoked for non-performance on Pearson's part. This will not really solve anything as the entire system set up under NCLB is deeply flawed. Let's drop into analogy land here. You have 1 car and are saving to buy another, but have a long way to go. One day you start the car to go to work and it belches a huge black cloud from the exhaust, so you decide that instead of having it looked at you should instead invest more in the new car fund. Some time later, the engine begins an ominous rattle, which you decide means you should invest even more in the new car fund rather than taking your existing car to a mechanic. Further, you write a reprimand to your local mechanic, who you never took your car to for failing to fix it. Later still, the engine in your car dies completely with a metal on metal gating of finality. What do you do in response? You push to have the local mechanic shut down for not fixing your car, which you never took to him, and you push the dead car to a church so it can learn how wrong Darwin was, how the US was founded as a religious state, etc, etc, etc, ad nauseum. Of course, you are now walking, taking the bus, or trying to find other rides because your new car fund is no where near what you need to actually buy the new car. With the failing schools, as with the car, we need to find out whey they are failing, and fix them, not close them down.

7:30PM PDT on May 8, 2012

"there is a religious extremist and corporatist agenda to destroy public education."

Standard tests are just brain washing and this is exactly what religious extremists and corporations want, they don't make kids THINK! All religions fight to suppress "thinking" because when you apply logic to "religion" it becomes glaringly obvious all religions are LIES and bullshit complete with fairy gods, pie heavens and 72 virgins. If the Catholic Church and the GOP billionaires can't keep the poor people IGNORANT and brainwashed in RELIGION, the children will never agree to go DIE IN ENDLESS WARS FOR NOTHING. Why would a kid go to WAR if he realized he would DIE A HORRIBLE DEATH, NOT GO TO PIE HEAVEN, NEVER HAVE A CHANCE TO HAVE SEX, NEVER GET MARRIED and BE GONE FOREVER. Kids are LIED to, told that "this" life is NOTHING, just WAIT til the NEXT LIFE!! The truth is, we all have only THIS LIFE and it's the ONLY ONE WE WILL EVER HAVE. These tyrannical religious regimes have RAPED THEIR OWN FOLLOWERS' CHILDREN and KILLED MILLIONS OF THEIR CHILDREN IN RELIGIOUS WARS, ALL FOR NOTHING! Religions should be BANNED from the face of the earth!


7:30PM PDT on May 8, 2012

"there is a religious extremist and corporatist agenda to destroy public education."

Standard tests are just brain washing and this is exactly what religious extremists and corporations want, they don't make kids THINK! All religions fight to suppress "thinking" because when you apply logic to "religion" it becomes glaringly obvious all religions are LIES and bullshit complete with fairy gods, pie heavens and 72 virgins. If the Catholic Church and the GOP billionaires can't keep the poor people IGNORANT and brainwashed in RELIGION, the children will never agree to go DIE IN ENDLESS WARS FOR NOTHING. Why would a kid go to WAR if he realized he would DIE A HORRIBLE DEATH, NOT GO TO PIE HEAVEN, NEVER HAVE A CHANCE TO HAVE SEX, NEVER GET MARRIED and BE GONE FOREVER. Kids are LIED to, told that "this" life is NOTHING, just WAIT til the NEXT LIFE!! The truth is, we all have only THIS LIFE and it's the ONLY ONE WE WILL EVER HAVE. These tyrannical religious regimes have RAPED THEIR OWN FOLLOWERS' CHILDREN and KILLED MILLIONS OF THEIR CHILDREN IN RELIGIOUS WARS, ALL FOR NOTHING! Religions should be BANNED from the face of the earth!


1:00PM PDT on May 8, 2012

What NCLB and the tyranny of standardized testing actually show, if you look at who the driving forces behind them have been and who profits from them, is that there is a religious extremist and corporatist agenda to destroy public education, except perhaps as a de facto re-segregated
system for the poor.

10:03AM PDT on May 8, 2012

Standardized tests aren't perfect. They are an attempt at guaranteeing a minimal education for all young people. It camouflages the real problem. We have a strong union and other laws protecting mediocre schools, administrators, and teachers. Focus on testing them and see what happens!

7:00AM PDT on May 8, 2012

Sad that our public education system is so homogenized. Goes to show once again that big government can not serve a country as diverse as ours.

6:18AM PDT on May 8, 2012

I appreciate the mention of Diane Ravitch. She started out somewhat on the other side of these matters until she saw the negative effects of NCLB and related trends on public education. She has become one of the most accessible and wisest critics of the whole NCLB/standardized testing industry scam. Along with
the great Jonathan Kozol, I look to her to help me understand the current insanity. Readers unfamiliar with Ravitch owe it to themselves to click on the link in this article.

add your comment



Disclaimer: The views expressed above are solely those of the author and may not reflect those of
Care2, Inc., its employees or advertisers.

ads keep care2 free

Recent Comments from Causes

Extreme histrionics on either side are not acceptable. Period. And although I'm a Christian, I doubt…

While non human animals are legally catagorised as products or commodities rather than living beings,…

Camilla V. “sounds like this woman is very stupid” and just what would you do if you were…

Story idea? Want to blog? Contact the editors!
ads keep care2 free

more from causes




Select names from your address book   |   Help
   

We hate spam. We do not sell or share the email addresses you provide.