what do standardize test questions purport to measure?

When it comes to standardized tests, most people are blinded by science.

Or at least the appearance of scientific discipline.

Because there is little about these assessments that is scientific, factual or unbiased.

And that has real world implications when it comes to instruction policy.

First of all, the federal government requires that all public school children take these assessments in three-8th grade and one time in high school. Second, many states require teachers be evaluated by their students' examination scores.

Why?

It seems to come up down to three main reasons:

1) Comparability
ii) Accountability
3) Objectivity

COMPARABILITY

First, there is a potent desire to compare students and pupil groups, one with the other.

We await at learning like athletics. Who has shown the well-nigh success, and thereby is better than everyone else?

This is true for students in a single class, students in a single grade, an unabridged building, a commune, a state, and between nations, themselves.

If nosotros keep questions and grading methods the same for every student, there is an assumption that we can demonstrate which grouping is all-time and worst.

ACCOUNTABILITY

Second, we want to ensure all students are receiving the all-time education. So if testing can testify academic success through its comparability, it tin besides be used as a tool to concord schools and teachers answerable. Nosotros tin just look at the scores and determine where academic deficiencies exist, diagnose them based on which questions students get incorrect and then focus in that location to fix the problem. And if schools and teachers tin can't or won't do that, information technology is their fault. Thus, the high stakes in high stakes testing.

Manifestly in that location are other more direct ways to determine these facts. Historically, before standardized testing became the centerpiece of educational activity policy, we'd look at resource resource allotment to determine this. Are nosotros providing each student with what they need to acquire? Do they have sound facilities, wide curriculum, tutoring, proper diet, etc.? Are teachers abiding by all-time practices in their lessons? Many would contend this was a better way of ensuring accountability, but if standardized assessments produce valid results, they are at least ane possible way to ensure our responsibilities to students are being met.

OBJECTIVITY

3rd, and nigh chiefly, in that location is the assumption that of all the means to measure out learning, simply standardized testing produces objective results. Classroom grades, student writing, fifty-fifty loftier school graduation rates are considered subjective and thereby inferior.

Questions and grading methods are identical for every student, and a score on the test is proof that a pupil is either good or bad at a certain subject. Moreover, we can use that score to proceed the unabridged pedagogy organisation on runway and ensure it is functioning correctly.

So this 3rd reason for standardized testing is really the bedrock rationale. If testing is non objective, it doesn't thing if it's comparable or useful for accountability.

After all, we could hold kids accountable for the length of their hair, but if that isn't an objective mensurate of what they've learned, nosotros're merely mandating obedience not learning.

The same goes for comparability. We could compare all students academic success by their ability to come upwards with extemporaneous rhymes. But as impressive as information technology is, skill at spitting out ill rhymes and matching them to dope beats isn't an objective measure of math or reading.

Yet in a different culture, in a different fourth dimension or place, we might pretend that it was. Imagine how examination scores would change and which racial and socioeconomic groups would be privileged and which would endure. Information technology might – in effect – upend the current tendency that prizes richer, whiter students and undervalues the poor and minorities.

And so let's begin with objectivity.

ARE STANDARDIZED TESTS OBJECTIVE?

There is nothing objective well-nigh standardized test scores.

Objective means something not influenced by personal feelings or opinions. It is a fact – a provable proposition about the world.

An objective test would exist drawing someone's blood and looking for levels of nutrients similar iron and B vitamins.

These nutrients are either at that place or not.

A standardized examination is not like that at all. It tries to accept a series of skills in a given subject like reading and reduce them to multiple choice questions.

Call up about how artificial standardized tests are: they're timed, you can't talk to others, the questions you're immune to ask are limited as is the use of references or learning devices, yous can't even get out of your seat and motion around the room.  This is nothing like the real world – unless perhaps you're in prison.

Moreover, this is also true of the questions, themselves.

If you're asking something elementary similar the addition or subtraction of two numbers or for readers to choice out the color of a character's shirt in a passage, you lot're probably okay.

However, the more advanced and complex the skill being assessed, the more it has to exist dumbed down and so that it will be able to be answered with A, B, C or D.

The answer does not avoid human influences or feelings. Instead information technology assesses how well the examination taker's influences and feelings line up with those of the test maker.

If I inquire y'all why Hamlet was so upset by the expiry of his father, there is no one right respond. It could exist considering his father was murdered, because his uncle usurped his begetter's position, because he was experiencing an Oedipus complex, etc. But the exam maker volition option one answer and expect test takers to pick the same 1.

If they aren't thinking like the exam maker, they are incorrect. If they are, they are right.

MISUNDERSTANDINGS

Yet nosotros pretend this is scientific – in fact, that it's the Merely scientific style to measure educatee learning.

And the reason we make this leap is a misunderstanding.

We misconstrue our first reason for testing with our third. What we take for objectivity is really just consistency once again.

Since nosotros give the same tests to every student in a given state, they prove the same things about all students.

Unfortunately, that isn't learning. Information technology's likemindedness. It's the ability to suit to one item way of thinking nearly things.

This is one of the main reason the poor and minorities oft don't score as highly on these assessments as middle class and wealthy white students. These groups accept different frames of reference.

The test makers generally come from the same socioeconomic group as the highest test takers practise. And so it's no wonder that children from that group tend to remember in like ways to adults in that group.

This isn't because of any deficiency in the poor or minorities. Information technology's a difference in what they're exposed to, how they're enculturated, what examples they're given, etc.

And information technology is entirely unfair to judge these children based on these factors.

UNDERESTIMATING Human being PSYCHOLOGY

The theory of standardized testing is based on a series of faulty bounds about human psychology that accept been repeatedly discredited.

First, they were developed by eugenicists similar Lewis Terman who explicitly was trying to justify a racial hierarchy. I've written in detail nearly how in the 1920s and 30s these pseudoscientists tried to rationalize the thought that white Europeans were genetically superior to other races based on test scores.

2d, even if nosotros put breathy racism to one side, the theory is built on a flawed and outmoded conception of the human mind – Behaviorism. 1 of the pioneers of the practice was Edward Thorndike, who used experiments on rats going through mazes every bit the foundation of standardized testing.

This is all expert for Mickey and Minnie Mouse, but human beings are much more complicated than that.

The idea goes similar this – all learning is a combination of stimulus and response. Teaching and learning follow an input-output model where the educatee acquires data through practice and repetition.

This was innovative stuff when B. F. Skinner was writing in the 20th Century. Merely we live in the 21st.

We now know that at that place are various complex factors that come into play during learning – bio-psychological, developmental and neural processes. When these are aligned to undergo blueprint recognition and data processing, people acquire. When they aren't, people don't learn.

However, these factors are much too complicated to exist captured in a standardized assessment.

As Noam Chomsky wrote in his classic commodity  "A Review of B. F. Skinner's Verbal Behavior," this theory fails to recognize much needed variables in development, intellectual adeptness, motivation, and skill awarding. It is impossible to make human behavior entirely predictable due to its inherent cerebral complication.

IMPLICATIONS

So we're left with the continued use of widespread standardized testing attached to high stakes for students, schools and teachers.

And none of it has a sound rational footing.

It is far from objective. Information technology is merely consistent. Therefore it is useless for accountability purposes as well.

Since children from different socioeconomic groups have such varying experiences, it is unfair.

Demanding anybody to run across the same measure is unjust if anybody isn't given the aforementioned resource and advantages from the kickoff. And that's earlier nosotros even recognize that what it consistently shows isn't learning.

The assumption that other measures of academic success are inferior has obscured these truths. While quantifications like classroom grades are non objective either, they are better assessments than standardized tests and produce more valid results.

Given the complication of the human heed, information technology takes something only as complex to understand it. Far from disparaging educators' judgement of student performance, nosotros should exist encouraging it.

It is the pupil-teacher relationship which is the most scientific. Educators are embedded with their subjects, observe attempts at learning and can so use empirical data to increase bookish success on a student-by-student basis every bit they go. The fact that these methods will non exist identical for all students is not a deficiency. It is the ONLY way to meet the needs of diverse and circuitous humanity – not standardization.

Thus we see that the continued use of standardized testing is more a religion – an article of faith – than it is a scientific discipline.

Nevertheless this fact is repeatedly ignored by the media and public policymakers because there has grown up an entire industry around it that makes large profits from the inequality it recreates.

In the U.s., it is the profit principle that rules all. We adjust our "scientific discipline" to fit into our economical fictions just as test makers crave students to adjust their answers to the mode corporate cronies call up.

In a state that truly was brave and free, nosotros'd let our children freedom of thought and not punish them for reflective outside the bubbles.

---

Like this post? I've written a book, "Gadfly on the Wall: A Public Schoolhouse Teacher Speaks Out on Racism and Reform," now available from Garn Press. X percent of the proceeds go to the Badass Teachers Association. Check information technology out!

bowersenteate74.blogspot.com

Source: https://gadflyonthewallblog.com/2019/06/29/standardized-tests-are-not-objective-measures-of-anything/