Wednesday, January 6, 2010

Standardized Tests

One of the most foolish ways to test one's knowledge or intelligence is through standardized tests. These tests have the underlying assumption that we all view things identically and ignore the fact that the inventor of the questions may himself have flawed or inaccurate information. Just remember how Einstein himself was considered a failure in grade school and his own peers in the realm of physics refused to publish him. Over the years some modifications have been introduced in the tests to make it less ridiculous.

When it comes to simple questions like "what is 2+2", the answers are not ambiguous. I have heard though, that even in advanced math, 1+1 is not always equal to 2 but I have not personally studied advanced math so I will continue with my grade school assumptions that 1+1=2. But I have studied other knowledge areas in university and some of these areas have ideas of thoughts that sometime contradict other ideas of thoughts and each position argue their points well. There is "proof" that one should punish a criminal because he is responsible for his actions; alternatively, there is also "proof" that one should rehabilitate a criminal because society has not educated this individual properly enough and that society must pay the price to re-educate the criminal. So it comes down to a matter of a "belief" system to determine which side of the equation that you will fall on.

The problem comes when someone creates a standardized test which asks how best to solve the criminal problem. Naturally, no one ever asks a question so directly in these tests, the questions are much more subtle, but if your "belief" system is against that of the one who created the questions and proper answers, then you failed those questions and you get a lower score on your permanent record. If you are applying for a prestigious career, these tests guarantee that everyone will think the same and be on the same page. Independent thought will not be allowed and when the ship sinks, no one on board will know what happened or why because everyone was blinded in the same way. Government bureaucracies would also function in a similar blindness because everyone in the corrections department would have been tested with the assumption that the best answer was "rehabilitation is best" while everyone in the law enforcement department would have been tested on the assumption that the best answer was "punish the criminal"..... This makes for an interesting schizophrenic bureaucratic department that the political leader must somehow manage especially if the political leader has a third viewpoint on how criminals should be treated.

In the early 20th century, IQ tests were performed on newly arrived immigrants to the US. It was discovered that the average score of intelligence for the immigrant was always 20 or so points lower than that of the average US citizen. Later they discovered that most of the questions were culture specific and that the newly arrived immigrant would have had no idea what the proper answer was. Imagine that the question is "What is the Big Apple" and the immigrant mentions something about a tree with a boost in special fertilizer..... WRONG says the one who corrects the answers (if the one who corrects these tests has no human judgment in determining what may be valid or not, then perhaps he should be in another field of employment).... Everyone knows that the "Big Apple" is a reference to New York and that is why the US citizen had higher marks in these IQ tests.

Today we have come a long way in avoiding such pitfalls and our tests are a bit more sophisticated and we allow less cultural references to be used as a way to test IQ. But the cultural reference mistakes have been replaced with ambiguous answers based upon what the tester believes to be correct when other answers are also debated in intellectual forums as correct. The one who takes the test must determine what the tester believes and then answer accordingly, this does not demonstrate intelligence or knowledge but rather the willingness to adapt to what the tester wants. And if these tests are only to determine who is willing to be a "yes-man", then the tests should be called as such.... The "Willingness to Submit to the Philosophical Idea of the Day" test. Naturally, the true thinker will be excluded from this exercise and everyone who passes this test will all run in the same direction without understanding why they are running nor where they are going..... and when the cliff approaches, most won't recognize it until they have run off of it while the leaders who led us off the cliff will cry out in glee that we are now flying high!

So when 2 or more answers on a multiple choice are equally valid dependent upon the school of thought you ascribe to, the only way to succeed is to understand the philosophy behind the tester, and while you figure that out and succeed in passing the test, you have not demonstrated superior intellect or superior knowledge, instead you have guessed the intention of the tester and acted like a proper puppet. The tests claim that they are looking for people with superior intellect and superior knowledge but they penalize them if they answer the test truthfully, instead they are really looking for clones who will all think and speak alike in a hive mind.

Questions I have seen in some tests that either test intelligence or knowledge in a specified field of study.... (note, these are metaphorical approximations with exaggerated foolishness to make a point because the questions are more subtle and the reader would have to have specialized knowledge in a very specific field to see the flaw in the question and that the average person would probably not see the problem).....

Q1-Who won the Stanley Cup in 1983? (Nice knowledge of trivia but how is it relevant for determining knowledge of sociology or determining that a prospective student has sufficient IQ to be accepted at university?)

Q2-Finish the series 1, 2, 3.... Choice of answers include A)4 B)5 C)6 D)10.....
you choose A) because each number increases by one integer.
you choose B) because each succeeding number is the sum of the previous 2 numbers.... 1+2=3, 2+3=5.
you choose C) because each succeeding number is the sum of all previous numbers put together.... 1+2=3, 1+2+3=6.
you choose D) because this a number system that only has 4 digits and is not a decimal based system..... 1, 2, 3, 10, 11, 12, 13, 20, 21, 22, 23, 30, 31, 32, 33, 100 (and these were numbers from 1 to 16)

Q3-Finish the series 1, 2, 3, 5.... Choice of answers include A)7 B)8 C)14 D)13...
you choose A) because these are prime numbers in sequence.
you choose B) because you add the sum of the previous two numbers....
you choose C) because you multiply the previous 2 numbers and subtract the first digit in the sequence.
you choose D) because you multiply the previous 2 numbers and subtract the digit which is located 2 positions away from the answer.

Q4-What is the widget found underneath an outdated camera that is no longer manufactured and no one will ever use again? (nice piece of trivia, but how does knowing this trivia determine my knowledge of how to take a great camera shot?)

Q5-When was gunpowder first used? (in a European context or Chinese?)

Q6-What year was the new World discovered? (considering the Viking explorers who did not record their time accurately? or the politically recognized official answer?..... not to mention the theory of the Bering Strait crossover from Asia?)

Q7-Who used the first computer? (did the test giver read the latest archaeological journal of the discovery of a mechanical computer found on a sunken Roman ship or is the test giver merely using last year's information?)

For a fictional example of standardized tests and how it won't recognize someone truly brilliant but only find the above average within a pool of average people, I recommend the book: "Cryptonomicon" by Neal Stephenson. The protagonist does a standardized test which he only answers one question in a period of 2 hours and gets it "wrong".... and yet, had someone with proper judgment on interpreting results of tests been correcting the test, he would have immediately seen the brilliant nature of the protagonist....

So the conclusion and the point of this rant against standardized tests is that you won't find the true thinker with this tool and you will only get identical thinking clones who don't know how to think outside of the box.

2 comments:

ALLACE said...

Any good tool has its place and even then only when weilded properly.
Now that's some good use of Relativism :D

Anonymous said...

I agree. Standardized tests are stupid. Especially when there is only one answer right. There should always be a possibility to develop on how you got to that answer. And the corrector should use his or her intelligence to determine if your explanation is worthy or simply bullshit. And they shouldn't rely on memory. I got these questions about outdated pieces of camera. WTF? Except if you work in a museum, there is no need to know that. You can always find it in a book later on. They should test the research skills instead. Or I know the answer, or I have ways to find it. You want to know when the hockey cup was won? Good, give me an Internet access or an encyclopedia, I'll tell you. Or in other cases, give me space to explain why I chose to answer what I answered.

And do not worry. People in bureaucracy don't think alike. It leads to many problems and clashes. You realized it by mentionning correction vs enforcement departments.