Skip to main content

Testing Glitches

This Business Week article on the leaking of GMAT questions (a part of a series I have been following for some time) is reflective of the kind of bathwaterism that bedevils any large enterprise public or private. Instead of trying to go after the root cause of the problem, the solution is the punish the effect and everyone who was tainted by it. This is akin to covering chicken-pox with concealer instead of preventing it by inoculation.

The users of the service as several of the commentators point out did not necessarily know that it was illegal and to that extent going after them retro-actively does not really help plug the hole through which the questions are leaking. Would it not make sense to use much more sophisticated technology to select the questions for the test and also deliver a customized and adaptive version to each test taker based on the sum total of all their academic and non-academic credentials. Needless to say, the use of a wide pool of geographically and culturally varied resources to prepare the questions is equally if not more critical.

As long as the rules of engagement are transparent and the system has been independently vetted and verified for accuracy everyone should be comfortable and more importantly advance knowledge or preparation would not confer any significant advantage. In the end, a test for the best institutions of learning should be all about putting learned concepts to the most intelligent and innovative use without having "prepared" in advance. The focus of such testing needs to shift from measuring skill to measuring innate talent.

While any amount of help understanding concepts and theoretical underpinnings of the subjects being tested is perfectly legitimate, the test itself should be designed in such a way that it just cannot be a learned or taught skill. Just doing that will put all coaching, hot-housing and tutoring facilities out of business. The standardized test even with questions randomly culled from a massive database is a set up for failure, a disaster waiting to happen.

This is exactly how India has failed to maintain the strength and consistency of its IIT and IIM brands, and would be where the American system would fail as well once the ratio of the available slots to the number of aspirants to them falls low enough.

Returning to the Business Week story itself, as much as the actions and decisions of GMAC reek of bureaucratic short-sightedness, it may prove to be a strong deterrent against seeking any form of "help" in preparing for the GMAT - at least until someone comes up with a more creative way to game the system. I can't imagine this will be the last time something like Scoretop will make headlines. As long as testing status quo prevails, elite education will produce no more than "excellent sheep" as William Deresiewicz writes.

Comments

Popular posts from this blog

Part Liberated Woman

An expat desi friend and I were discussing what it means to return to India when you have cobbled together a life in a foreign country no matter how flawed and imperfect. We have both spent over a decade outside India and have kids who were born abroad and have spent very little time back home. Returning "home" is something a lot of new immigrants like L and myself think about. We want very much for that to be an option because a full assimilation into our country of domicile is likely never going to happen. L has visited India more often than I have and has a much better pulse on what's going on there. For me the strongest drag force working against my desire to return home is my experience of life as a woman in India. I neither want to live that suffocatingly sheltered existence myself nor subject J to it. The freedom, independence and safety I have had in here in suburban America was not even something I knew I could expect to have in India. I never knew what it felt t...

Under Advisement

Recently a desi dude who is more acquaintance less friend called to check in on me. Those who have read this blog before might know that such calls tend to make me anxious. Depending on how far back we go, there are sets of FAQs that I brace myself to answer. The trick is to be sufficiently evasive without being downright offensive - a fine balancing act given the provocative nature of questions involved. I look at these calls as opportunities for building patience and tolerance both of which I seriously lack. Basically, they are very desirous of finding out how I am doing in my personal and professional life to be sure that they have me correctly categorized and filed for future reference. The major buckets appear to be loser, struggling, average, arrived, superstar and uncategorizable. My goal needless to say, is to be in the last bucket - the unknown, unquantifiable and therefore uninteresting entity. Their aim is to pull me into something more tangible. So anyways, the dude in ques...

Reading Shantaram

I finished listening to Shantaram on audiobook after several weekends of being absorbed in the story. This book had been on my to-read list for a long time and I am glad I chose the audio version of it. It is an extraordinary story teeming with colorful characters and rich detail. As an Indian who is a stranger to Mumbai and Maharashtra in that I have never spent years of my life there. I have to rely on what I know second hand. As a fan Rohinton Mistry's A Fine Balance, where in my mind I imagined the action taking place in Mumbai, this book was a chance for me to know the city through another author even if an Australian.  The author,  Gregory David Roberts comes across as someone who is able to see the soul of India through all that ails it. And in connecting with that soul, he finds some answers to his life's hard questions. India does not save him but it keeps his soul alive and striving. Most of his experiences would be unrelatable to the average person who lives a far m...