Quote preview background for Cathy O'Neil
Will those insights be tested, or simply used to justify the status quo and reinforce prejudices? When I consider the sloppy and self-serving ways that companies use data, I'm often reminded of phrenology, a pseudoscience that was briefly the rage in the nineteenth century. Phrenologists would run their fingers over the patient's skull, probing for bumps and indentations. Each one, they thought, was linked to personality traits that existed in twenty-seven regions of the brain. Usually the conclusion of the phrenologist jibed with the observations he made. If the patient was morbidly anxious or suffering from alcoholism, the skull probe would usually find bumps and dips that correlated with that observation - which, in turn, bolstered faith in the science of phrenology. Phrenology was a model that relied on pseudoscientific nonsense to make authoritative pronouncements, and for decades it went untested. Big Data can fall into the same trap. Models like the ones that red-lighted Kyle Behm and black-balled foreign medical students and St. George's can lock people out, even when the "science" inside them is little more than a bundle of untested assumptions.
Cathy O'Neil Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
Turn into a Quote Card

Quote Detail

Will those insights be tested, or simply used to justify the status quo and reinforce prejudices? When I consider the sloppy and self-serving ways that companies use data, I'm often reminded of phrenology, a pseudoscience that was briefly the rage in the nineteenth century. Phrenologists would run their fingers over the patient's skull, probing for bumps and indentations. Each one, they thought, was linked to personality traits that existed in twenty-seven regions of the brain. Usually the conclusion of the phrenologist jibed with the observations he made. If the patient was morbidly anxious or suffering from alcoholism, the skull probe would usually find bumps and dips that correlated with that observation - which, in turn, bolstered faith in the science of phrenology. Phrenology was a model that relied on pseudoscientific nonsense to make authoritative pronouncements, and for decades it went untested. Big Data can fall into the same trap. Models like the ones that red-lighted Kyle Behm and black-balled foreign medical students and St. George's can lock people out, even when the "science" inside them is little more than a bundle of untested assumptions.
CO
Cathy O'Neil

Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy

Quick Answer

What this quote page tells you

This canonical quote page keeps the full saying, the attributed author, any linked work, and the topic tags together so the quote can be cited from one stable URL.

Related Quotes

More quote cards from the same area

"

Had Moreau had any intelligible object, I could have sympathized at least a little with him. I am not so squeamish about pain as that. I could have forgiven him a little even, had his motive been only hate. But he was so irresponsible, so utterly careless! His curiosity, his mad, aimless investigations, drove him on; and the Things were thrown out to live a year or so, to struggle and blunder and suffer, and at last to die painfully.

"

This 'web of discourses' as Robyn called it...is as much a biological product as any of the other constructions to be found in the animal world. (Clothes too, are part of the extended phenotype of Homo Sapiens almost every niche inhabited by that species.An illustrated encyclopedia of zoology should no more picture Homo Sapiens naked than it should picture Ursus arctus-the black bear- wearing a clown suit and riding a bicycle.