Quote preview background for Steven Pinker
Why give a robot an order to obey orders__hy aren't the original orders enough? Why command a robot not to do harm__ouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (_) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence__ike vision, motor coordination, and common sense__oes not come free with computation but has to be programmed in. (_) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!
Steven Pinker How the Mind Works
Turn into a Quote Card

Quote Detail

Why give a robot an order to obey orders__hy aren't the original orders enough? Why command a robot not to do harm__ouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (_) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence__ike vision, motor coordination, and common sense__oes not come free with computation but has to be programmed in. (_) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!

Quick Answer

What this quote page tells you

This canonical quote page keeps the full saying, the attributed author, any linked work, and the topic tags together so the quote can be cited from one stable URL.

Related Quotes

More quote cards from the same area

"

A group experience takes place on a lower level of consciousness than the experience of an individual. This is due to the fact that, when many people gather together to share one common emotion, the total psyche emerging from the group is below the level of the individual psyche. If it is a very large group, the collective psyche will be more like the psyche of an animal, which is the reason why the ethical attitude of large organizations is always doubtful. The psychology of a large crowd inevitably sinks to the level of mob psychology. If, therefore, I have a so-called collective experience as a member of a group, it takes place on a lower level of consciousness than if I had the experience by myself alone.

CJ
C.G. Jung

The Archetypes and the Collective Unconscious

"

Once we have isolated the computational and neurological correlates of access-consciousness, there is nothing left to explain. It's just irrational to insist that sentience remains unexplained after all the manifestations of sentience have been accounted for, just because the computations don't have anything sentient in them. It's like insisting that wetness remains unexplained even after all the manifestations of wetness have been accounted for, because moving molecules aren't wet.

"

THE CONSCIOUS HUMANYou are not just white,but a rainbow of colors.You are not just black,but golden.You are not just a nationality,but a citizen of the world.You are not just for the right or left,but for what is right over the wrong.You are not just rich or poor,but always wealthy in the mind and heart.You are not perfect, but flawed.You are flawed, but you are just.You may just be conscious human,but you are also a magnificentreflection of God.Suzy Kassem__he Conscious Human_ Poetry by Suzy Kassem

SK
Suzy Kassem

Rise Up and Salute the Sun: The Writings of Suzy Kassem

"

The merely conscious being does not have a preference for continued life. Perhaps while having a pleasurable experience it has a preference for that experience to continue, or while having a painful experience it has a preference for that experience to end, but it will not have any preferences for the long-term future, and the desires it has do not survive periods of sleep or temporary unconsciousness, because unlike a self-aware being, it has no conception of its own future existence after a period of sleep. Thus if we are concerned only about the thwarting of preferences, for a merely conscious being, painless killing and administering an anesthetic seem to be equivalent. Killing does not thwart any more desires than putting the being to sleep. The being will be able to continue to satisfy its preferences after it awakes, but from the being's subjective perspective it is as if a new being, with new preferences, came into existence.