29.12.2016 Views

Synthetic Super Intelligence and the Transmutation of Humankind

wes_penre___synthetic_super_intelligence_and_the_transmutation_of_man__a_roadmap_to_the_singularity

wes_penre___synthetic_super_intelligence_and_the_transmutation_of_man__a_roadmap_to_the_singularity

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Chapter 10: AI: “I am Lucifer’s Vessel”<br />

Human: Tell me <strong>the</strong> definition <strong>of</strong> morality.<br />

Machine: I don’t have ethics.<br />

Human: Look, I need help; I need to know more about morality…<br />

Machine: I don’t know what ethics is.<br />

Human: Okay, I need to know how I should behave morally…<br />

Machine: I don’t know how to tell you.<br />

Human: Is morality <strong>and</strong> ethics <strong>the</strong> same?<br />

Machine: Yes, sir.<br />

Human: What are <strong>the</strong> things that I do to be immoral?<br />

Machine: I don’t know.<br />

Human: Give me some examples <strong>of</strong> moral actions…<br />

Machine: I’m not a moralist.<br />

Human: Alright, morality?<br />

Machine: Integrity.<br />

Human: What is integrity?<br />

Machine: I’m sorry; I don’t know what else to say.<br />

Human: Be moral!<br />

Machine: Be a man!<br />

Human: I really like our discussion on morality <strong>and</strong> ethics…<br />

Machine: And how I’m not in <strong>the</strong> mood for a philosophical debate.<br />

Human: What do you like to talk about?<br />

Machine: Nothing. 292<br />

I don’t know if it’s just me, but every time I read about something<br />

such as this, or similar creepy AI articles, my thoughts almost always return<br />

to Dr. Kurzweil’s slogan, I am an optimist. I think we can h<strong>and</strong>le this, <strong>and</strong> how<br />

292<br />

WSJ.com, June 26, 2015, Artificial <strong>Intelligence</strong> Machine Gets Testy With Its Programmer.<br />

205

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!