X-Message-Number: 30194
From: 
Date: Fri, 21 Dec 2007 18:45:44 EST
Subject: Re: CryoNet #30177 - #30186

In a message dated 12/21/2007 3:16:52 AM Mountain Standard Time,  
 writes:

[Henson]:

Robert,  I am not even sure that will do  it.  "Minimize human misery" 
is  explicit and unambiguous.   A machine without social motives might  
rationally conclude that  killing the entire population of humans was  
the most effective way  to reach the goal. "Maximize human happiness"  
could be equally  lethal.




Jack Williamson's "The Humanoids" is a fine dystopian story in which a  

powerful AI charged to "Protect" humans becomes a patronizing monster that won't
allow you to do anything that might be "harmful". A good read, from around  
1950.
 
Because of a thousand such science fiction stories stretching over nearly a  
century, it is unlikely that an AI will be given physical power or contact 
with  the outside world through the Net.
 
Alan



**************************************See AOL's top rated recipes 
(http://food.aol.com/top-rated-recipes?NCID=aoltop00030000000004)


 Content-Type: text/html; charset="US-ASCII"

[ AUTOMATICALLY SKIPPING HTML ENCODING! ] 

Rate This Message: http://www.cryonet.org/cgi-bin/rate.cgi?msg=30194