09-01-2016, 03:29 PM
(09-01-2016, 02:58 PM)Mordent Wrote:(09-01-2016, 01:47 PM)Noah Buttes Wrote:(09-01-2016, 01:22 PM)Mordent Wrote: On the topic of laws, I'd suggest adding a "high numbered laws take precedence in the case of conflict" base law (not even a law, just a state), which makes some things a touch easier on the AI with the inevitable conflicting laws. The reason for "higher" rather than "lower" is that it makes it possible to overwrite-by-adding if necessary.
I'm gonna have to say no on that.
Say someone uploaded a poorly worded law like "Stop all the bad guys."
What would happen then?
Firstly, that law is subjective as anything. Garbage in, garbage out.
Secondly, that law wouldn't override Law 1 explicitly, both can be carried out without conflict ("stop" doesn't mean harm). You could use your cyborgs to pen them into a corner. You could bolt them in rooms. You could incessantly undress them of their gear. You could incessantly slip them.
Thirdly, it also doesn't override Law 2 explicitly, and both can be carried out without conflict - if they asked to be let out you still have to obey it (pursuant to Law 1) then find another way to stop them.
I'm not sure how this particularly law would be a problem.
My argument sounded a lot better in my head.