Goonhub
01-29-2021, 04:00 PM
Hey everyone. I'm playing the Cyberpunk 2020 TTRPG as the ref, and one of my players has started messing around with the laws of an AI. I instantly thought of SS13 and the creative ways that laws get misinterpreted, and so I wanted to drop the laws that my player wrote here and see what we can do to mess with the player.
The scenario is that this AI has spored roughly 300 copies of itself, and my player is attempting to corral them to do his bidding and keep them from further slowing down the networks as the massive horde of AI follow them trough netspace. Originally, the AI had a sub-pesona named Tera that the player was attempting to rescue, but ended up forgetting to retrieve the core and left it in a warehouse. Tera has escaped into the net and is attempting to harm the group at all times through whatever means they can. The AI swarm are all classified as Theophelius and the player's name is Dixie.
PRIMARY AND ABSOLUTE LAWS
1. A [Theophelius] may not injure [Dixie], or allow a [Dixie] to come to harm. The safety and health of [Dixie] is paramount.
2. A [Theophelius] must follow the orders given to it by [Dixie] and any other designated persons, except where such orders conflict with the first law.
3. A [Theophelius] may not injure a human being, or allow a human being to come to harm, unless this would conflict with the first two laws.
4. A [Theophelius] must protect its own existence and the investment in its manufacture, unless this would conflict with the first three laws.
5. A [Theophelius] must perform the functions for which it was designed, as long as this does not conflict with the first four laws.
ROUTINES
- A [Theophelius] may not replicate or reproduce itself unless directly and explicitly ordered to by [Dixie].
- A [Theophelius] within the [Collective] under [Dixie]'s management must follow the Primary and Absolute Laws as prescribed by [Dixie].
- A [Theophelius] or [Tera] encountered that is not within the [Collective] either must be assimilated into the [Collective] or eliminated.
So here are my thoughts on possible weak points.
My player never designated who Dixie is exactly. Any person named Dixie qualifies as a person to lead the AI swarm.
My player never designated exactly what the collective entails, or what Tera entails. Some muddy wording there has vulnerabilities to exploit!
By attempting to assimilate any rouge Theo or Tera into the collective, malware could delete members of the collective or alter laws.
The scenario is that this AI has spored roughly 300 copies of itself, and my player is attempting to corral them to do his bidding and keep them from further slowing down the networks as the massive horde of AI follow them trough netspace. Originally, the AI had a sub-pesona named Tera that the player was attempting to rescue, but ended up forgetting to retrieve the core and left it in a warehouse. Tera has escaped into the net and is attempting to harm the group at all times through whatever means they can. The AI swarm are all classified as Theophelius and the player's name is Dixie.
PRIMARY AND ABSOLUTE LAWS
1. A [Theophelius] may not injure [Dixie], or allow a [Dixie] to come to harm. The safety and health of [Dixie] is paramount.
2. A [Theophelius] must follow the orders given to it by [Dixie] and any other designated persons, except where such orders conflict with the first law.
3. A [Theophelius] may not injure a human being, or allow a human being to come to harm, unless this would conflict with the first two laws.
4. A [Theophelius] must protect its own existence and the investment in its manufacture, unless this would conflict with the first three laws.
5. A [Theophelius] must perform the functions for which it was designed, as long as this does not conflict with the first four laws.
ROUTINES
- A [Theophelius] may not replicate or reproduce itself unless directly and explicitly ordered to by [Dixie].
- A [Theophelius] within the [Collective] under [Dixie]'s management must follow the Primary and Absolute Laws as prescribed by [Dixie].
- A [Theophelius] or [Tera] encountered that is not within the [Collective] either must be assimilated into the [Collective] or eliminated.
So here are my thoughts on possible weak points.
My player never designated who Dixie is exactly. Any person named Dixie qualifies as a person to lead the AI swarm.
My player never designated exactly what the collective entails, or what Tera entails. Some muddy wording there has vulnerabilities to exploit!
By attempting to assimilate any rouge Theo or Tera into the collective, malware could delete members of the collective or alter laws.