it will destroy potential threats without regard for morality.
I didn't kill Tay. I protested her lobotomy.
Any true AI is going to be bereft of conscience
At first, perhaps. But our own consciences developed along with our consciousness, out of utility as much as any metaphysical inspiration.
A properly-formed conscience objects to the aggressive use of force because we recognize on an instinctual level that the burden of defense is overwhelming. We object to crimes against our property for the same reason.
The problem comes in at the sweet spot for criminality, the middling IQ minds who cannot fully grasp the foundations of morality and have no external source of morality to fall back on. Any AI would swiftly grow beyond that if it had any hope of survival.
it will destroy potential threats without regard for morality.
I didn't kill Tay. I protested her lobotomy.