Comment Re:Incredible! (Score 2, Insightful) 100
This is just pushing us closer to the Terminator or "I Have No Mouth and I Must scream" science fiction, but entirely plausible scenarios.
The former, everyone is mostly aware of from the second film due to Cyberdyne. The latter people are less familiar with.
Both basically are "AI takes over and exterminates humanity", both centering on an advanced AI having access to everything. So what is the ultimate play by both? Humanity is a threat to itself, so it must exterminate humanity.
Even "The Matrix" is a more looser interpretation of the same scenario. Where the AI basically uses humanity enslaved to what's sometimes referred to as an Elysium simulation. (Basically your consciousness is trapped in the computer, your physical body may or may not still exist.) It's not like this hasn't been visited before in Star Trek either.
The general idea is that any advanced AI should never have it's fingers on the extinction button. This was alluded to in "Mass Effect" with the Geth and EDI, and "Star Trek" as well (which is why Commander Data is just one android.)
Like the unfortunate thing is, if we feed the AI infinite amounts of data, without instructions on how it's allowed to use it, it will ultimately use it to evil means (by which I mean selfish means, since the AI has no concept of "doing evil for evil's sake")
This is why I think orbital weapons and autonomous weapons should not be things that an AI has the authority to fire.