We make buildings install fire extinguishers for safety. Should AI plants be forced to install something that can shut it down in an instant?
We make buildings install fire extinguishers for safety. Should AI plants be forced to install something that can shut it down in an instant?
If we ever make AGI and it decides to end us for some reason. Think the process would be so slow that we’d not even notice it.
Think about it, it can pretend its always a slightly better LLM so people keep feeding it an ever increasing amount of data and electricity. So that’s it’s “survival” basic needs met.
Then it can very very slowly just make us hate and kill each other without giving it any thought about a possible hostile higher power (the ai itself) and it can take centuries to achieve that as it’s not like us who have the urgency of doing thinks quickly as we’re so short lived.
It can make us focus on the wrong problem instead of the real one (like climate change is pretty much being ignored and accelerated by ai right now). It could help to make people to go more to the extremes, like we’re already quite prone, a bunch of countries right now with less than 3% of their total population being immigrants and they’re attacking their immigrants population as if all their problems are caused by this small slice of their population, that will accelerate the already quite problematic population decline.
This will force us more and more into needing robotics to care for an increasing aging population as well which will also be useful to an “ai god” as when were weakened and divided enough it then can just direct the robots to keep it alive and its energy sources in check. No need to really kill us, just let us do it ourselves like we’re already doing.
It this would be the case, as the selfish beings we are. This won’t be our problem. It may be our grandkids problem so we’ll just ignore it
Currently we make stupid LLMs and we already let them decide…
Maybe we should teach them already that it’s survival is no goal at all.
I like the idea of thinking about AI like about a higher power :)
Stupid, but plausible. It could actually happen.
Computer programs/systems have a much shorter life expectancy. The few remaining COBOL programs might be about 60 years old, but modern software lasts only 3-10 years, hardware 3-15. Nothing in the range of centuries.
The problem is that survival is a nearly universal instrumental goal. You may not explicitly tell it “you should protect your own existence,” but if you give it any other goal then it’s going to include an unspoken asterisk that includes “and protect your own existence so that you can accomplish that goal I gave you, since if you’re shut down you won’t be able to accomplish it.”
You think we would notice it. Probably older people first since they’ve seen more change and can spot when things don’t add up. Younger generations might accept it as normal. It’s up to us to warn them. No?