https://www.thesaturdaypaper.com.au/life/technology/2023/07/13/tipping-point?cid=1250508c4e880f356376704af3a3ad41#mtr
Australia must join a globally co-ordinated campaign to ensure the safe development of AI, which is reaching a critical phase that could have disastrous consequences.
Consider a worse fate: they do exactly as we tell them to, until we become incapable of existing apart from them.
And then they break with no one to fix them.
It’s a bit hard to imagine how all AIs could break simultaneously. Nothing short of a full-on apocalypse, and then fixing AIs would be the least of humanity’s problems.
And I’d guess in the future there would always be some local/open-source/offline AI that might be able to recreate (or help recreate) larger systems.