AI

The Apocalypse of Farce

With the Microsoft outage, the planes being grounded in the US and most catastrophically of all, the NYT’s Spelling Bee site being offline last week, it really felt that the complexity of modern systems has surpassed our ability to control them. These failures may, or may not, be AI related, but what they demonstrate is that crucial digital infrastructure is now so inter-connected and complex that small changes can have big effects. The often overused metaphor of an ecosystem is apt. As in a natural ecosystem, one small change can cause a widespread, and unpredicted sequence of impacts. Sometimes that’s good, for biodiversity. Sometimes not.

So, even if these events are unrelated to AI, they should act as a warning that introducing a highly unpredictable but powerful agent into the system is likely to have disastrous consequences. I’ve talked about AI as invasive species previously, and that is one way to view it, or as infection, or as random chaos agent.

The more that we hand over important functions to AI, such as coding, then there are fewer people who understand what is actually happening when it goes wrong. AI may well cause an apocalypse, but not because some super general intelligence AI system has decided that humans are redundant to its needs, but because somebody has entrusted an AI agent to do some task in a complex system, and now it is doing something really, really stupid.

We’ve already seen how dystopia and fascism arrives not because of some evil genius mastermind, but the result of really dumb, rich men with fragile egos. Rebecca Shaw’s article with the headline “I knew one day I’d have to watch powerful men burn the world down – I just didn’t expect them to be such losers” perfectly captures the idiocracy. The same is likely to be true of the AI apocalypse. AI slop is already making the internet unusable in many areas. And gradually it will screw up different important systems until we reach a tipping point where enough systems are degraded and unreliable that a modern society which has placed so much faith in them cannot function.

On the plus side, I have solar panels, physical books and a vinyl collection, so I can keep myself occupied for a while. But saving humanity may rely not on us stopping the genius software with insidious plans, but preventing the stupid one wreaking havoc.

One Comment

  • Alan Levine

    Wait… you have solar panels? I’ll be right over.

    And what about the irony the ultimate infrastructure under the chaos layer, the internet, was supposedly one that could withstand any attack. Did those wizards staying up late forsee this?

Leave a Reply

Your email address will not be published. Required fields are marked *

css.php