It's Not a Conspiracy
It feels like the world is falling apart, doesn’t it?
The things we take for granted seem to just not work properly anymore. Widespread outages, major disruptions, so many security vulnerabilities, and things just not doing what they’re supposed to. It’s easy to blame a foreign adversary, “artificial intelligence,” or some secret cabal determined to undermine our society from the inside.
It must be a distraction right? There must be something despicable going on, and somebody won’t tell the truth. Somewhere out there, somebody is in control, and is exercising their power to create all this chaos, right?
No. No singular person is culpable, this is a systemic problem with no simple solution.
In the past couple years, layoffs have swept through the tech industry. First it was justified as a sensible and prudent reduction in workforce after “overhiring” during the COVID-19 era. Soon, it was justified as big corporations having to tighten their belts to survive a funding crunch. And now the big buzz is laying off experienced workers to replace them with AI.
This has been the constant all throughout the “tech” industry. From private industry to the highest levels of government, managers and executives can’t resist the siren call of reducing headcounts to pass along savings to the shareholders. Stock price goes up, taxes go down, everybody’s happy right?
Well, clearly not. Anybody who’s worked with LLMs can tell you the limitations. The rate of most egregious errors has gone down over time, but it’s certainly not zero (and might never be). So what you’re left with is an overtaxed workforce rushing changes that are only 95% correct. That seems good, but those 5% of errors can cause a lot of problems. That creates a new and exciting type of “technical debt” that the industry body of knowledge isn’t prepared for.
And to be clear, this isn’t the fault of LLM technology, it’s a fundamental and systemic problem. We’re no longer willing to invest in “human capital” and build the kind of systems that are resilient against these types of faults. An industry that once built a transcontinental phone network resilient against nuclear attack is now crumbling.
How do we solve this? We slow the fuck down. The last two decades has been a race to the bottom, championed by organizations with mantras like “move fast and break things.”
If we want to fix this, it’ll be by moving deliberately and fixing things.