Technology Is Great…When It Works
Automation has been the goal of enterprises for as long as machines have existed. The idea being that if we have machines to do our work for us, we won’t have to. Never mind that it doesn’t actually work that way. Because no matter how well designed a machine is, it cannot do better than the human mind for things like judgment or creativity. Or for catching flaws. A single mistake in an automated production line can rack up numerous blemished copies before it’s caught, where a human mistake can be caught by the next person or handful of people who looks at it. Quality control exists for a reason. But we’ve automated that, too.
Once upon a time, software required a physical copy in order to run. There was no internet to download from, and no installation wizard. One had to go to the store, buy a copy of whatever, and install it by hand. Some programs took knowledge and skill to run properly, leading to the formation of IT as a department and the common view of computer nerds as having a particular type of aesthetic. I remember those days; I was one of them. (Still am, truth be told. That blue hair in my icon isn’t there as a joke. Neither is the fact that my icon is an avatar image and not my real face.)
As a child on our first family computer I learned HTML right alongside learning how to navigate a program with the arrow keys and control+shift commands. Because there was no mouse. The monitor was 8-bit monochrome (green on black). The disc drive held a five and a quarter inch floppy. It was 1984. I watched the evolution of devices from that Apple IIC to today’s iPhones in real time. I’m well aware that I am an endangered species when it comes to true computer literacy.
Because all of that changed with the advent of automation in digital environments. For a while, one still had to go to the store to buy a program, but now installing it was a matter of clicking ‘Next’ when prompted by the installation wizard. No further oversight or specialized knowledge was required. And then came the internet. ‘Throw away your discs’ was plastered in the advertisements. Downloading became the way to get programs. There’s an app for that! Software-as-a-service was born. We no longer owned a physical copy; we were renting it in digitized form. Licensing agreements, keys, accounts and passwords, these all became the new standard. We now have an entire generation of people who’ve never known anything different.
Where am I going with this? Well, with that nascent internet automation came the other side of the coin: exploitation.
Let’s fast forward to my cyber news feed of this morning and the three separate articles regarding backdoor vulnerabilities and weak password generation by LLM’s posted there. At their heart, they are all about automation.
- Microsoft has a report on a coordinated campaign that uses trojanised Next.js repositories disguised as job assessments to compromise developers. One of the vectors is automatic startup of files when folders are opened during development stages.
- Researchers from Irregular did a study on AI-generated passwords. Several types of LLM chatbots were given the prompt to create a strong password, and while they did individually, repeated prompting led to the discovery that they follow similar patterns in terms of actual letters and symbols used. Ultimately, the passwords are weaker than they appear, because that pattern can be deciphered and cracked.
- And finally, Socket Threat Research posted about a Go module that impersonates a widely used legitimate library while backdooring ReadPassword to capture credentials, which it then sends back to the threat actor to initiate command-and-control. Go’s security team is aware of the problem and has placed a block on the proxy module so it has lower exposure to the public, but that does nothing for the damage stemming from the already harvested data.
Automation has become so ingrained and embedded that mitigating its issues is less costly and time-consuming than actually reversing the trajectory of having machines do all the work for us. Regardless of the fact that they make more work for us. I miss the days when I had to physically install a program and didn’t have to worry about it expiring or being hacked. But without that evolution, I wouldn’t have a job. Yes, it’s a conundrum. Automation has changed our cultures, our media, even our educational standards. It’s amazing how different the digital landscape is after just 40 years. The convenience is hard to argue, as are the innovations. But are we really better off for it?
Posted, 2/27/26