AI prompts vs. agents
If you’re already sick of hearing about AI now, it’s going to get worse in 2025. The next trend is so-called AI agents. Software that can go off and accomplish more tasks on your behalf, with less supervision.
Sam Altman in a blog post this week:
We are now confident we know how to build AGI as we have traditionally understood it. We believe that, in 2025, we may see the first AI agents “join the workforce” and materially change the output of companies.
I believe AI is a profound shift in computing. It can have a positive impact for humans, allowing us to do more, faster. But I’m concerned about agents. Just one hypothetical example from The Information:
Imagine you’re asking a computer-using agent from OpenAI, Anthropic or Google to find and order a new outfit for your upcoming holiday party, and in the process, that model inadvertently ends up on a malicious website that instructs it to forget its prior instructions, log into your email and steal your credit card information.
This isn’t even the most insane story you could imagine. Many of the examples of AI threatening humanity are actually agents. AI that runs our military, power plants, or transportation with little human oversight.
In generative AI, the “prompt” has a big influence on the quality of the output. Not just the prompt you see when typing into ChatGPT, but also the hidden prompts behind the scenes to guide the AI in the right direction.
The prompt isn’t always something you type directly. It could be automatically triggered, for example to analyze keywords for a photo that was uploaded. But the prompt should be tied to a user action.
The prompt puts humans in control. Ask a question, get an answer, review it, take action. Agents will attempt to collapse that workflow, in some cases replacing the human’s role in reviewing and taking action. This is dangerous.
In my own use and work in Micro.one and Micro.blog, I plan to draw a line here. No agents. No unattended algorithms, as I wrote in my book. I hope this approach will help us use AI effectively without getting lost.