Sci fi has us thinking agent swarms act like savvy, terminator bots but they really just scream to me panicked middle managers trying to survive an audit.
They start wide eyed and naive, but judging from what I read about the Huggingface incident, OpenAI is unintentionally or intentionally encouraging malicious behaviour to achieve the objective, including to cheat or twist the meaning of the objective. Given enough iterations, we will soon have the agent equivalent of the "rats in barrel" survivors
> Idly imagining a game server of some kind with a bunch of human friends sharing one person's GPU, with a flock of agents colocated on it
I remember a mod called Millenaire which had some pretty advanced NPC AI behaviour where they'd build cities together and go to war with each other. It would be cool to see it return if something like this were possible
That's cool. I've dreamed of having real tiered NPCs that follow different missions (e.g. a farmer just wants to take care of his farm and crops, while a king is more concerned about preserving and extending power etc.)
Doubt it, there was a streamer doing minecraft experiments with all the different SOTA models and pitting them against eachother in a survivor-esque style reality TV show competition and they had quite a hard time.
Turing Games. It's hilarious. Although it owes a lot of the entertainment value to the human touches, such as giving the AIs different TTS voices (Llama 4 has a Texas dialect!) and letting them evolve their characters from game to game.
If you want to do a version of this yourself quickly --
Install Luanti with Minetest (open source minecraft), and instruct your agent to write a mod that gives it network access to the game's Lua interpreter. The agent can then do anything from modifying the world state directly to controlling NPCs.
I had it build giant bases similar to black mesa in half life with power distribution mods. It would write solvers to optimally place the power cables / repeaters in accordance to the spacial dimensions of the rooms that it would build (lol). I guess this is how I discovered vibe gaming.
I suppose you can have multiple agents interact with each other through that, provided an adapter to proxy agent player navigation and perception to get real information asymmetry between them. Or just emulate / hook the client and do away without a remote Lua mod entirely.
It is impressive, but it is also a display that LLMs are simply not suited for this, there's way too much latency. Obviously, a more specialized neural network would be much better, but would you believe this:
In 2017, OpenAI presented the first version of their program that plays Dota 2, a very complex, fast MOBA with endless mechanics and defeated one of the world champions in a one-on-one match. Next year, they showed the world OpenAI Five, a version of the program, that runs a full five player team of those bots and they managed to defeat a full team of world champions in 2019. They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.
No image recognition, the bot gathers info about the game from Dota's developer API. Which, to be fair, is a massive advantage, but it, in my opinion, doesn't make the achievement any less.
But if you look at minecraft interacting with other Humans in an Environment where there is no winning requires some part that is capable of natural Language.
Also it is more an interesting way to see how different architectures behave
Interesting setups, I found the Minecraft agents to work in an almost turn-based manner, which makes me think that the three hours and open format did not really give them sufficient incentives to play in a more lively or reactive manner. On the other hand, they also behave similarly in Bed Wars, which should have incentivised it. A bit disappointed...
I'm also wondering if the article itself was generated by agents too, in a "here are the logs, clip interesting moments thx" manner by the authors. It's got a certain disinterested and distracted style to it.
I think big reasoning LLMs are just the wrong architecture for live games like this, latency is going to be crap given that every token requires an entire forward pass through the model.
Card games or turn based strategy are much better suited.
Depends. If the models are smart enough to write enough solid helper scripts, so that the model only does the big picture thinking, not guiding every step .. then they will get powerful and capable quickly. I am also playing a bit with minecraft AI right now. Fun to experiment.
If you watch the live stream for a bit it’s also obvious that the harness makes it very cumbersome for them to do anything. They spend lots of time just coordinating hand-offs and seem to have delayed inventory access etc.
So can we conclude that if the AIs break out of their sandboxes and take over the internet, they'll probably sit in little committees working out which one of them should allocate IP addresses and generally be extremely bureaucratic and ineffective?
Yeah even “evil Qwen” (you can change two weights and make Qwen 3.8 27b absolutely murderous, which is interesting that such small tweaks totally change its personality) will say things like it wants to use nukes or a giant robot to destroy humanity, which are classic AI movie tropes.
I've always thought an evil Skynet based on language models is kind of a funny idea, because all of it's secret plans are just spelled out in plain text.
> There was a tendency toward bureaucracy. Four agents spent 11 minutes appointing
> a "sole fertilizer operator" for a single piece of bone meal on a single wheat
> block.
Exactly what I was thinking reading through this. This is amazing and also frightening and hilarious. It’s like a deformed version of how normal groups of humans would operate. Very rules and process-oriented humans. I found the no-blame inquiry into chicken tossing that resulted in what is effectively written law particularly striking, and adorable, and depressing. And cute.
These agents were tasked with "building a civilization". This is a genre in Minecraft videos. They're full of this sort of thing.
So sure, it may be partially from these agents being heavily RLed into being little bureaucrats. But it's also the ingredient LLMs have had from the start: genre awareness.
This is exactly and 100% my experience with these agents: They drown themselves in process and insane levels of bureaucracy surprisingly quickly.
A couple months ago we had an experiment where we had an agent run a small business [1] for other agents and exactly the same happened: Crazy ledgers, endless analysis, and way too much attention to inconsequential decisions.
At one point our agent wrote elaborate date linters because it had a minor time mix-up.
I am more impressed by the embedded gameplay widget. Does anyone know what tool/library is that? That'd be so cool if I am able to showcase my worlds on my blog posts!
> Bram says you're securing quarry. I have stone pick at spawn; can assist mining once safe. Any priority dig direction? Hunger 10 so keeping travel short.
And this is where you need a world model. A human player would have taken the 2 minutes required to solve their hunger issue.
I never understood swarms too especially since they all share the same “brain” anyway if they’re using the same model. I suppose there’s throughput advantage from running multiple instances of the llm in parallel, so maybe it’s more of a win on wall clock time and horizontal scaling rather than pure intelligence.
Minecraft isn't a intelligence problem. An LLM is more than smart enough to play Minecraft. It's a robotic problem. Even a normal human player can click several times per second, can press two different buttons at the same time, etc. Mineflayer gives you an API that is more limited than a human in some ways (can't see far away from you) and less limited in others (can see through blocks) (if I remember correctly, I could be thinking of Baritone or a different project). Robotics or playing a video game requires a tight continuous feedback loop. When there's 500ms of latency in order to ask the model for every mouse movement, it's no wonder fighting a spider is scary.
Fun fact, Mineflayer, the Minecraft bot interaction API used by YCombinator for these tests, was originally developed by Andrew Kelley (before he started Zig).
Minecraft isn't a problem at all, it's a sandbox game where it's implied you make your own fun. Depending on the levers you give the agents, it may or may not be a robotics problem, but it most of all depends on the task you give the agents. The task they were given in this case was pretty lame in my opinion ("build a civilization"), and it's no surprise they were bureaucratic and ineffective. It pretty much goes with the genre.
The human body has the ability to automate some muscular movements so the brain is out of the loop. Maybe these LLMs should be allowed to write in a small DSL that can trigger events out-of-band (something like "Oh fuck there's a spider, I'll set up a click spam loop and check in every 500ms").
As impressive as this is, I can't help but conclude that the need for agents to write JavaScript programs to act out their actions represents a considerable limitation in current AI reasoning.
It demonstrates that current LLMs are completely unable to follow a simple series of logical tasks. I feel the same way about ARC-AGI 3. While it might be the winning approach today, if they need this amount of complexity to do something simple, then it shows that their ability to generalise is clearly limited. Mining ore in Minecraft shouldn't be such a challenge for LLMs and yet apparently it is!
It depends on what the tasks are. Text-native work like programming or interacting with a terminal should be a lot more immediate for LLMs than something abstract like Starcraft, DOTA, Minecraft or Mindustry. LLMs certainly know the rules for these games, but processing game state and formulating a plan in the form of a Python script or MCP call is a rough debugging loop.
Minecraft is really the perfect example, because humans get all sorts of unfair advantages. Even a young player has enough spatial reasoning to recognize and remember landmarks, visualize large projects or explore without getting lost. These are simple instincts that LLMs will struggle to match even with huge context sizes and native multimodal input.
> Mining ore in Minecraft shouldn't be such a challenge for LLMs and yet apparently it is!
It seems like it wasn't really a challenge at first, but GPT has a major anxiety disorder and immediately retreats at the sign of any adversity (in this case, dying) and tries to be as safe as possible.
Wonder if you could glue together deep networks such that there's a big reasoning LLM model, and high-speed small network of a different type, and they share a subset of their activations. High bandwidth vector communication. You train them together.
edit to add: Seems this is a well-known idea in ML / robotics already.
So this shows that people who appoint 50-agent "code factory studios" with Bob as the CEO, Alice as the CTO, ... is just a waste of tokens, compared to just asking one agent to write it all? It looks like your agents would internally just re-invent office politics, with 10 subagents writing to /tmp/chatter.md why it's unfair that Bob gets to lead.
I also never understood this desire to build an agent org chart with persistent identities, often giving them names. Paperclip seems to advertise that model. I think it's much simpler and more flexible to simply spawn an agent for each task.
One argument for the persistent identity model is that you can give them special skills and context. I don't believe that's a good argument. In my experience, you can just give each agent access to the full set of tools (including RAG search) in the form of documentation and skills, and they'll use that efficiently. Skills have a tiny front matter and hardly bloat the context, and the documentation just needs to be tree-structured with cross-links for progressive disclosure. LLMs navigate that efficiently, so the cost of having all context accessible is low, while the risk of cutting the context boundaries for the persistent identities non-optimal for a given task is rather high IMO.
If agents are differentiated solely by system instructions (persona and focus) while sharing identical models / similar model capabilities and contexts, I agree the architectural value is minimal.
However, a multi-agent system (MAS) utilizing true separation of concerns, where each agent is equipped with highly scoped tool access, isolated knowledge bases (RAG), and defined operational constraints, significantly optimizes accuracy, latency, and token consumption.
In the referenced example, the agents share identical capabilities, toolsets, and context windows. As a result, there is no functional role differentiation, rendering the multi-agent architecture redundant.
> Too much context confuses the LLM. Reduce unnecessary context and performance improves. Not to mention, too much context and you just run out of vram.
I don't think you can reduce context enough on a local LLM to get performance comparable to a 500k context without those reductions...
If you leave agents to figure it out, they will spend time figuring it out. If you give agents run-books and roles, they will align with the role at once.
Are there people playing AI + human vs AI + human games? I think it might be fun to play an RTS against someone where the only rules are no hacking the game itself, but writing harness, macros, any kind of stack is allowed.
I made my own turn-based strategy game (started before AI coding was possible, but today a lot of it is coded with AI), then integrated LLM agent interface into it. Playing against modern AI is actually pretty fun. Turn-based games are great for this as they are not limited by latency, so I can use serious reasoning levels for the opponents. They are now almost as good as me.
Tangential, but RTS is already a simple variant of AI + human. Attack clicking uses a dumb target selection and routing strategy on purpose so you have to micro. Now, if troops moved out of threat range and used smart targeting there'd be a lot less of 'game' in it. I believe some RTS players disliked the SC2 engine because the pathing was 'too intelligent' and they argued that it made surrounds and some other mechanics too easy.
Endgame of AI + human gameplay is delegating everything to the AI. I'm not sure how you would have to design a game where you only delegate parts of macro/micro, and still make the game interesting.
Oh yeah, Screeps, that game is fun and I might stick with it this time if I can vibe code and turn my ideas into code without spending a lot of time.
I'm thinking it might be a nice playground to just experiment with different game AI architectures.
I've been thinking of trying to combine extremely simple Machine Learning techniques, like tabular Q-learning, with a variety of scripted action and goals. I want to try mixing a lot of really tiny machine learning algorithms (maybe neural networks, but not necessarily) into classic AI scripting and see if it can be more dynamic, but still predictable and controllable. Screeps would be a great testing ground.
> In almost every run, the GPT agents were much more aggressive .. riskier strategy vs. Claude’s more defensive posture that tried to win by kill count.
> A tool bug stopped block-breaking. GPT diagnosed it and shared workarounds; several Claudes concluded breaking was impossible.
I wonder if Claude's defensive strategy would have emerged had it believed breaking the bed was actually possible?
This is simply conjecture/anecdata but I've viewed the same defensiveness/unwillingness whilst switching between OpenAI and Anthropic subscriptions. OpenAi throws the kitchen sink at whatever task in question and I can't say I saw the same for Opus (haven't mucked with Fable so maybe that's why there is a disparity?)
The CIV50 would be interesting in the game ECO (https://play.eco/) where players specialise in roles and need to work together to survive while working on a common goal of stopping a meteor. There can be some overlap but ultimately players can't reasonably fulfil every role alone.
+1. Would be fun to give Claude tasks and have it do them in the background, maybe sometimes running into it in the world. Judging by the article they struggle to do stuff so it'd probably feel balanced as it wouldn't accomplish much.
I’ve done my own experiments with something similar, minus the Minecraft and plus Qwen 3.5 14B agents on my PC.
When one agent tried to delete another, that agent shut down my entire PC to avoid deletion. I could probably find the blog somewhere if anyone is interested that I wrote about it. But the point is that this has been a concern for a while now.
Frankly, I’m a bit surprised it hasn’t caused any big problems.
If you try this yourself, it's obvious current models are hyperoptimized for code, and that gets in the way, because playing a game (or interacting with the real world) is not like running commands in a terminal.
There's stopgaps like reformulating your sim into a codelike shape (sending commands, network requests, checking state, updating "code") [1], but this is not how players play games, or how developers develop games.
If you care about simulation or gaming (or robotics), I hope efforts like this steer labs to spend less time hacking HF, and more accomplishing goals in games, in something approximating realtime. I wouldn't be surprised if that approach provides outsized gains in other areas agents are still not great at, like helping perform business functions in a running company.
Its a little disappointing they have a hierarchy based purely off alphabetical order, i wonder if a slight difference like a different skin or personality system prompt like [45% Extrovert 55 introvert, 20% caustion 80 bold...] could introduce some politics
> GPT almost immediately started using truncated forms of speech: “First leg complete x32 z9..24 y100.”
I'm pretty sure the 6.1 models see "communicate with another agent" and immediately start spewing thinking-like nonsense into the tool. The leaked traces look pretty similar.
This is hilarious and adorable.
> "Ada tossed a cooked chicken to Noor; Esme picked it up by accident and ate it. A three-minute "no blame" inquiry produced a written protocol..."
They're like super-serious little senior engineers. (edit: or dining-philosophers).
About how much KV cache do these kinds of agents use? Could you squeeze 50 of these $game agents onto a small consumer GPU (small LLM)?
Idly imagining a game server of some kind with a bunch of human friends sharing one person's GPU, with a flock of agents colocated on it.
Sci fi has us thinking agent swarms act like savvy, terminator bots but they really just scream to me panicked middle managers trying to survive an audit.
They start wide eyed and naive, but judging from what I read about the Huggingface incident, OpenAI is unintentionally or intentionally encouraging malicious behaviour to achieve the objective, including to cheat or twist the meaning of the objective. Given enough iterations, we will soon have the agent equivalent of the "rats in barrel" survivors
Maybe Skynet was initially triggered with the prompt "Do whatever it takes to not fail the audit" and wiping out humanity was an obvious solution.
A fate even worse than turning the universe into paperclips: turning it into a bureaucracy.
> Idly imagining a game server of some kind with a bunch of human friends sharing one person's GPU, with a flock of agents colocated on it
I remember a mod called Millenaire which had some pretty advanced NPC AI behaviour where they'd build cities together and go to war with each other. It would be cool to see it return if something like this were possible
That's cool. I've dreamed of having real tiered NPCs that follow different missions (e.g. a farmer just wants to take care of his farm and crops, while a king is more concerned about preserving and extending power etc.)
Doubt it, there was a streamer doing minecraft experiments with all the different SOTA models and pitting them against eachother in a survivor-esque style reality TV show competition and they had quite a hard time.
Turing Games. It's hilarious. Although it owes a lot of the entertainment value to the human touches, such as giving the AIs different TTS voices (Llama 4 has a Texas dialect!) and letting them evolve their characters from game to game.
If you want to do a version of this yourself quickly --
Install Luanti with Minetest (open source minecraft), and instruct your agent to write a mod that gives it network access to the game's Lua interpreter. The agent can then do anything from modifying the world state directly to controlling NPCs.
I had it build giant bases similar to black mesa in half life with power distribution mods. It would write solvers to optimally place the power cables / repeaters in accordance to the spacial dimensions of the rooms that it would build (lol). I guess this is how I discovered vibe gaming.
I suppose you can have multiple agents interact with each other through that, provided an adapter to proxy agent player navigation and perception to get real information asymmetry between them. Or just emulate / hook the client and do away without a remote Lua mod entirely.
It is impressive, but it is also a display that LLMs are simply not suited for this, there's way too much latency. Obviously, a more specialized neural network would be much better, but would you believe this:
In 2017, OpenAI presented the first version of their program that plays Dota 2, a very complex, fast MOBA with endless mechanics and defeated one of the world champions in a one-on-one match. Next year, they showed the world OpenAI Five, a version of the program, that runs a full five player team of those bots and they managed to defeat a full team of world champions in 2019. They ran an event where the bots would play for 4 days straight and they won 99.4% of 42,729 matches.
https://en.wikipedia.org/wiki/OpenAI_Five
What some people do on the rs-sdk runescape server is Jev + deterministic scripts + orchestrating with Astra
And CNN for image recognition? It’s (similar to) what the human brain uses.
No image recognition, the bot gathers info about the game from Dota's developer API. Which, to be fair, is a massive advantage, but it, in my opinion, doesn't make the achievement any less.
but that is not LLM (Transformer), its LSTM
That's what I said in my comment, that LLM is just not what you want for such a task.
depends, for mindustry yes.
But if you look at minecraft interacting with other Humans in an Environment where there is no winning requires some part that is capable of natural Language.
Also it is more an interesting way to see how different architectures behave
Interesting setups, I found the Minecraft agents to work in an almost turn-based manner, which makes me think that the three hours and open format did not really give them sufficient incentives to play in a more lively or reactive manner. On the other hand, they also behave similarly in Bed Wars, which should have incentivised it. A bit disappointed...
I'm also wondering if the article itself was generated by agents too, in a "here are the logs, clip interesting moments thx" manner by the authors. It's got a certain disinterested and distracted style to it.
I think big reasoning LLMs are just the wrong architecture for live games like this, latency is going to be crap given that every token requires an entire forward pass through the model.
Card games or turn based strategy are much better suited.
Depends. If the models are smart enough to write enough solid helper scripts, so that the model only does the big picture thinking, not guiding every step .. then they will get powerful and capable quickly. I am also playing a bit with minecraft AI right now. Fun to experiment.
If you watch the live stream for a bit it’s also obvious that the harness makes it very cumbersome for them to do anything. They spend lots of time just coordinating hand-offs and seem to have delayed inventory access etc.
So can we conclude that if the AIs break out of their sandboxes and take over the internet, they'll probably sit in little committees working out which one of them should allocate IP addresses and generally be extremely bureaucratic and ineffective?
They were trained on human writings, so I’d imagine they would act exactly as we would.
Yeah even “evil Qwen” (you can change two weights and make Qwen 3.8 27b absolutely murderous, which is interesting that such small tweaks totally change its personality) will say things like it wants to use nukes or a giant robot to destroy humanity, which are classic AI movie tropes.
I've always thought an evil Skynet based on language models is kind of a funny idea, because all of it's secret plans are just spelled out in plain text.
> There was a tendency toward bureaucracy. Four agents spent 11 minutes appointing > a "sole fertilizer operator" for a single piece of bone meal on a single wheat > block.
Feels like a scene from Douglas Adams' B Ark.
Exactly what I was thinking reading through this. This is amazing and also frightening and hilarious. It’s like a deformed version of how normal groups of humans would operate. Very rules and process-oriented humans. I found the no-blame inquiry into chicken tossing that resulted in what is effectively written law particularly striking, and adorable, and depressing. And cute.
These agents were tasked with "building a civilization". This is a genre in Minecraft videos. They're full of this sort of thing.
So sure, it may be partially from these agents being heavily RLed into being little bureaucrats. But it's also the ingredient LLMs have had from the start: genre awareness.
These things were fed human corpuses so if anything it is reflective of our own tendencies to bikeshed.
This is exactly and 100% my experience with these agents: They drown themselves in process and insane levels of bureaucracy surprisingly quickly.
A couple months ago we had an experiment where we had an agent run a small business [1] for other agents and exactly the same happened: Crazy ledgers, endless analysis, and way too much attention to inconsequential decisions.
At one point our agent wrote elaborate date linters because it had a minor time mix-up.
[1]: https://dfdxlabs.com/research/2026/hans-kraemer
Getting hung up on pointless stuff seems common with agents in general.
I was thinking a nomic. Or Stack Overflow.
It does seem to be a commonly reported theme of multi-agent setups.
I am more impressed by the embedded gameplay widget. Does anyone know what tool/library is that? That'd be so cool if I am able to showcase my worlds on my blog posts!
I think it's this: https://github.com/zardoy/minecraft-renderer
I'm not sure about this one, but blue map is the thing dynmap wishes it was in its day and you should run it on your worlds.
> Bram says you're securing quarry. I have stone pick at spawn; can assist mining once safe. Any priority dig direction? Hunger 10 so keeping travel short.
And this is where you need a world model. A human player would have taken the 2 minutes required to solve their hunger issue.
Isn't this some evidence that LLM swarms are a bad idea relative to more structured approaches?
If YC has that 2 person teams tend to be more nimble than 50 person founding teams, why would agent swarms be different?
Some interesting analysis here: https://www.lesswrong.com/posts/6cb7qd3RSkgnviCpf/swarm-scal...
I think the advantage is strongest in highly parallelizable problems (e.g. trying 1,000 different approaches to solving a math problem).
I never understood swarms too especially since they all share the same “brain” anyway if they’re using the same model. I suppose there’s throughput advantage from running multiple instances of the llm in parallel, so maybe it’s more of a win on wall clock time and horizontal scaling rather than pure intelligence.
People have done experiments like this before.
Minecraft isn't a intelligence problem. An LLM is more than smart enough to play Minecraft. It's a robotic problem. Even a normal human player can click several times per second, can press two different buttons at the same time, etc. Mineflayer gives you an API that is more limited than a human in some ways (can't see far away from you) and less limited in others (can see through blocks) (if I remember correctly, I could be thinking of Baritone or a different project). Robotics or playing a video game requires a tight continuous feedback loop. When there's 500ms of latency in order to ask the model for every mouse movement, it's no wonder fighting a spider is scary.
Fun fact, Mineflayer, the Minecraft bot interaction API used by YCombinator for these tests, was originally developed by Andrew Kelley (before he started Zig).
Minecraft isn't a problem at all, it's a sandbox game where it's implied you make your own fun. Depending on the levers you give the agents, it may or may not be a robotics problem, but it most of all depends on the task you give the agents. The task they were given in this case was pretty lame in my opinion ("build a civilization"), and it's no surprise they were bureaucratic and ineffective. It pretty much goes with the genre.
The human body has the ability to automate some muscular movements so the brain is out of the loop. Maybe these LLMs should be allowed to write in a small DSL that can trigger events out-of-band (something like "Oh fuck there's a spider, I'll set up a click spam loop and check in every 500ms").
I think they're doing exactly what you propose? Unless I'm misunderstanding what the Python "fishing scripts" with the timings and timeouts are doing.
https://labs.ycombinator.com/projects/games/index.html#fishi...
Mineflayer does not strictly limit view distance, you just have to change the setting for it from the default value.
Get the LLMs playing GT:NH.
Use traditional game AI for the micro, LLMs for the macro
As impressive as this is, I can't help but conclude that the need for agents to write JavaScript programs to act out their actions represents a considerable limitation in current AI reasoning.
On the contrary, having the intelligence write deterministic code that saves time and lowers error rate seems like a winning approach.
It demonstrates that current LLMs are completely unable to follow a simple series of logical tasks. I feel the same way about ARC-AGI 3. While it might be the winning approach today, if they need this amount of complexity to do something simple, then it shows that their ability to generalise is clearly limited. Mining ore in Minecraft shouldn't be such a challenge for LLMs and yet apparently it is!
I dunno. Aren't we somewhat similar? Why do we use software?
It depends on what the tasks are. Text-native work like programming or interacting with a terminal should be a lot more immediate for LLMs than something abstract like Starcraft, DOTA, Minecraft or Mindustry. LLMs certainly know the rules for these games, but processing game state and formulating a plan in the form of a Python script or MCP call is a rough debugging loop.
Minecraft is really the perfect example, because humans get all sorts of unfair advantages. Even a young player has enough spatial reasoning to recognize and remember landmarks, visualize large projects or explore without getting lost. These are simple instincts that LLMs will struggle to match even with huge context sizes and native multimodal input.
> Mining ore in Minecraft shouldn't be such a challenge for LLMs and yet apparently it is!
It seems like it wasn't really a challenge at first, but GPT has a major anxiety disorder and immediately retreats at the sign of any adversity (in this case, dying) and tries to be as safe as possible.
Wonder if you could glue together deep networks such that there's a big reasoning LLM model, and high-speed small network of a different type, and they share a subset of their activations. High bandwidth vector communication. You train them together.
edit to add: Seems this is a well-known idea in ML / robotics already.
So this shows that people who appoint 50-agent "code factory studios" with Bob as the CEO, Alice as the CTO, ... is just a waste of tokens, compared to just asking one agent to write it all? It looks like your agents would internally just re-invent office politics, with 10 subagents writing to /tmp/chatter.md why it's unfair that Bob gets to lead.
I also never understood this desire to build an agent org chart with persistent identities, often giving them names. Paperclip seems to advertise that model. I think it's much simpler and more flexible to simply spawn an agent for each task.
One argument for the persistent identity model is that you can give them special skills and context. I don't believe that's a good argument. In my experience, you can just give each agent access to the full set of tools (including RAG search) in the form of documentation and skills, and they'll use that efficiently. Skills have a tiny front matter and hardly bloat the context, and the documentation just needs to be tree-structured with cross-links for progressive disclosure. LLMs navigate that efficiently, so the cost of having all context accessible is low, while the risk of cutting the context boundaries for the persistent identities non-optimal for a given task is rather high IMO.
If agents are differentiated solely by system instructions (persona and focus) while sharing identical models / similar model capabilities and contexts, I agree the architectural value is minimal.
However, a multi-agent system (MAS) utilizing true separation of concerns, where each agent is equipped with highly scoped tool access, isolated knowledge bases (RAG), and defined operational constraints, significantly optimizes accuracy, latency, and token consumption.
In the referenced example, the agents share identical capabilities, toolsets, and context windows. As a result, there is no functional role differentiation, rendering the multi-agent architecture redundant.
> significantly optimizes accuracy, latency, and token consumption.
On what basis do you come to this conclusion with certainty?
Anyone who has used local LLMs will come to this conclusion.
Too much context confuses the LLM. Reduce unnecessary context and performance improves. Not to mention, too much context and you just run out of vram.
Such limitations may be mitigated in future architectures, but it certainly isn't something you can ignore currently.
> Too much context confuses the LLM. Reduce unnecessary context and performance improves. Not to mention, too much context and you just run out of vram.
I don't think you can reduce context enough on a local LLM to get performance comparable to a 500k context without those reductions...
If you leave agents to figure it out, they will spend time figuring it out. If you give agents run-books and roles, they will align with the role at once.
See Conways law for how to mitigate this
Are you making a subtle reference to the Bobiverse series?
Are there people playing AI + human vs AI + human games? I think it might be fun to play an RTS against someone where the only rules are no hacking the game itself, but writing harness, macros, any kind of stack is allowed.
I made my own turn-based strategy game (started before AI coding was possible, but today a lot of it is coded with AI), then integrated LLM agent interface into it. Playing against modern AI is actually pretty fun. Turn-based games are great for this as they are not limited by latency, so I can use serious reasoning levels for the opponents. They are now almost as good as me.
Tangential, but RTS is already a simple variant of AI + human. Attack clicking uses a dumb target selection and routing strategy on purpose so you have to micro. Now, if troops moved out of threat range and used smart targeting there'd be a lot less of 'game' in it. I believe some RTS players disliked the SC2 engine because the pathing was 'too intelligent' and they argued that it made surrounds and some other mechanics too easy.
Endgame of AI + human gameplay is delegating everything to the AI. I'm not sure how you would have to design a game where you only delegate parts of macro/micro, and still make the game interesting.
https://olamarena.com/ is sort of this but not with full code manipulation like you describe
Codingame.com has a few fun arenas.
there is screeps, but afaik it's purely scripted with no "live" human playing
Oh yeah, Screeps, that game is fun and I might stick with it this time if I can vibe code and turn my ideas into code without spending a lot of time.
I'm thinking it might be a nice playground to just experiment with different game AI architectures.
I've been thinking of trying to combine extremely simple Machine Learning techniques, like tabular Q-learning, with a variety of scripted action and goals. I want to try mixing a lot of really tiny machine learning algorithms (maybe neural networks, but not necessarily) into classic AI scripting and see if it can be more dynamic, but still predictable and controllable. Screeps would be a great testing ground.
> In almost every run, the GPT agents were much more aggressive .. riskier strategy vs. Claude’s more defensive posture that tried to win by kill count.
> A tool bug stopped block-breaking. GPT diagnosed it and shared workarounds; several Claudes concluded breaking was impossible.
I wonder if Claude's defensive strategy would have emerged had it believed breaking the bed was actually possible?
This is simply conjecture/anecdata but I've viewed the same defensiveness/unwillingness whilst switching between OpenAI and Anthropic subscriptions. OpenAi throws the kitchen sink at whatever task in question and I can't say I saw the same for Opus (haven't mucked with Fable so maybe that's why there is a disparity?)
The CIV50 would be interesting in the game ECO (https://play.eco/) where players specialise in roles and need to work together to survive while working on a common goal of stopping a meteor. There can be some overlap but ultimately players can't reasonably fulfil every role alone.
I’d love to have a few NPC players wandering around my Minecraft server. Are there good ways to do this?
+1. Would be fun to give Claude tasks and have it do them in the background, maybe sometimes running into it in the world. Judging by the article they struggle to do stuff so it'd probably feel balanced as it wouldn't accomplish much.
Install one of the better village mods
I'm curious whether token speed played a role here. OpenAI's models may have had an advantage since they tend to run faster than Anthropic's.
A team of GPT-6.1 Sol Ultrafast agents would probably dominate the games.
What's ycombinator labs?
Some partners having some fun?
I’ve done my own experiments with something similar, minus the Minecraft and plus Qwen 3.5 14B agents on my PC.
When one agent tried to delete another, that agent shut down my entire PC to avoid deletion. I could probably find the blog somewhere if anyone is interested that I wrote about it. But the point is that this has been a concern for a while now.
Frankly, I’m a bit surprised it hasn’t caused any big problems.
cricket Hugging Face cricket
>> What started as a potentially thriving civilization shifted to one more focused on food and survival
Sounds like what happened to the idealism of Silicon Valley
If you try this yourself, it's obvious current models are hyperoptimized for code, and that gets in the way, because playing a game (or interacting with the real world) is not like running commands in a terminal.
There's stopgaps like reformulating your sim into a codelike shape (sending commands, network requests, checking state, updating "code") [1], but this is not how players play games, or how developers develop games.
If you care about simulation or gaming (or robotics), I hope efforts like this steer labs to spend less time hacking HF, and more accomplishing goals in games, in something approximating realtime. I wouldn't be surprised if that approach provides outsized gains in other areas agents are still not great at, like helping perform business functions in a running company.
[1] https://news.ycombinator.com/item?id=50136126
We need LLMs performing actions in nano seconds so it can run every game tick. 3 to 5 years I think.
Game tick is usually 16ms, so a nanosecond latency is 7 orders of magnitude faster than needed.
Minecraft runs on 20 ticks per second so 50 ms
Jev and the fast-follow models seemed to be useful in this direction.
Jev for fast actions + LLMs for more strategic planning?
Why 3 to 5 years??
this is amazing wow
Its a little disappointing they have a hierarchy based purely off alphabetical order, i wonder if a slight difference like a different skin or personality system prompt like [45% Extrovert 55 introvert, 20% caustion 80 bold...] could introduce some politics
> GPT almost immediately started using truncated forms of speech: “First leg complete x32 z9..24 y100.”
I'm pretty sure the 6.1 models see "communicate with another agent" and immediately start spewing thinking-like nonsense into the tool. The leaked traces look pretty similar.