It's Mart, Neel and Jack from the Factorio Learning Environment team.
Since our initial release, we have been working hard to expand the environment to support multi-agent scenarios, reasoning models and MCP for human-in-the-loop evals.
We have also spent time experimenting with different ways to elicit more performance out of agents in the game, namely tools for vision and reflection.
Today, we are proud to release v0.2.0, which includes several exciting new features and improvements.
1. For a competent ML researcher, this is trivial to build using VQA + MCTS + standard message passing.
2. MARL techniques with attention-based communication solved this years ago
3. It does not seem very "viral" or income-generating. I know this is premature at this point, but without charging users for the service, is it reasonable to expect to make money off of this?
1. These are additions to our existing Factorio Learning Environment, which is an extensive agent environment for evaluating pre-trained LLM agents in an unbounded/open-ended setting in the game of Factorio. I don't agree that it is trivial, as there is significant infrastructure in place to support Factorio as an LLM eval.
2. Factorio is an unsolved game in multi-agent research.
3. This is a research environment. You can read our paper on Arxiv if you're interested! Nobody will make any money of this.
noddybear|9 months ago
It's Mart, Neel and Jack from the Factorio Learning Environment team.
Since our initial release, we have been working hard to expand the environment to support multi-agent scenarios, reasoning models and MCP for human-in-the-loop evals.
We have also spent time experimenting with different ways to elicit more performance out of agents in the game, namely tools for vision and reflection.
Today, we are proud to release v0.2.0, which includes several exciting new features and improvements.
Thanks for checking this out.
goa|9 months ago
1. For a competent ML researcher, this is trivial to build using VQA + MCTS + standard message passing.
2. MARL techniques with attention-based communication solved this years ago
3. It does not seem very "viral" or income-generating. I know this is premature at this point, but without charging users for the service, is it reasonable to expect to make money off of this?
noddybear|9 months ago
2. Factorio is an unsolved game in multi-agent research.
3. This is a research environment. You can read our paper on Arxiv if you're interested! Nobody will make any money of this.
georgeh4cks|9 months ago