[waltbosz]

Your comment makes me wonder how well SIMA 2 could do at playing Minecraft and discovering how create things like iron farms and villager trading halls.

Think of all the steps required for it to learn iron farms. First it would need to observe that iron golems drop iron when killed. Then it would need to learn about water physics. Then spawning rules for iron golems. Then how hoppers and chests work. Etc etc.

But would it even bother to learn it in the first place? To be motivated to build one it would need to first learn that iron is valuable. And if its goal is to simply win the game, it would probably skip right to fighting the ender dragon as soon as possible.

[mashyc]

You'd be interested in Dreamer 4, very recently the first AI to acquire diamonds in Minecraft purely from offline knowledge: https://danijar.com/project/dreamer4/