[croo]

For anyone who actually tried it :

Does it respects/builds some kind of game map in the process or is it just a bizarre psychedelic dream walk experience where you cannot go back the same place twice and space dimensions are just funny? Is a game map finite?

[InsideOutSanta]

Just looking at the first video, there's a section where structures just suddenly appear in front of the player, so this does not appear to build any kind of map, or have any kind of meaningful awareness of something resembling a game state.

This is similar to LLM-based RPGs I've played, where you can pick up a sword and put it in your empty bag, and then pull out a loaf of bread and eat it.

[anal_reactor]

> you can pick up a sword and put it in your empty bag, and then pull out a loaf of bread and eat it

Mondays

[aidos]

Just skimmed the article but my guess is that it’s a dream type experience where if you turned around 180 and walked the other direction it wouldn’t correspond to where you just came from. More like an infinite map.

[lopuhin]

I don't think so, what they show on CS video is exactly the Dust2 map, not just something similar/inspired by it.

[delusional]

Just tried it out, and no. It doesn't have any sort of "map" awareness. It's very much in the "recall/replay" category of "AI" where it seems to accurately recall stuff that is part of the training dataset, but as soon as you do something not in there (like walk into a wall), it completely freaks out and spits out gibberish. Plausible gibberish, but gibberish none the less.

[neongreen]

Can you upload a screen recording? I don’t think I can run the model locally but it’d be super interesting to see what happens if you run into a wall

[kqr]

This should mainly be a matter of giving it more training though, right? It sounds like to amount of training it's gotten is relatively sparse.