Using genetic algorithms to train a Mario AI

[feral]

Reminds me of the AI competition on infinite mario, recently: Here is a video of the winning bot (A* based approach), cool to watch, as they display its trajectory calculations. http://www.youtube.com/watch?v=DlkMs4ZHHr8

GA is cool and everything, but I am sometimes sceptical about its merits. Yes, it gives you a natural problem representation, but would it really have done a better job in this particular domain than using a technique like simulated annealing to move through the Mario AI parameter space?

We just don't know without seeing benchmark comparisons. Maybe its much worse. So, its a cool application, but we should be cautious about how quickly we decide GA was a particularly suitable search algorithm.

[tassl]

I have always thought that GA have won lot of acceptance for its name. Don't get me wrong, they are great to solve some problems, and even though they don't assure us to converge into a global minimum on our space, they are more robust than other methods to search in the whole space.

We can see a relation with the humans, I am pretty sure that we are not a global minimum in evolutionary terms, but... certainly we are at least close to be a local minimum.

[mirkules]

I think simulated annealing would fall short if the levels have a lot of dead ends. A good reason to use GA is precisely to avoid the problem of getting stuck in local minima/maxima.

(Direct link to mario ai website: http://www.marioai.org/)

[henning]

Normally evolutionary computation papers which describe experimental/applied stuff like this will describe what they actually did more precisely, give actual benchmarks, and if possible try alternative approaches (as you suggested).

[andymorris]

I would have really liked to have seen a video sample at various stages of the evolution :-(

[TGJ]

What program would I use to edit the code? Just notepad or is this specific to another language?