Not at expert in this area, but its interesting stuff.
Obviously, its nothing like the headline of 'computers learns to play by reading manual'. Sounds more like 'manual provides context hints to help guide search'.
I'm not sure the baseline AI of civ is that hard to beat, so its hard to evaluate how good the headline stat of 78% is? Anyone?
The other thing that gives me pause, is that they performed their rollouts against the other AI player. That seems kind of unfair - might be concerned they might be specialising to beat the build in AI, rather than to play the game.
Finally, did they perform their rollouts during a training phase of their model, and then use just the fitted model during evaluation play, or did they continue to use the rollouts during evaluation? I presume it was the former, but I only skimmed the paper, and couldnt find it explicitly?
How do you know the manual affected how well the computer played? IMHO Put a machine learning algorithm into playing enough games and it isn't so unreasonable it would do better than the default AI on at least some games.
They need a control where the computer doesn't have access to a manual and compare to that.
[+] [-] colanderman|14 years ago|reply
[+] [-] m_myers|14 years ago|reply
[+] [-] btcoal|14 years ago|reply
Very interesting.
[+] [-] roschdal|14 years ago|reply
http://groups.csail.mit.edu/rbg/code/civ/
[+] [-] feral|14 years ago|reply
I'm not sure the baseline AI of civ is that hard to beat, so its hard to evaluate how good the headline stat of 78% is? Anyone?
The other thing that gives me pause, is that they performed their rollouts against the other AI player. That seems kind of unfair - might be concerned they might be specialising to beat the build in AI, rather than to play the game.
Finally, did they perform their rollouts during a training phase of their model, and then use just the fitted model during evaluation play, or did they continue to use the rollouts during evaluation? I presume it was the former, but I only skimmed the paper, and couldnt find it explicitly?
[+] [-] tessro|14 years ago|reply
[+] [-] llambda|14 years ago|reply
[+] [-] trebor|14 years ago|reply
[+] [-] meric|14 years ago|reply
They need a control where the computer doesn't have access to a manual and compare to that.
[+] [-] moozilla|14 years ago|reply
Which is exactly what they did: http://people.csail.mit.edu/regina/my_papers/civ11.pdf
[+] [-] rosejn|14 years ago|reply