[dgant]

The dirty secret is we think we want the AI to play more realistically, but actually don't. This is true in many games but especially Civilization, where we rely on the AI behaving predictably to feel mastery over the environment, and for diplomacy to feel "fair". If the AI were playing to win, diplomacy would mostly evaporate as a game system. It'd break the fiction of the game.

[JeffL]

That's what the developers say, but I think it's part true and part a cop out. The AI in Civ 5 & 6 is just so so bad, that it's only challenging when you play on the really hard modes that gives them all sorts of cheats. And then it's a bit less fun because you're walking the line between impossible because of the cheating and having to essentially exploit the AI because of the cheating.

I don't necessarily want an AI that tries to play like a human, though it would be a fun option, I want an AI that isn't just straight up terrible given the same starting resources and rules as the player.

Part of the problem, I think, is that each iteration of Civ, they make the game more complicated in a way that makes it even harder for the AI to do as well as a good player, but probably most players don't care and there isn't a lot of reason to become good at the game anyway.

[SCLeo]

Actually, if you play Stellaris, there is a mod called StarNet AI, which uses weights that are considered "meta". From my very limited personal experience (I got destroyed), it is not really fun to play an AI that uses very good strategies as it eliminates all previously viable, but not optimal playstyles.

Also, it feels _really_ good when you get to a new ship tier faster than your neighbors. The reverse is, however, very frustrating, as you are forced to play catch.

[simonh]

This comes up often in discussions about Axis & Allies Online. It has an AI, but it’s pretty basic and really only there as an aid to learn the rules before playing humans. The main way the game is played is ranked play on the built in ladder against humans, or custom games. There’s a discord that runs regular tournaments as well.

The problem is AI for complex games like that is absurdly hard to develop. The combinatorial complexity of a game like Axis & Allies is something like a hundred orders of magnitude greater than chess. It’s probably similar with Civ, probably a lot more so.

But aside from just competency, what makes playing humans so compelling is personality. Human players range the full spectrum from terrible to excellent, but even beyond that they vary massively in the ways they are terrible, and the ways in which they are excellent. With A&AOL there are top tiered players that employ radically different strategies, to great effect.

[baazaa]

IMO it's the reverse. I could swear some of these games intentionally keep the gap between good-play and bad-play very small so as to hide the deficiencies of AI.

The lack of choice in buildings, reasonably inconsequential bonus tile yields, minimalist tech tree where you have to research everything, lack of synergies between buildings-resources-terrains, etc. all make a lot more sense when you see what horrendous decisions the AI makes even on hardest difficulties.

[1123581321]

Sid had achieved competent but un-fun AI early on in the series and backed off. Players hate it because of how good it is at sacking poorly defended cities, especially early on when the AI knew too much about the global map.

[orthoxerox]

SMAC had a few restrictions that made dealing with its leaders harder, but more realistic. In Civ 4 and later Civs you can build complex deals and propose them to the AI leaders. If they are bad, they tell you they are not acceptable and you can try again and again. You can see the "diplomatic price" of each item.

In SMAC you could make a single proposal per turn. If it was good, they would accept it, if it was almost good, they would counter your offer, if it wasn't good enough, they would actually get madder at you and stop talking for the rest of the turn (or for a few turns if you relations were that bad). That was the only feedback you'd get.

This small change made parlaying with AI leaders feel more realistic. Instead of going "Hm, you won't give me Zaragoza and all your money, because 'we are losing' is only at +15, I'll come next turn when it should be at +17" you start building a mental model of each leader and proposing deals you think they should accept.

[MaxikCZ]

This is being repeated during every AI comptenecy discussion, giving an example of "you wouldnt want AI that never misses in FPS". But its completely missing point.

We want AI that is capable to never miss, and then is tuned down in a controllable matter. We want smart AI that are dumbed down in precise ways to create illusion of dumb AI, not dumb AI boosted by resources and damage modifiers to give illusion of a smart one.

You can make smart AI look dumb (thus weaker), but hardly ever you can make dumb AI look smart, thus now the strong AI is just dumb AI with advantage

[blkhawk]

My definition of a smart AI is an AI that is smart at mimicking a human - that means as a Game AI it would play an entirely different game of "mimicking a human" in essence.

The issue is that a lot of things a computer controlled player does is entirely too easy to implement with just a few random rolls. This starts to fall apart if you want to vary the difficulty. So you can get a credible if disdained "AI" in a lot less effort that say training a Neural net to predict what action a human would likely take next.

There simply is no "GPT-1" AI of playing a game yet much less a "GPT-3" level one and I do not think that it would be entirely easy at all to "tune" it in any way to get a consistent difficulty scale.

[andsoitis]

ah but there is no smart AI yet

[root_axis]

Totally disagree. Civ increases AI difficulty by gifting the AI free army units, resources and settlers. There are currently no 4x games where the AI can challenge an experienced player on even terms - the first game to do this (while also being a good game in and of itself) will be a massive success.

[ethbr0]

My impression was there was a lot of research and competent results in StarCraft AI.

And that was 10 or so years ago.

Which is more constrained than your average 4X, but not fundamentally different (resource + research + movement + combat).

[Vespasian]

It would be a major breakthrough if the AI could plausible adapt to the human players.

Every one gets a challenge (or not if they chose so). We are probably not quite there yet.

[BlueTemplar]

Doesn't Galactic Civilizations 2 qualifies ? (Maybe for not particularly high values of "experienced".)

[raincole]

> The dirty secret is we think we want the AI to play more realistically, but actually don't.

The dirty secret is that we don't know if we want that. So far we don't have technology to make Civ AI play remotely like a reasonable human (at least not on a consumer grade PC). So we have absolute zero data point on how players will react to that.

[synu]

Also if this was actually true nobody would play multiplayer. And many people only play multiplayer because the AI is dumb.

[kevinwang]

It would be a different game, but as a counterpoint: people do play and enjoy multiplayer civ.

[mabbo]

I recall years ago playing some edition of "Galactic Civilizations" on single player and I started to get ready to attack a neighbour.

The neighbour saw this and sent me a message saying "If this were a harder difficulty mode, I would think you were planning to attack me!"

[flohofwoe]

One area where current advances in (chatbot-style) AI would make a lot of sense to apply in games is to make non-critical (for gameplay) interactions with NPCs more interesting, just as "background noise" to make the game world feel more alive.

E.g. you could start an "interesting" conversation with a random NPC in GTA or Hitman instead of getting the same pre-canned reactions over and over.

The downside then however is that the scripted characters which are important for driving the story forward will feel like pre-programmed robots compared to any 'unpredictable' random NPC ;)

[fshbbdssbbgdd]

If you can make an AI that can play like a smart human, you can make an AI that plays like a dumb human. And you can design a game that rewards cooperation between smart or dumb players.

[setr]

You want it to behave predictably. That doesn’t mean it needs to be predictably incompetent, and it doesn’t mean predictably optimal. Predictability is orthogonal to competency.

If the diplomacy mechanic cannot survive with players playing to win, then it’s clearly the diplomacy mechanic that’s wrong — diplomacy in reality is an inevitable result of multiple players playing to win; you don’t do diplomacy for fun, but to shift the world-state slightly in your favor by unifying against common threats.

Something must be fundamentally wrong with the model if it cannot encourage the most basic action within that model, without a player acting completely against his own interest

[lordnacho]

I think maybe the thing to do is not so much use LLMs (which I would still use for generating variety) for the AI's decision making, but to bring to bear the many lessons from TikTok and various other attention engines that we find on the internet.

Let the AI know everything, in the way that a father knows everything when teaching chess to his kid. But instead of just nurturing an independent chess player, feed the player with dopamine experiences that keeps him playing. Early victories, the joy of discovery, interesting diplomatic situations. Once they can play better, stretch it out a bit, more intricate setups.

No idea how to code this up.

[seszett]

I'm not sure why you would think they, when multiplayer games obviously show that intelligent opponents are nice to play against and that diplomacy is not only possible but much more interesting between humans.

[Sakos]

Even here, comments are pointing out how bad Civ's AI is. The solution isn't more realistic AI. It's better deterministic "AI" that allows you to learn how it plays and devise different strategies for how to deal with it. Unfortunately, AI is largely an afterthought for developers and players don't really understand what they want either.

[BlueTemplar]

Probably because an AI competent at playing the game is ridiculously hard in a game development context.

Meanwhile an AI better at roleplaying now seems to be a low investment for a decent reward situation ?

[as_bntd]

But isn't there a huge difference between the AI behaving 'realistically' and the AI playing 'to win'?

[treeman79]

Current civ6. Harder modes just give massive starter advantages and statistical bonuses.

3 starter cities compared to your 1. That can be brutal to overcome. Top players like potato mcwhisky basically have to know every little thing possible to win.

[MagicMoonlight]

Cope.

If AI was playing rationally then you would actually be able to understand it’s decisions and it wouldn’t do random shit or block deals because of RNG

[badpun]

In the real world, countries are lead by people (smarter than the best AI) and diplomacy is still a (major) thing.

[epigramx]

a lot about the nonsensical lust for 'ai' will be solved, once people realize it's not literal human 'intelligence', it's just a collage of data based on statistical analysis of past data and a prompt.

[gmadsen]

right, thats why some moves by alphago were called beautiful and deeply creative by human go masters?

idk know why this keeps getting repeated, it is NOT a statistical analysis of past data and a prompt. It is not just pattern matching. It is building models to predict patterns, which is a very different statement. And the fact of the matter is, is that is mostly still an unknown blackbox. It is an area of active research to understand the mechanisms of this blackbox.

[catach]

> once people realize it's not literal human 'intelligence'

I suspect that our brains are so profoundly hardwired to recognize certain signal patterns as proof of conscious intent that soon, even experts who should know better are doomed to be fooled. The layman has no chance.

[AuryGlenz]

Careful, it’s possible you just described human intelligence ;)

[presentation]

Hard disagree, I find civ to be crappy in single player because it’s AI is so dumb and just gets unfair advantages to remain competitive, it turns the game into just cheesing the stupid AI until you win at harder difficulties. So I ended up only playing multiplayer, but since the devs don’t care about making a reasonable networking stack it just crashes all the time. Hopefully they fix the AI, but if not I hope they actually make the networking stack not suck.