[Padding]

> Let's exclude things like rigorous scientific studies for the purpose of the discussion and focus on day-to-day human reasoning

I think you'll need to look at the other end of the spectrum to see an abundance of (wrong?) models of causality: Religion and Law.

There are no "confirmed" cases of anyone actually going to heaven or hell or purgatory (or whatever else), and yet many of us still conform to some arbitary ruleset in the hopes of eventually ending (or not ending) up in one of thoses places, because we have constructed some model of how doing this gets you into hell and doing that gets you into heaven.

Similarly, we have plenty of evidence on how companies spend huge effort on finding loopholes in tax laws in order to avoid taxes, and yet instead of simplyfing the ruleset (so that there are obviously no holes in it) we still opt for piling on more laws (so that there are no obvious holes in it) because we construct (faulty?) models of how those new rules will prevent further exploits.