Counterfactual Regret Minimisation or How I won any money in Poker?

I used CFR to solve another card game called Setback (aka Auction Pitch), which is a trick-taking game that’s similar to, but simpler than, Bridge.<p>CFR is very effective, but slow and requires a lot of RAM. I had to create a smaller, abstract version of the game, solve that, and then map the result back to the actual game, so I didn’t end up with a perfect Nash equilibrium, but the solution does still play at a super-human level.<p>One of the interesting things about my approach is that it actually uses CFR at two separate levels: First it solves a single-deal version of the game, then it uses that solution to run CFR again on a repeated version of the game where each player accumulates points across multiple deals. (Bidding in Setback is highly score-dependent.)<p>I think a similar approach might be possible for Hearts, but I haven’t tried it yet. Solving Bridge with CFR may be beyond our current capability, but could also be possible in the future.<p>[0]: <a href="https:&#x2F;&#x2F;www.bernsrite.com&#x2F;Setback" rel="nofollow">https:&#x2F;&#x2F;www.bernsrite.com&#x2F;Setback</a><p>[1]: <a href="https:&#x2F;&#x2F;github.com&#x2F;brianberns&#x2F;Setback">https:&#x2F;&#x2F;github.com&#x2F;brianberns&#x2F;Setback</a><p>[2]: <a href="https:&#x2F;&#x2F;github.com&#x2F;brianberns&#x2F;Cfrm">https:&#x2F;&#x2F;github.com&#x2F;brianberns&#x2F;Cfrm</a>

The commercially available solvers may be using CFR, but they are not anywhere near as strong as Pluribus because Pluribus pre-computed solutions for a reduced state space, then mapped the hand and actions into that reduced space and solved from there. That meant Pluribus could come up with a much better solution in much less time than the commercial solvers. This is also why most of the solvers only solve heads up.

I&#x27;m curious if one can make any money playing poker online while following some computer-optimized strategy. I assume many (most?) players are already doing this. Insights are appreciated :)

That&#x27;s evidential decision theory, right? You minimize the expected regret. If that&#x27;s not risk adverse enough for you, you can weight together multiple perturbation groups for your world model and utility function.

The OP mentions use of CFR in transportation logistics problems. Does anyone know of examples?

Something that is surprising to me is that there are seemingly no strong open-source poker AIs available. Maybe it&#x27;s because implementing CFR for poker is genuinely difficult?

I made a CRM bot for Texas hold-em limited using the uni supercomputer in 2012 something. It was quite good, beat the reference bots, but it could not play online. I think there was house bots or already mainly good bots in the poker rooms at that time. Internet poker has been broken for a long long time.