CAS makes new AI poker program

Chinese scientists have developed an artificial intelligence program that is quick-minded and on par with professional human players in heads-up no-limit Texas Hold'em poker.

The AI program called AlphaHoldem equaled four sophisticated human players in a 10,000-hand two-player competition, after three days of self-training, according to a paper to be presented at AAAI 2022, a global AI conference to be held in Vancouver, Canada, in February.

Texas Hold'em is a popular poker game in which players often deceive and bluff. It is more similar to real-world problems than Go and chess since decisions are made with imperfect information.

The researchers from the Institute of Automation of the Chinese Academy of Sciences reported that AlphaHoldem, a fast learner, used only about three to four milliseconds for each movement, about 1,000 times quicker than that of first-generation AI Hold'em players DeepStack and Libratus. AlphaHoldem got the better of DeepStack in a 100,000-hand competition, according to the researchers.

DeepStack, developed by the University of Alberta, and Libratus, developed by Carnegie Mellon University, beat professional players in heads-up no-limit two-player Hold'em in 2016 and 2017.

The two previous AI players, based on an algorithm called counterfactual regret minimization, spent respectively three and four seconds for each movement, consuming a large amount of computing power, the researchers say.

AlphaHoldem, which employs a new framework by incorporating deep-learning into a new self-play algorithm, used only eight GPUs during its training, which is ultralightweight compared with DeepStack's 13,000 GPUs, according to the recent news release by the CAS.

The researchers say looking forward, they will apply the underlying technology to other games like mahjong and bridge, fostering smarter AI.

Xinhua