[math-fun] Chess Solved
"Computer program can't lose at checkers" http://news.yahoo.com/s/ap/20070719/ap_on_hi_te/solving_checkers;_ylt=AoQVuW... apparently, they analyzed all games with 10 or fewer remaining pieces. the correct website (not the one in the yahoo article) is: http://www.cs.ualberta.ca/~chinook/ warning: if you don't have the latest java, parts of the chinook site will hang your firefox browser!
Whew! It's just checkers, not chess. On 7/19/07, Robert Baillie <rjbaillie@frii.com> wrote:
"Computer program can't lose at checkers"
http://news.yahoo.com/s/ap/20070719/ap_on_hi_te/solving_checkers;_ylt=AoQVuW...
apparently, they analyzed all games with 10 or fewer remaining pieces.
the correct website (not the one in the yahoo article) is: http://www.cs.ualberta.ca/~chinook/ warning: if you don't have the latest java, parts of the chinook site will hang your firefox browser!
_______________________________________________ math-fun mailing list math-fun@mailman.xmission.com http://mailman.xmission.com/cgi-bin/mailman/listinfo/math-fun
-- Mike Stay metaweta@gmail.com http://math.ucr.edu/~mike
The article confuses me. How can checkers be "solved" if only the best-play outcome is only known for pieces involving at most ten pieces? On the other hand, the article says this: * * * It does not matter how the players make it to 10 checkers left because from that point on, the computer cannot lose, Schaeffer said. For two players who never make a mistake, every game would be a draw, he said. * * * This would seem to imply that the best-play outcome of the checkers start position is known to be a draw. Is that right? On 7/19/07, Mike Stay <metaweta@gmail.com> wrote:
Whew! It's just checkers, not chess.
On 7/19/07, Robert Baillie <rjbaillie@frii.com> wrote:
"Computer program can't lose at checkers"
http://news.yahoo.com/s/ap/20070719/ap_on_hi_te/solving_checkers;_ylt=AoQVuW...
apparently, they analyzed all games with 10 or fewer remaining pieces.
the correct website (not the one in the yahoo article) is: http://www.cs.ualberta.ca/~chinook/ warning: if you don't have the latest java, parts of the chinook site will hang your firefox browser!
_______________________________________________ math-fun mailing list math-fun@mailman.xmission.com http://mailman.xmission.com/cgi-bin/mailman/listinfo/math-fun
-- Mike Stay metaweta@gmail.com http://math.ucr.edu/~mike
_______________________________________________ math-fun mailing list math-fun@mailman.xmission.com http://mailman.xmission.com/cgi-bin/mailman/listinfo/math-fun
-- Thane Plambeck tplambeck@gmail.com http://www.plambeck.org/ehome.htm
On Thu, 19 Jul 2007, Thane Plambeck wrote:
The article confuses me. How can checkers be "solved" if only the best-play outcome is only known for pieces involving at most ten pieces?
Here's what the paper in Science says (in part): The researchers began by constructing a database of all 39,000 billion arrangements with 10 or fewer pieces on the board. In the process, they determined whether each one led to a win for black, a win for red, or a draw. They then considered the very beginning of the game, opened with a move by black, and then used a specialized search algorithm to trace out subsequent moves and show that, as the two players try to maximize their advantage, they inevitably steer the game to one of the 10-checker configurations that leads to a draw. Schaeffer credits improvements in computers for making the result possible. In fact, he suspended work from 1997 to 2001 to wait for a particular technology--the 64-bit processor--to mature. But Murray Campbell, a computer scientist at IBM's Thomas J. Watson Research Center in Hawthorne, New York, says that the researchers' ingenuity was key, too. "Without a lot of the clever ideas behind what they did, I think it would have been a number of years before technology alone could have solved checkers," says Campbell, who co-wrote the Deep Blue program that defeated chess champion Garry Kasparov in 1997. Most experts expected that checkers would eventually be proved a draw, says Jaap van den Herik, a computer scientist at Maastricht University in the Netherlands, if only because grandmaster players routinely play each other to a draw. But, he says, "if you have not proved the result, then every expectation is worth nothing." Schaeffer says he feels vindicated by the proof. In 1994, a program he developed called Chinook played the then-reigning world champion, Marion Tinsley, to a series of draws before Tinsley withdrew because of health problems and conceded. Tinsley, who is considered the best player ever and who lost only three tournament games from 1951 to 1991, died of cancer 8 months later. Some players scorned Schaeffer, he says, and even charged that the stress of the special title match had killed Tinsley. Chinook defended its crown in two subsequent matches against the next-highest-ranked player. "To this day, I still get people saying that you would never have beaten Tinsley," Schaeffer says. "The program today would never lose to Tinsley or anyone else, period." And because humans eventually make mistakes, the program should inevitably prevail in a series of games against any person, even Tinsley, for whom Schaeffer says he has "great respect." Van den Herik worries that Schaeffer's solution will accelerate the decades-long decline of tournament checkers. Meanwhile, Schaeffer is turning his computers to poker. In principle, that game can't be solved--but it can make you a lot of money.
From: "Edwin Clark" <eclark@math.usf.edu>
Here's what the paper in Science says (in part):
Meanwhile, Schaeffer is turning his computers to poker. In principle, that game can't be solved--but it can make you a lot of money.
Here are some news about that: http://www.pokernews.com/news/2007/7/man-machine-poker-championship-tomorrow... http://www.cardplayer.com/poker-news/article/9320 Alec Mihailovs http://mihailovs.com/Alec/
From: "Alec Mihailovs" <alec@mihailovs.com>
From: "Edwin Clark" <eclark@math.usf.edu>
Here's what the paper in Science says (in part):
Meanwhile, Schaeffer is turning his computers to poker. In principle, that game can't be solved--but it can make you a lot of money.
Here are some news about that:
http://www.pokernews.com/news/2007/7/man-machine-poker-championship-tomorrow...
Just found another link - on the Alberta University site, http://poker.cs.ualberta.ca/man-machine/ Alec Mihailovs http://mihailovs.com/Alec/
From: "Alec Mihailovs" <alec@mihailovs.com>
And we can see that poker is not solved yet. Alec
I've seen various papers analyzing (extremely restricted) poker-like card games, and have often wondered what the best results along these lines are. Maybe someone knows a good survey article? I'm more interested in the most-complicated poker-like card game for which an optimal play strategy is known that in programs designed to play full-blown poker (but which involve heuristics or AI kind of things...) On 7/25/07, Alec Mihailovs <alec@mihailovs.com> wrote:
From: "Alec Mihailovs" <alec@mihailovs.com>
And we can see that poker is not solved yet.
Alec
_______________________________________________ math-fun mailing list math-fun@mailman.xmission.com http://mailman.xmission.com/cgi-bin/mailman/listinfo/math-fun
-- Thane Plambeck tplambeck@gmail.com http://www.plambeck.org/ehome.htm
the simplest non-trivial poker game i can think of is: 1. the players ante one chip each to the pot. 2. the players are each dealt a card from a deck of three cards: 1, 2, and 3. 3. A has the opportunity to bet one chip (B must call if he wants to continue to play). 4. if A doesn't bet, B can bet one chip (A must call if he wants to continue to play). 5. if both players are still in, best hand wins the pot. there is clearly no incentive to bluff with a 2, but there is with a 1. what are the optimal strategies for this game? if you can manage that, what are the optimal strategies with the cards 1, 2, 3, and 4? erich
I've seen various papers analyzing (extremely restricted) poker-like card games, and have often wondered what the best results along these lines are.
Maybe someone knows a good survey article?
On 7/26/07, Erich Friedman <efriedma@stetson.edu> wrote:
the simplest non-trivial poker game i can think of is:
1. the players ante one chip each to the pot. 2. the players are each dealt a card from a deck of three cards: 1, 2, and 3. 3. A has the opportunity to bet one chip (B must call if he wants to continue to play). 4. if A doesn't bet, B can bet one chip (A must call if he wants to continue to play). 5. if both players are still in, best hand wins the pot.
there is clearly no incentive to bluff with a 2, but there is with a 1. what are the optimal strategies for this game?
if you can manage that, what are the optimal strategies with the cards 1, 2, 3, and 4?
erich
I've seen various papers analyzing (extremely restricted) poker-like card games, and have often wondered what the best results along these lines are.
Maybe someone knows a good survey article?
The book you want is The Mathematics of Poker, by Bill Chen and Jerrod Ankenman. It analyzes a series of "toy poker games" like these, of gradually increasing complexity, some of which have optimal solutions that exhibit quite surprising results. There are also more practical sections that talk about what these results tell you about how you should play actual poker. Disclaimer: Bill and Jerrod are friends of mine, and I was originally going to be a co-author of this book, but I didn't have the time. -- Andy.Latto@pobox.com
Thu, 26 Jul 2007 11:53:00 -0400 "Andy Latto" <andy.latto@gmail.com> The book you want is The Mathematics of Poker, by Bill Chen and Jerrod Ankenman. A book you probably *don't* want, but may enjoy anyway, is "Poker Strategy: Winning with Game Theory" by Nesmith Ankeny (he was a math professor at MIT when I was an undergrad). It is a book about how to win at poker, but (for better or for worse) written by a mathematician. If I remember correctly, the main concern of the book was when and how to bluff. It is available used from Amazon (published by Basic Books in 1981, ISBN 0-465-05839-6
MikeG>A book you probably *don't* want, but may enjoy anyway, is "Poker Strategy: Winning with Game Theory" by Nesmith Ankeny (he was a math professor at MIT when I was an undergrad). It is a book about how to win at poker, but (for better or for worse) written by a mathematician. If I remember correctly, the main concern of the book was when and how to bluff. I took his seminar in '64 or '65 and had to deliver in class a precis on his manuscript. The only thing I remember was never bluff on a mediocre hand. He claimed to finance an annual trip to Las Vegas by playing poker with off-duty blackjack dealers. --rwg
FYI -- The New York Times July 26, 2007 In Poker Match Against a Machine, Humans Are Better Bluffers By JOHN MARKOFF VANCOUVER, British Columbia, July 25  For anyone stuck on a casino stool, playing hours of video poker, rest assured: humans can still beat a computer. But computers may soon dominate on the felt-top table, as they have on the chessboard. In a match of wits between man and machine this week, a software program running on an ordinary laptop computer fought a close match, but lost to two well-known professional human poker players. The contest, which was billed as the ÂFirst Man-Machine Poker Championship and which offered prize money totaling $50,000, pitted two professionals, Phil Laak and Ali Eslami, against a program written by a team of artificial intelligence researchers from the University of Alberta. They gave it a name that probably no gambler would ever choose as a nickname, Polaris. Poker is thought to be a more difficult challenge for software designers than games like chess and checkers. Computer scientists have to develop different strategies and algorithms to deal with the uncertainties introduced by the hidden cards held by each player as well as difficult-to-quantify risk-taking behaviors such as bluffing. In the past, research has focused on chess and checkers. In 1997 Deep Blue, a supercomputer-based chess playing software system developed by I.B.M. researchers, beat Gary Kasparov, the world chess champion. The University of Alberta researchers won the world checkers championship in 1994, and earlier this month they reported that they had developed a program that cannot lose, and at best can be tied at checkers. However, Jonathan Schaeffer, chairman of the University of Alberta computer science department and the researcher who initiated the poker playing research effort 16 years ago, said that the advances that are being made in the development of poker-playing software are likely to be more applicable in the real world than chess research. ÂI contend that poker is harder than chess for computers, and the research results that come out of the work on poker will be much more generally applicable than what came out of the chess research, he said. Research interest has shifted to games like poker in recent years, in part because chess is no longer of keen interest and in part because rapid progress is being made in developing new algorithms with broad practical applications in areas such as negotiation and commerce, said Tuomas Sandholm, a Carnegie Mellon University computer scientist. The version of poker used in the match Monday and Tuesday at the annual meeting of the Association for the Advancement Artificial Intelligence was a popular game called Texas Hold ÂEm heads-up limit poker, a two-player game in which some cards are hidden and others are playable by both sides. Each hand is played in four rounds during which each side can bet or fold. After four rounds of 500 hands each, lasting about four hours, the player with the most money is declared the winner. Unlike chess competitions, which are marked by extreme concentration and long moments of silence, the tournament in a hotel here was festive, with each human competitor offering a running commentary on PolarisÂs style of play to an audience of several hundred people. Mr. Laak, who is nicknamed the Unabomber because of his trademark hooded sweatshirt and sunglasses, would frequently gesticulate wildly at the laptop computer screen and repeatedly referred to the computerÂs play as Âsick  his way of describing an unexpected or extraordinary action on the part of the machine. His supporters included Jennifer Tilly, an actress who is also a well-known professional poker player. The contest had to be formatted to accommodate the computer. To counter the luck of the draw, a dominating factor in poker, the human players were put in separate rooms. The hand dealt to the human in one room was identical to the hand dealt to the computer in the other room. The format also eliminated one of the crucial aspects of traditional poker called the tell, subtle clues such as facial ticks that may permit other players to make accurate guesses about the hidden cards held by their opponent. Mr. Eslami and Mr. Laak are both well-known figures in the world of poker and are mathematically skilled and familiar with the techniques used by their opponents. Although Mr. Eslami and Mr. Laak are not the best human players in the world, the scientists argued that their knowledge of computing made them more effective opponents than other top-ranked poker players. The human team reached a draw in the first round even though their total winnings were slightly less than that of the computer. The match rules specified that small differences were not considered significant because of statistical variation. On Monday night, the second round went heavily to Polaris, leaving the human players visibly demoralized. ÂPolaris was beating me like a drum, Mr. Eslami said after the round. However, during the third round on Tuesday afternoon, the human team rebounded, when the Polaris teamÂs shift in strategy backfired. They used a version of the program that was supposed to add a level of adaptability and Âlearning. Unlike computer chess programs, which require immense amounts of computing power to determine every possible future move, the Polaris poker software is largely precomputed, running for weeks before the match to build a series of agents called Âbots that have differing personalities or styles of play, ranging from aggressive to passive. The Alberta team modeled 10 different bots before the competition and then chose to run a single program in the first two rounds. In the third round, the researchers used a more sophisticated ensemble of programs in which a Âcoach program monitored the performance of three bots and then moved them in and out of the lineup like football players. Mr. Laak and Mr. Eslami won the final round handily, but not before Polaris won a $240 pot with a royal flush then beat Mr. EslamiÂs three-of-a-kind. The two men said that Polaris had challenged them far more than their human opponents.
yikes! sorry for the typo! it IS checkers. bob --- Mike Stay wrote:
Whew! It's just checkers, not chess.
On 7/19/07, Robert Baillie <rjbaillie@frii.com> wrote:
"Computer program can't lose at checkers"
http://news.yahoo.com/s/ap/20070719/ap_on_hi_te/solving_checkers;_ylt=AoQVuW...
apparently, they analyzed all games with 10 or fewer remaining pieces.
the correct website (not the one in the yahoo article) is: http://www.cs.ualberta.ca/~chinook/ warning: if you don't have the latest java, parts of the chinook site will hang your firefox browser!
_______________________________________________ math-fun mailing list math-fun@mailman.xmission.com http://mailman.xmission.com/cgi-bin/mailman/listinfo/math-fun
participants (10)
-
Alec Mihailovs -
Andy Latto -
Edwin Clark -
Erich Friedman -
greenwald@cis.upenn.edu -
Henry Baker -
Mike Stay -
R. William Gosper -
Robert Baillie -
Thane Plambeck