{"id":241,"date":"2008-03-12T16:05:12","date_gmt":"2008-03-12T20:05:12","guid":{"rendered":"http:\/\/mat.tepper.cmu.edu\/blog\/?p=235"},"modified":"2008-03-12T16:05:12","modified_gmt":"2008-03-12T20:05:12","slug":"poker-and-operations-research","status":"publish","type":"post","link":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/2008\/03\/12\/poker-and-operations-research\/","title":{"rendered":"Poker and Operations Research"},"content":{"rendered":"

I just attended a fantastic talk by Michael Bowling<\/a> of the University of Alberta entitled “AI After Dark: Computers Playing Poker” where he described work by the U of A Computer Poker Research Group<\/a>. Like most artificial intelligence research (particularly in games), there is no veneer of trying to mimic the human brain in this work: it is all about algorithms to compute optimal strategies, which puts it solidly within operations research by my view.<\/p>\n

Much of his talk revolved around a recent “Man-Machine Poker Championship”<\/a> where a program they have developed played against two professional poker players: Phil “The Unabomber” Laak and Ali Eslami. Laak is known from TV appearances; I haven’t seen Eslami, but he has a computer science background and understands the work the U of A researchers do, so that might make him an even more formidable opponent. The results were, at one level, inconclusive. The humans (playing in “duplicate” poker) won two of the four 500 deal matches, lost one, and one was tied. The overall amount of money “lost” by the computer was very small. I have no doubt that most humans facing professionals would have lost a lot more. So having a competitive program is already a big step. Like most who lose at poker, Michael claimed “bad luck” but he has the technical skills to correct for the luck, and was pretty convincing that the computer outplayed the humans.<\/p>\n

One interesting aspect is that the program does no “opponent analysis” yet, though that is an extremely active research area (75% of the U of A’s efforts, Michael said). Given a couple more years, I am pretty confident that these programs will start giving the pros a run for their money. Michael said that one goal of their work could be stated: they want to make Phil Helmuth cry. That seems a little less likely.<\/p>\n

On the technical side, the presentation concentrated on some new ways for systems to learn to solve huge (1000000000000 state) extensive form games. They have a neat system for having systems learn by playing against themselves. It takes a month of serious computation to tune the poker player, but the method may have other applications in economics. Check out Michael’s publications<\/a> for more information.<\/p>\n

Definitely one of the best talks I have heard in a long time!<\/p>\n","protected":false},"excerpt":{"rendered":"

I just attended a fantastic talk by Michael Bowling of the University of Alberta entitled “AI After Dark: Computers Playing Poker” where he described work by the U of A Computer Poker Research Group. Like most artificial intelligence research (particularly in games), there is no veneer of trying to mimic the human brain in this … Continue reading “Poker and Operations Research”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[40,46],"tags":[],"class_list":["post-241","post","type-post","status-publish","format-standard","hentry","category-people","category-research"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/241","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=241"}],"version-history":[{"count":0,"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/posts\/241\/revisions"}],"wp:attachment":[{"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=241"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=241"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mat.tepper.cmu.edu\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=241"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}