Hand History Parser for obtaining Player Stats

Add your suggestions for improving Poker Mavens

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Mon May 11, 2020 7:43 pm

I made the suggested change, but the output is still the same. Below is a copy paste of that portion of the script (in case I got it wrong). Thanks for the help, by the way.


else:
# process each file listed on the command line
# first loop through is just to parse and get each hand separated, and get basic hand
# info into the hands dictionary
# basic hand info is hand number, local hand number, hand time, and table
# everything else goes into TEXT
for fh in args.file:
f = open(fh.name, mode='r', encoding='utf-8')
line = f.readline()
while (len(line) != 0):
matches = re.search("Hand #(\d*)-(\d*) - (.*)$",line)
if (matches != None):
handNumber = matches.group(1)
handTime = datetime.datetime.strptime(matches.group(3),"%Y-%m-%d %H:%M:%S")
hands[handNumber] = {LOCAL: matches.group(1),
DATETIME: handTime,
TEXT: ''}
line = f.readline()
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Mon May 11, 2020 7:44 pm

Oh, the forum did not format with spacing. I'm not sure how to post an image here.
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Mon May 11, 2020 7:46 pm

LOL, my bad. I was feeding it a log file, not a hand history file

Working fine now :)
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Mon May 11, 2020 7:49 pm

If I "stitched" two hand history files together, would this still work? Often games go from before midnight, until after midnight. This means the session history is spread over two files. If I just copied and pasted the contents of two files into one, would that work?
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby Kent Briggs » Mon May 11, 2020 7:49 pm

naked_eskimo wrote:I'm not sure how to post an image here.


Click the "Upload attachment" tab below the edit box.
Kent Briggs - [email protected]
Briggs Softworks - http://www.briggsoft.com
Kent Briggs
Site Admin
 
Posts: 5278
Joined: Wed Mar 19, 2008 8:47 pm

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Mon May 11, 2020 8:07 pm

Here is what the output looks like. Does this look correct?

C:\misc\python>processLogs.py "HH2020-05-09 Table#1 NLHE .50%2F$1 10 Max.txt"
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10748 has 100.0 expected 99.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10766 has 101.0 expected 100.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10769 has 100.5 expected 99.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10771 has 100.0 expected 99.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10774 has 96.0 expected 95.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10777 has 96.0 expected 95.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10779 has 109.5 expected 108.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10781 has 108.5 expected 107.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10782 has 107.5 expected 106.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10783 has 104.5 expected 103.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10784 has 103.5 expected 102.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10785 has 103.5 expected 102.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10786 has 103.5 expected 102.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10787 has 102.5 expected 101.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10788 has 115.5 expected 114.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10789 has 115.5 expected 114.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10790 has 115.5 expected 114.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10791 has 115.5 expected 114.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10792 has 115.5 expected 114.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10793 has 112.5 expected 111.5
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10794 has 114.0 expected 113.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10795 has 113.0 expected 112.0
Inconsistent state for Gilly in table Table#1 NLHE .50/$1 10 Max hand 10796 has 112.5 expected 111.5
Players: 8
Table Table#1 NLHE .50/$1 10 Max: Processed hands: 24

Player Notes for Bouchey22
2020-05-09 23:30:47 table Table#1 NLHE .50/$1 10 Max hand (10743) initial buy in 220.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 195.0
Total IN 220.0
Total OUT 195.0
Bouchey22 owes 25.0


Player Notes for Gilly
2020-05-09 23:30:47 table Table#1 NLHE .50/$1 10 Max hand (10743) initial buy in 100.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 111.5
Total IN 100.0
Total OUT 111.5
Gilly is due 11.5


Player Notes for radarrayner
2020-05-09 23:39:06 table Table#1 NLHE .50/$1 10 Max hand (10766) initial buy in 100.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 94.75
Total IN 100.0
Total OUT 94.75
radarrayner owes 5.25


Player Notes for GDJI
2020-05-09 23:39:33 table Table#1 NLHE .50/$1 10 Max hand (10769) initial buy in 100.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 114.5
Total IN 100.0
Total OUT 114.5
GDJI is due 14.5


Player Notes for jpodge
2020-05-09 23:40:36 table Table#1 NLHE .50/$1 10 Max hand (10774) initial buy in 200.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 222.75
Total IN 200.0
Total OUT 222.75
jpodge is due 22.75


Player Notes for ChefWill
2020-05-09 23:44:53 table Table#1 NLHE .50/$1 10 Max hand (10782) initial buy in 100.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 91.0
Total IN 100.0
Total OUT 91.0
ChefWill owes 9.0


Player Notes for ANOG77
2020-05-09 23:48:18 table Table#1 NLHE .50/$1 10 Max hand (10786) initial buy in 100.0
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) ended table with 92.0
Total IN 100.0
Total OUT 92.0
ANOG77 owes 8.0


Player Notes for Jeff
2020-05-09 23:51:02 table Table#1 NLHE .50/$1 10 Max hand (10788) initial buy in 60.0
2020-05-09 23:51:02 table Table#1 NLHE .50/$1 10 Max hand (10788) stood up with 60.0
2020-05-09 23:52:01 table Table#1 NLHE .50/$1 10 Max hand (10789) player returned with 60.0
2020-05-09 23:52:01 table Table#1 NLHE .50/$1 10 Max hand (10789) stood up with 60.0
2020-05-09 23:53:13 table Table#1 NLHE .50/$1 10 Max hand (10790) player returned with 60.0
2020-05-09 23:53:13 table Table#1 NLHE .50/$1 10 Max hand (10790) stood up with 60.0
2020-05-09 23:53:57 table Table#1 NLHE .50/$1 10 Max hand (10791) player returned with 60.0
2020-05-09 23:53:57 table Table#1 NLHE .50/$1 10 Max hand (10791) stood up with 60.0
2020-05-09 23:55:24 table Table#1 NLHE .50/$1 10 Max hand (10792) player returned with 60.0
2020-05-09 23:55:24 table Table#1 NLHE .50/$1 10 Max hand (10792) stood up with 59.0
2020-05-09 23:56:51 table Table#1 NLHE .50/$1 10 Max hand (10793) player returned with 59.0
2020-05-09 23:56:51 table Table#1 NLHE .50/$1 10 Max hand (10793) stood up with 58.5
2020-05-09 23:57:22 table Table#1 NLHE .50/$1 10 Max hand (10794) player returned with 58.5
2020-05-09 23:57:22 table Table#1 NLHE .50/$1 10 Max hand (10794) stood up with 61.5
2020-05-09 23:58:00 table Table#1 NLHE .50/$1 10 Max hand (10795) player returned with 61.5
2020-05-09 23:58:00 table Table#1 NLHE .50/$1 10 Max hand (10795) stood up with 61.5
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) player returned with 61.5
2020-05-09 23:59:23 table Table#1 NLHE .50/$1 10 Max hand (10796) stood up with 58.5
Total IN 540.5
Total OUT 539.0
Jeff owes 1.5


Net balance: 0.0

C:\misc\python>
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby StevieG » Mon May 11, 2020 8:48 pm

First off, yes, you can feed it multiple files. So if your session extends over multiple days, or multiple tables, you should be able to list those and process them.

naked_eskimo wrote:Here is what the output looks like. Does this look correct?


Kind of.

The script has two main loops.

The first loop runs through all files processed, and grabs the hands and puts them in a Python dictionary data structure, organized by table.

The second loop then runs through all those hands, sorted by time, and attempts to keep track of all chip transactions (who sat down with how much, any add-ons, and what they end with).

At the end of each hand it tries to reconcile an amount, and then when it gets the next hand for the table, it wants to see that everyone has as much in play as it expects them to have.

In this case, clearly something is wrong with Gilly's count, and it happens at hand 10748 on table #1 NLHE.

I don't know why it is off, and although only $1, something is amiss.

My email is in the script. If you want, send me the HH and I will take a look.

Otherwise it is telling you exactly what I expect to see. There were 8 players seen in the log file, and it tells you their net for the session. The amount zeroes out. But the count may be off by $1 for Gilly and someone else.
StevieG
 
Posts: 56
Joined: Mon May 04, 2020 12:27 pm

Re: Hand History Parser for obtaining Player Stats

Postby StevieG » Tue May 12, 2020 1:50 pm

Thanks to naked_eskimo for trying this out and finding a couple issues to fix.

Here it is again, with fixes

Code: Select all
#!/usr/bin/python
# processLogMavens.py
# Steve Grantz [email protected]
# 2020-04-26
# Usage:
# python processLogMavens.py logfile.txt [logfile2.txt ...]

############################################################################################################
# WHAT THIS DOES
#
# goal of this program is to process Poker Mavens logs to track player activity
# - initial appearance (initial buy-in)
# - addition of chips
# - last known amount of chips
#
# To do this we will take the logs and first break it up into hand by hand, indexed by time
# for a chronology
#
# Then we can loop through each hand, and process for player activity
# the first time we see a player, we add them and their first known chip count
# then in each hand we not additional chips, as well as resolution of the pot
#
# When processing the next hand, everything SHOULD align
# if it does not, throw an error
# otherwise keep processing
#
# look for wins, add ons, and pot contributions
# log cash in and cash out for narrative at end of night
#
# KEY ASSUMPTIONS
#
# assume unique hand number (that is the hand number can NOT repeat across tables)
# assume that the hand nummber structure NNN-M can be reduced to NNN andt hat the M local part is not needed
#
#
# CHANGE LOG
# 2020-04-26 v0.1 first version
# 2020-04-28 v0.2 email results
# 2020-05-12 v0.4 bug fixes
#

import argparse
import csv
import datetime
import getpass
import json
import os
import re
import sys


from os import path
from smtplib import SMTP

# constants
VERSION = "0.4"
CSVTRANS = "gamelog.csv"
CSVBALANCE = "balances.csv"
LOCAL = "local"
INDEX = "imdex"
TEXT = "text"
FIRST = "first"
LATEST = "latest"
LAST = "last"
IN = "cash in"
OUT = "cash out"
WAITING = "sitting out"
LEFT = "left table"
NOTES = "notes"
TABLE="table"
COUNT="count"
DATETIME="datetime"
NAME="name"
UNIT="unit"
EMAIL="email"

# constants around email options
EMAIL_SUBJ_PREFIX = "Mavens game info from "
FROMADDRESS = '[email protected]'
CCADDRESS = '[email protected]'
SMTPSERVER = 'mail.mydomain.tld'
SMTPPORT = 26
DEBUGLEVEL = 0


##################################################################################################################
#
# DATA STRUCTURES
#
hands = {}    # the hands dictionary
              # structure
              # KEY - string - hand number
              # LOCAL - string - he "dash" portion of the hand number, may recombine, but so far unique without it
              # DATETIME - datetime - timestamp for the hand
              # TABLE - string - table where the hand happened
              # TEXT  - string - full text of hand, with newlines

players = {}  # the players dictionary
              # structure
              # KEY - string - player name as found in log
              # IN - float - total money in
              # OUT - float - total money out
              # NOTES - string log of activity with newlines
              # sub-dictionary by TABLE ******
              #      KEY - string for the table - will only exist if player was seen at table in logs
              #      FIRST - float - initial buy in for table - not really used much, could be deprecated
              #      IN - float - money in at this table
              #      OUT - float - money out at this table
              #      WAITING - Boolean - whether player is seated ut not in play
              #      LEFT - Boolean - player has been at table but is no longer seated
              #      LATEST - float - running tally of player holding at the table - IMPORTANT for checking consistency

tables = {}   # the tables dictionary
              # structure
              # KEY - string - table name as found in log
              # COUNT - integer - number of hands processed for table
              # LATEST - datetime - the latest time stamp for a hand processed for this table
              # LAST - string - hand number for the latest hand processed for this table
              #        LAST and LATEST are used to mark the "end" activity of players standing up
              #        they represent the last seen hand at the table from the processed logs

csvRows = []  # list of lists for the csv transaction content
              # see CSV Header for list of fields
              # CSV - log of activity in CS format - with newlines
csvHeader =  ["Time",
               "Table",
               "Hand Number",
               "Player",
               "Action",
               "Amount In",
               "Amount Out"
               ]

csvBalances = []  # list of lists for the csv balance content
csvBalanceHeader =  ["Date",
                     "Disposition",
                     "Player",
                     "Amount"
                     ]

# resolvedScreenNames dictionary takes in Poker Mavens Screen Name as has info needed for processing
#               Structure
#               KEY - Poker Mavens screen name
#               NAME - short name used in player ledger
#               EMAIL - email address for the player for sending player notes for session
resolvedScreenNames = {
               'MyScreenName':{NAME:'me',EMAIL:"[email protected]"},
               }

# end of data structures
#
#######################################################################################################################

##################################################################################################################
#
# FUNCTIONS
#

# isNewPlayer checks to see if the player exists in the player dictionary, and if not, adds them
# ALL it does is add them and create initial notes, so if additional work needs to be done, check the
# return status for True and then do that extra work
# if context is given in the form of a table name, then additionally the function checks if the player
# has a sub-dictionary for the table. If not, that is created.
#
def isNewPlayer(check, table = None):
    "Check to see if player exists in players dictionary, and add them if not. Return new status."
    isNew = False
    if (table is not None):
        if (not check in players):
            isNew = True
            players[check] = {IN: 0, OUT: 0, NOTES: ""}
            players[player][NOTES] = ("Player Notes for " + player + os.linesep)
        if (not table in players[check]):
            isNew = True
            players[player][table] = {FIRST: 0, IN: 0, LATEST: 0, OUT: 0, LEFT: False}
    elif (not check in players):
        isNew = True
        players[check] = {IN: 0, OUT: 0, NOTES: ""}
        players[player][NOTES] = ("Player Notes for " + player + os.linesep)

    return isNew


# end of functions
#
#######################################################################################################################

lineCount = 0
sessionDate = datetime.datetime.now().strftime("%m/%d/%Y")

# get and parse command line arguments
# then process some key ones straight away
# namely, if roster option is used, dump the player roster and go
# if email option is activated, check for presence of password command line argument
# if not there prompt for it
parser = argparse.ArgumentParser(description='Process Poker Mavens log files and deliver transaction info and player balances.')
parser.add_argument('-c','--csv', action="store_true",dest="doCsv",default=False,help="Output CSV content.")
parser.add_argument('-e','--email', action="store_true",dest="doEmail",default=False,help="Email player results.")
parser.add_argument('-p','--password', action="store",dest="password",
                    help=("Password for email account (" + FROMADDRESS + ")"))
parser.add_argument('-q','--quiet', action="store_true",dest="quiet",default=False,help="Run in quiet mode with minimal output.")
parser.add_argument('-r','--roster', action="store_true",dest="roster",default=False,
                    help="Show roster of players known to the script and exit.")
parser.add_argument('file', type=argparse.FileType('r'), nargs='*',help="plain text files of Poker Mavens hand histories to process.")
args = parser.parse_args()

if (args.roster):
    if (args.doCsv):
        print("Poker Mavens Screen Name,Nickname,EMail")
    else:
        print("Roster of Players: " + str(len(resolvedScreenNames)))
        print("")
    for player in sorted(resolvedScreenNames.keys(), key=str.casefold):
        if (args.doCsv):
            text = (player + "," + resolvedScreenNames[player][NAME] + ",")
            if (EMAIL in resolvedScreenNames[player]):
                text = text + resolvedScreenNames[player][EMAIL]
        else:
            text = (player + " (" + resolvedScreenNames[player][NAME] + ")")
            if (EMAIL in resolvedScreenNames[player]):
                text = text + " - " + resolvedScreenNames[player][EMAIL]
        print (text)
    sys.exit(0)

emailPassword = ''
if(args.doEmail):
    if (args.password is None):
        emailPassword = getpass.getpass("Enter the password for the enail account (" + FROMADDRESS +"): ")
    else:
        emailPassword = args.password

lastHandTime = datetime.datetime.now()

numArg = len(args.file)
if (numArg == 0):
    print("Must provide a name of a log file to process.")
else:
    # process each file listed on the command line
    # first loop through is just to parse and get each hand separated, and get basic hand
    # info into the hands dictionary
    # basic hand info is hand number, local hand number, hand time, and table
    # everything else goes into TEXT
    for fh in args.file:
        f = open(fh.name, mode='r', encoding='utf-8')
        line = f.readline()
        while (len(line) != 0):
            matches = re.search("Hand #(\d*)-(\d*) - (.*)$",line)
            if (matches != None):
                handNumber = matches.group(1)
                handTime = datetime.datetime.strptime(matches.group(3),"%Y-%m-%d %H:%M:%S")
                hands[handNumber] = {LOCAL: matches.group(1),
                                   DATETIME: handTime,
                                   TEXT: ''}
                line = f.readline()
                while (not (line.strip() == '')):
                    table = re.search("Table: (.*)$",line)
                    if (table != None):
                        tableName = table.group(1)
                        if (not tableName in tables):
                            tables[tableName] = {COUNT: 0, LATEST: ""}
                        hands[handNumber][TABLE] = tableName
                    hands[handNumber][TEXT] = hands[handNumber][TEXT] + line
                    line = f.readline()
            else:
                line = f.readline()
        f.close()

    handNumber = ""
    handTime = datetime.datetime.now()

    # now that we have all hands from all the files,
    # use the timestamps of the imported hands to process them in chronological order
    # this is the place for processing the text of each hand and look for player actions
    for handNumber in sorted(hands.keys(), key=lambda hand: hands[hand][DATETIME] ):
        # print(handNumber) #DEBUG
        handTime = hands[handNumber][DATETIME]
        table = hands[handNumber][TABLE]
        tables[table][COUNT] += 1
        tables[table][LATEST] = handNumber
        tables[table][LAST] = handTime
        lastHandTime = handTime
        # print(handTime) # DEBUG

        for line in hands[handNumber][TEXT].splitlines():
            # the text match to look for a seated player and see their chip amount
            seat = re.search("Seat \d+: (\w+) \(([\d.]+)\)",line)
            if (seat != None):
                player = seat.group(1)
                stack = float(seat.group(2))

                if (isNewPlayer(check=player, table=table)):
                    players[player][IN] += stack
                    players[player][table][IN] = stack
                    players[player][table][FIRST] = stack
                    players[player][table][LATEST] = stack
                    players[player][NOTES] = players[player][NOTES] + (str(handTime) +
                                              " table " + table +
                                              " hand (" + handNumber + ") " +
                                              "initial buy in " + str(stack) + os.linesep)
                    csvRows.append([handTime,table,handNumber,player,"initial buy in",stack,""])
                else:
                    # check for consistent state of chips from last hand
                    # this is where we find corner cases and so on
                    # found split pot issue, side pot issue by virtue of having this consistency check
                    # NOTE - if player was waiting the stack may have changed,
                    #        so adjust accordingly and log it
                    if (players[player][table][LATEST] != stack):
                        if (players[player][table][WAITING] or players[player][table][LEFT]):
                            if (stack > players[player][table][LATEST]):
                                adjustment = stack - players[player][table][LATEST]
                                players[player][table][LATEST] = stack
                                players[player][table][IN] += adjustment
                                players[player][IN] += adjustment
                                action = "player returned with " if (players[player][table][LEFT]) else "while waiting added on by "
                                players[player][NOTES] = (players[player][NOTES] + str(handTime) + " table " + table +
                                                          " hand (" + handNumber + ") " + action + str(adjustment) + os.linesep)
                                csvRows.append([handTime,table,handNumber,player,"add on while waiting",adjustment,""])
                            else:
                                adjustment = players[player][table][LATEST] - stack
                                players[player][table][LATEST] = stack
                                players[player][table][OUT] += adjustment
                                players[player][OUT] += adjustment
                                players[player][NOTES] = (players[player][NOTES] + str(handTime) + " " + table + " hand (" + handNumber + ") " +
                                                          "while waiting reduced by " + str(adjustment) + os.linesep)
                                csvRows.append([handTime,table,handNumber,player,"reduction while waiting","",adjustment])
                        else:
                            print("Inconsistent state for " + player + " in table " + table + " hand " + handNumber + " has " + str(stack) +
                                  " expected " + str(players[player][table][LATEST]))
                            action = ''
                            adjustment = 0
                            if (stack > players[player][table][LATEST]):
                                adjustment = stack - players[player][table][LATEST]
                                players[player][table][LATEST] = stack
                                players[player][table][IN] += adjustment
                                players[player][IN] += adjustment
                                action = "adjusting for consistency - adding on "
                            else:
                                adjustment = players[player][table][LATEST] - stack
                                players[player][table][LATEST] = stack
                                players[player][table][OUT] += adjustment
                                players[player][OUT] += adjustment
                                action = "adjusting for consistency - deducting "

                            players[player][NOTES] = (players[player][NOTES] + str(handTime) + " table " + table +
                                                      " hand (" + handNumber + ") " + action + str(adjustment) + os.linesep)
                            csvRows.append([handTime,table,handNumber,player,action,adjustment,""])

                # player is active at this table, so mark the LEFT attribute for the tabe as False
                players[player][table][LEFT] = False

                # change state on sitting or waiting
                if (re.search(r'sitting',line) or re.search(r'waiting',line)):
                    players[player][table][WAITING] = True
                else:
                    players[player][table][WAITING] = False

            # the text to match for an add on
            addOn = re.search("(\w+) adds ([\d.]+) chip",line)
            if (addOn != None):
                player = addOn.group(1)
                additional = float(addOn.group(2))
                if (isNewPlayer(check=player,table=table)):
                    players[player][NOTES] = (players[player][NOTES] + str(handTime) + " table " + table +
                                              " hand (" + handNumber + ") " +
                                              "joined by add-on "  +os.linesep)
                players[player][IN] += additional
                players[player][table][IN] += additional
                players[player][table][LATEST] += additional
                players[player][NOTES] = (players[player][NOTES] + str(handTime) + " table " + table +  " hand (" + handNumber + ") " +
                                          "added on " + str(additional) + os.linesep)
                csvRows.append([handTime,table,handNumber,player,"add on",additional,""])


            # the text to check for a win
            winner = re.search("(\w+) (wins|splits).*Pot *\d? *\(([\d.]+)\)",line)
            if (winner != None):
                player = winner.group(1)
                win = float(winner.group(3))
                players[player][table][LATEST] += win

            # find contributions to the pot
            # this is a series of contributions of the form "PlayerName: Amount" separated by commas
            # needed for updating the LATEST amount on this table for each player, for consistency check next hand
            pot = re.search("Rake.*Pot.*Players \((.*)\)", line)
            if (pot != None):
                potString = pot.group(1)
                for contribution in potString.split(","):
                    (player,amount) = contribution.split(":")
                    player = player.strip()
                    players[player][table][LATEST] -= float(amount)

        # end of for loop, loop through active players and see if anyone has left the table -
        # if so, register a cash out and also mark the player as having LEFT the table
        for player in players.keys():
            seatSearch = r"Seat \d+: " + re.escape(player)
            if (not re.search(seatSearch, hands[handNumber][TEXT])):
                if (table in players[player] and not players[player][table][LEFT]):
                    amount = players[player][table][LATEST]
                    players[player][OUT] += amount
                    players[player][table][OUT] += amount
                    players[player][table][LATEST] = 0
                    players[player][table][WAITING] = True
                    players[player][NOTES] = (players[player][NOTES] + str(handTime) + " table " + table + " hand (" + handNumber + ") " +
                                          "stood up with " + str(amount) + os.linesep)
                    csvRows.append([handTime,table,handNumber,player,"stood up with","",amount])
                    players[player][table][LEFT] = True



# SUMMARIZE
# note how many unqiue players
# note how many hands processed for each table
# then for each table, and each player, find out who was still listed as not left and mark them
# as left and what they stood up with

print("Players: " + str(len(players)))
for table in tables:
    print("Table " + table + ": Processed hands: " + str(tables[table][COUNT]))

    for player in players.keys():
        # done processing the hands, so get players up from the table
        if (table in players[player] and not players[player][table][LEFT]):
            amount = players[player][table][LATEST]
            players[player][OUT] += amount
            players[player][table][OUT] += amount
            players[player][table][LATEST] = 0
            players[player][table][LEFT] = True
            players[player][NOTES] = (players[player][NOTES] + str(tables[table][LAST]) + " table " + table +
                                      " hand (" + tables[table][LATEST] + ") " +
                              "ended table with " + str(amount) + os.linesep)
            csvRows.append([tables[table][LAST],table,tables[table][LATEST],player,"ended table with","",amount])

netBalance = 0

# separator
print("")

if (lastHandTime is not None):
    sessionDate = lastHandTime.strftime("%m/%d/%Y")

note = 'Python calculation of Poker Mavens session'
for player in players.keys():
    # final tally
    cashIn = players[player][IN]
    cashOut = players[player][OUT]
    disposition=''
    diff = 0
    alias = player
    if (player in resolvedScreenNames):
        alias = resolvedScreenNames[player][NAME]
    players[player][NOTES] = (players[player][NOTES] + "Total IN " + str(cashIn) + os.linesep)
    players[player][NOTES] = (players[player][NOTES] + "Total OUT " + str(cashOut) + os.linesep)
    if (cashIn == cashOut):
        players[player][NOTES] = (players[player][NOTES] +  player + ' breaks even.' + os.linesep)
        disposition = "due"
    elif (cashIn > cashOut):
        diff = cashIn - cashOut
        netBalance += diff
        players[player][NOTES] = (players[player][NOTES] +  player + ' owes ' +str(diff) + os.linesep)
        disposition = "owes"
    elif (cashIn < cashOut):
        diff = cashOut - cashIn
        netBalance -= diff
        players[player][NOTES] = (players[player][NOTES] +  player + ' is due ' +str(diff) + os.linesep)
        disposition = "due"

    csvBalances.append([sessionDate,disposition,alias,diff,note])



    if(not args.quiet):
        print(players[player][NOTES])
        print("")

print("Net balance: " + str(netBalance))

if (args.doCsv):
    # Output CSV file of transactions
    with open(CSVTRANS, 'w', newline='') as csvfile:
        logwriter = csv.writer(csvfile, quoting=csv.QUOTE_MINIMAL)
        logwriter.writerow(csvHeader)
        for row in csvRows:
            logwriter.writerow(row)

        csvfile.close()
        print("CSV content written to " + CSVTRANS)

    # Output CSV file of balances
    with open(CSVBALANCE, 'w', newline='') as csvfile:
        logwriter = csv.writer(csvfile, quoting=csv.QUOTE_MINIMAL)
        logwriter.writerow(csvBalanceHeader)
        for row in csvBalances:
            logwriter.writerow(row)

        csvfile.close()
        print("CSV balance content written to " + CSVBALANCE)

if (args.doEmail):
    smtp = SMTP()

    smtp.set_debuglevel(DEBUGLEVEL)
    smtp.connect(SMTPSERVER, SMTPPORT)
    smtp.login(FROMADDRESS, emailPassword)
    #TODO: error handling for a failed login to SMTP server

    date = datetime.datetime.now().strftime("%a, %d %b %Y %T %z (%Z)")
    emailCount = 0

    for player in players:
        subj = EMAIL_SUBJ_PREFIX + sessionDate
        if (player in resolvedScreenNames and EMAIL in resolvedScreenNames[player]):
            emailCount += 1
            recipients = [CCADDRESS]
            to_addr = resolvedScreenNames[player][EMAIL]
            recipients.append(to_addr)

            subj = subj + " for " + player
            message_text = players[player][NOTES]

            msg = ("From: %s\nTo: %s\nCC: %s\nSubject: %s\nDate: %s\n\n%s"
                   % (FROMADDRESS, to_addr, CCADDRESS, subj, date, message_text))

            smtp.sendmail(FROMADDRESS, recipients, msg.encode("utf-8"))
    smtp.quit()
    print("Email messages sent: " + str(emailCount))

StevieG
 
Posts: 56
Joined: Mon May 04, 2020 12:27 pm

Re: Hand History Parser for obtaining Player Stats

Postby naked_eskimo » Thu May 14, 2020 9:01 am

Thanks for all your work on this, it is very much appreciated.

This script is a great tool for comparing against player balances after a session, but I also ran it against a month worth of hand history files at once to get a per player summary. That was extremely eye opening. Some of the win rates and some of the losses were way beyond what my meagre mental "rough idea" was. Not going to be sharing that with players unless they ask. It's great to be able to get that kind of summary with a simple script that runs in seconds.
naked_eskimo
 
Posts: 103
Joined: Wed Jan 07, 2015 3:51 pm

Re: Hand History Parser for obtaining Player Stats

Postby StevieG » Thu May 14, 2020 9:36 am

naked_eskimo wrote:Thanks for all your work on this, it is very much appreciated.

This script is a great tool for comparing against player balances after a session, but I also ran it against a month worth of hand history files at once to get a per player summary. That was extremely eye opening. Some of the win rates and some of the losses were way beyond what my meagre mental "rough idea" was. Not going to be sharing that with players unless they ask. It's great to be able to get that kind of summary with a simple script that runs in seconds.


Yeah, I imagine that will be the case.

As my co-manager likes to put it "don't kiss and tell".

By the way, I recognize that on Windows it is not easy to do a whole directory at a time. I will look into how Python might expand a wildcard and see if I cannot build that into the script.

Glad you are getting some use out of it though.
StevieG
 
Posts: 56
Joined: Mon May 04, 2020 12:27 pm

PreviousNext

Return to Wish List

Who is online

Users browsing this forum: No registered users and 1 guest

cron