Split Big HH Files

Let us know what features not currently in the PT4 should be added.

Moderators: WhiteRider, kraada, Flag_Hippo, morny, Moderators

Split Big HH Files

Postby ranka » Tue Jul 23, 2013 2:12 pm

Hey!

Yday got my lifetime hands from PokerStars. Most of these files are larger than 20MB, and some of them larger than 100MB (up to 180MB). PT4 cant handle so large files, so please fix your importer, or add automatic File Splitter.

Thanks
ranka
 
Posts: 50
Joined: Fri Jan 25, 2008 2:19 am

Re: Split Big HH Files

Postby kraada » Tue Jul 23, 2013 2:46 pm

I was not aware that PokerStars created and sent files of that magnitude. I'll mention this to a developer the next chance I get. In the meantime, try something like Notepad++ and it may handle the file well enough for you to open it, and cut it into two pieces.
kraada
Moderator
 
Posts: 54430
Joined: Wed Mar 05, 2008 2:32 am
Location: NY

Re: Split Big HH Files

Postby ranka » Tue Jul 23, 2013 5:26 pm

kraada wrote:I was not aware that PokerStars created and sent files of that magnitude. I'll mention this to a developer the next chance I get. In the meantime, try something like Notepad++ and it may handle the file well enough for you to open it, and cut it into two pieces.


Hey!

Yes, I already found a solution , but there are lots of guys who are not so experienced in internet/software things. E.g today I tried to import these hands. After 7h later, it was only 60K hands imported, 3h/s.

I breaked these files into smaller files (~100 hands per file), and after 3 hours 822K hands imported (total 950K, 822K imported, 130K dublicates), which is avg 85h/s and all of my hands will be imported in 5h19 minutes. Which is quite good results because I have played lifetime couple of million hands.

Just add similar feature for PT4. If PT founds a large file, then it automatically break into smaller files or ask: Large file found, do you want to break it smaller pieces to speed up import process? Its recommended to do, and no hands will be lost. blabala

But thanks for answer.
ranka
 
Posts: 50
Joined: Fri Jan 25, 2008 2:19 am

Re: Split Big HH Files

Postby kraada » Tue Jul 23, 2013 5:33 pm

Just in case anybody else finds this thread: we found in our testing the sweet spot varies by computer and is often more in the 1000-5000 hand range. Either way I'm glad you got everything working properly :)
kraada
Moderator
 
Posts: 54430
Joined: Wed Mar 05, 2008 2:32 am
Location: NY

Re: Split Big HH Files

Postby pt4pt4pt4 » Wed Jul 24, 2013 11:36 pm

kraada wrote:Just in case anybody else finds this thread: we found in our testing the sweet spot varies by computer and is often more in the 1000-5000 hand range. Either way I'm glad you got everything working properly :)


1000-5000 hand range

What do you mean?
pt4pt4pt4
 
Posts: 1097
Joined: Fri Feb 03, 2012 12:17 am

Re: Split Big HH Files

Postby kraada » Thu Jul 25, 2013 8:18 am

If you break the files into somewhere between 1000 hands per file and 5000 hands per file it works better than smaller or larger numbers. That's why the default export size is 1000 h/file.
kraada
Moderator
 
Posts: 54430
Joined: Wed Mar 05, 2008 2:32 am
Location: NY


Return to PT4 Feature Requests

Who is online

Users browsing this forum: No registered users and 0 guests