Hello, I'm trying to do something very basic, though the fact that the text file I'm using is around 152mb in size makes it a bit harder.
I'm trying to parse out HTML tags from the file. My Regex matching function tells me there are around 1100 HTML tags to take out (which isn't that many considering how big the file is), and the parsing function itself is multithreaded, though the program still freezes. I've even tried to compile it under x64, with no luck.
So, how can I effectively parse huge files like that without having my program freeze and not work? The problem is not with my threading or my parsing, it's with the size of the file.
I'm trying to parse out HTML tags from the file. My Regex matching function tells me there are around 1100 HTML tags to take out (which isn't that many considering how big the file is), and the parsing function itself is multithreaded, though the program still freezes. I've even tried to compile it under x64, with no luck.
So, how can I effectively parse huge files like that without having my program freeze and not work? The problem is not with my threading or my parsing, it's with the size of the file.