I have a huge Perl script (1500+ lines) that takes about 8 hours to run.
It generates SQL from HTML that is then imported into a website. Basically it’s reverse-engineering a whole forum into a new one (I have permission).
The script runs from the beginning each time parsing HTML that hasn’t changed in ages, it’s then stored in memory as arrays of hashes until all HTML has been parsed, the the SQL is generated.
I’d like it to pre-load the result from last time into memory and then only process the changes, but how can this be done?
Storable?