I have an excel sheet which has about 150,000 records, operations like find replace, delete columns etc are taking a lot of time. I need to write a script to perform some tasks like find and replace, sort, delete rows/columns etc. Because the excel sheet is too big, tasks like these take lots of time. What format should I convert my excel sheet so that processing time for such tasks becomes shorter, and so that I could create a script to perform the tasks>
I have an excel sheet which has about 150,000 records, operations like find replace,
Share
You could always load it into a SQLite database. If you’re doing lots of find-replacing that’d be pretty quick. It’s difficult to give a more useful answer without knowing a bit more about your data though, and how often you’ll need to do things with it in Excel.
You could write a bit of Python to get the data out of Excel and into SQLite (and back again) using pyExcelerator and the sqlite3 module.