I am using this extension to perform export/import for the product database on our website. The site is pretty snappy–loads quickly, on a killer server, everything functions flawlessly except for the product import/export.
Everything worked fine up until the point where we had about 12,000 products in the catalog. Now, it appears that product import works fine. Problem is, exporting products is choking. Here’s what happens… click export, hangs for about 10-12 minutes (during which time the site goes down, unless I kill the process via CLI), then goes to a “page not found” error, the same link the admin export function was accessing.
Technical data & stuff I have tried or considered…
-
Import export code may be downloaded here. Opencart is based on MVC framework, so controller and model are obviously the important files to look at.
-
I have upgraded the original plugin to utilize the absolute latest version of PHPExcel and Pear library, with OLE and Spreadsheet extensions–both utilized by the import/export module.
-
PHP.ini settings are maxed out–allowing up to 8 gigs of RAM, post_max_size, max upload, and all other settings are pretty much maxed out. Server is running dual quad-core Xeons with a number of SAS hard drives, with an average processor usage around 3%. So, it’s not the server, and unless I’m missing something, it’s not the php settings that is the root of the problem here.
-
There are no errors being thrown in the error log that would indicate any specific problems in the code. Just the fact that it was working before, and now locks up while exporting products when more than 12k products are in the DB.
-
I have tried repairing the product tables, optimizing the database, and re-installing the base Opencart framework.
I realize this is a pretty general question here, but I’m at my wits end. I am not going to code a custom import/export module from scratch to nail this problem down. Simply hoping that someone might be able to shed some light (extension author has not been able to answer this issue). I’ve picked this thing apart from top to bottom and can’t find any reason why it wouldn’t be working the way it should.
The solution was simpler than I would have ever imagined.
Export tool that actually works for large product databases (and of course, exports to CSV).
Here is the link.