Home/ Questions/Q 3675454
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-19T02:58:42+00:00

I have a fairly large csv file (at least for the web) that I

  • 0

I have a fairly large csv file (at least for the web) that I don’t have control of. It has about 100k rows in it, and will only grow larger.

I’m using the Drupal Module Feeds to create nodes based on this data, and their parser batches the parsing in groups of 50 lines. However, their parser doesn’t handle quotation marks properly, and fails to parse about 60% of the csv file. fgetcsv works but doesn’t batch things as far as I can tell.

While trying to read the entire file with fgetcsv, PHP eventually runs out of memory. Therefore I would like to be able to break things up into smaller chunks. Is this possible?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    fgetcsv() works by reading one line at a time from a given file pointer. If PHP is running out of memory, perhaps you are trying to parse the whole file at once, putting it all into a giant array. The solution would be to process it line by line without storing it in a big array.

    To answer the batching question more directly, read n lines from the file, then use ftell() to find the location in the file where you ended. Make a note of this point, and then you can return to it at some point in the future by calling fseek() before fgetcsv().

    • 0