Home/ Questions/Q 6095451
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T12:48:48+00:00

I have a django site running with a mysql database backend. I accept fairly

  • 0

I have a django site running with a mysql database backend. I accept fairly large uploads from one of the admin users to bulk import some data. The data comes in a format that is slightly different than the form it needs to be in the database so I need to do a little parsing.

I’d like to be able to pivot this data into csv and write it into a cStringIO object then simply use mysql’s bulk import command to load that file. I’d prefer to skip writing the file to the disk first, but I can’t seem to find a way around it. I’ve done basically this exact thing with postgresql in the past, but unfortunately this project is on mysql.

The short: Can I take an in memory file like object and somehow use mysql bulk import operation

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    If by “bulk import” you mean LOAD DATA [LOCAL] INFILE then, no, there’s no way around first writing the data to some file, damn it all. You (and I) would really like to write the table directly from an array.

    But some OSs, like Linux, allow a RAM-resident filesystem that eases some of the hurt. I’m not enough of a sysadmin to know how to set up one of these guys; I had to get my ISP’s tech support to do it for me. I found an article that might have useful info.

    HTH

    • 0