Home/ Questions/Q 6132473
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-23T17:06:24+00:00

I have about 28 million records to import into a mySql database. The record

  • 0

I have about 28 million records to import into a mySql database. The record contains personal information about members in the US and will be searchable by states.

My question is, is it more efficient to break up the table into smaller tables as opposed to keeping everything in one big table? What I had in mind was to split them up into 50 seperate tables representing the 50 states something like this: members_CA, members_AZ, members_TX, etc;

This way I could do a query like this:

'SELECT * FROM members_' . $_POST['state'] . ' WHERE members_name LIKE "John Doe" ';

This way I only have to deal with data for a given state at once. Intuitively it makes a lot of sense but I would be curious to hear other opinions.

Thanks in advance.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I posted as a comment initially but I’ll post as an answer now.

    Never, ever think of creating X tables based on a difference in attribute. That’s not how things are done.

    If your table will have 28 million rows, think of partitioning to split it into smaller logical sets.

    You can read about partitioning at MySQL documentation.

    The other thing is choosing the right db design and choosing your indexes properly.

    The third thing would be that you avoid terrible idea of using $_POST directly in your query, as you probably wouldn’t want someone to inject SQL and drop your database, tables or what not.

    The final thing is choosing appropriate hardware for the task, you don’t want such an app running on VPS with 500 mb of ram or 1 gig of ram.

    • 0