Home/ Questions/Q 3937032
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-20T00:01:16+00:00

Well, I have been working with large amount of network data. In which I

  • 0

Well, I have been working with large amount of network data. In which I have to filter out some IP address and store their communication with other IP’s. But the number of IP’s are huge, hundreds of thousands, for which I have to create so many tables. Ultimately I my MySQL access will slow down, everything will slow down. Each table will have few columns, many rows.

My Questions:
Is there a better way to deal with this, I mean storing data of each IP?
Is there something like table of tables?

[Edit]
The reason I am storing in different tables is, I have to keep removing and add entries as time passes by.
Here is the table structure

CREATE TABLE IP(syn_time datetime, source_ip varchar(18), dest_ip varchar(18));

I use C++ to access with ODBC connector

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    • Don’t DROP/CREATE tables frequently. MySQL is very buggy with doing that, and understandably so–it should only be done once when the database is created on a new machine. It will hurt things like your buffer pool hit ratio, and disk IO will spike out.

    • Instead, use InnoDB or xtradb, which means you can delete old rows whilst inserting new ones.

    • Store the IP in a column of type int(10) unsigned e.g. 192.168.10.50 would be stored as (192 * 2^24) + (168 * 2^16) + (10 * 2^8) + 50 = 3232238130

    • Put all the information into 1 table, and just use an SELECT ... WHERE on an indexed column

    • 0