Question

I have a table with ~1.2m rows in it. It has 6 columns indexed, including one varchar(255) field that contains urls.

I need to be able to scan the table to see whether a url exists in the table, hence the index, but I’m wondering whether I would see a performance gain by reducing the index size to around 50?

Of course this would mean that it may have to scan more rows when searching for a url in the database.. but I only have to do this query about once every 30 seconds, so I’m wondering if the smaller index size would be worth it. Thoughts?

Answer 1

Two reasons why lowering maybe better – (Assuming your index is useful)

1) Indexes too get loaded in memory, so there maybe a rare possibility that your index size grows to an extent that it is not completely cacheable in memory. Thats when you will see a performance hit (with all the new hardware specs… hardly a possibility with 1.2M rows, but still worth noting).

2) Manytimes, just the first ‘n’ characters are good enough to be able to quickly identify each record. You may not need to index the whole 255 characters at all.

Two reason why you may not care –

1) As stated, you may never see your indexes growing to be out of your key buffer, so why worry.

2) You will need to determine the first ‘n’ characters, and even after that the performance will less than or equal to a full index… never more. Do you really need to spend time on that? Is it worth the possible loss of accuracy?