Question

I am creating a simple comparison script and I have some questions for the database structure. Firstly the database will be huge, I am expecting more than 1 million entries in products.
Secondly, there will be a search form that the search term will look into (%$term%) the field name and display the product’s related info and shop’s info.

Below you can see my database structure named products.

id int(10) NOT NULL
name varchar(50) NOT NULL
link varchar(50) NOT NULL
description varchar(50) NOT NULL
image varchar(50) NOT NULL
price varchar(50) NOT NULL

My questions are:

1. Do you suggest me to index a field? Users will not be able to insert or update products, the only query will be SELECT to display the results and I will update the products from XML feeds often for possible products changes.

2. I have to store the shop info like name, shipping, link, image… This gives me two option. a) To create a new table named shops and join those two tables with a new field in products shopID that will look for the id in shops and display the info or b) Should I add these info (name, shipping, …) in extra fields in products in every single product ? (I think the answer is obvious but I need your suggestion).

3. Are there any other things I should have in mind, or change?

I am not an advanced programmer and what I learn is through internet, so maybe the questions are too obvious for you, but for me is the ticket for learning.

Thank you for your answers.

Answer 1

1. Indexes are required to fetch records very fast. So yes, they’re recommended. But what kind of an index would you like to use? MyISAM engine offers “regular” string index that you can use with a LIKE clause (e.g. LIKE 'hello%') but it restricts you from using a wildcard at the beginning of the search phrase. In addition, MyISAM has a FULLTEXT index that allows you to search words in the whole string, not just the beginning of the string. So you could create a FULLTEXT index on the columns description and name – but 2 FULLTEXT indexes seem redundant in this case. Maybe you could join those columns and separate the values with a token or a character? If so, you’ll need to create only 1 FULLTEXT index on the joined column, which can save a lot fragmentation and disk space. One of the cons for using MyISAM engine is that when writing to it (UPDATE/DELETE queries) – it locks the entire table. So, if the table is written to many times a minute, it will probably make other queries hang. That’s why you should see if InnoDB engine suits your needs – which enables concurrent read/write operations on the table.
2. That’s probably a good idea, since having index on the column price seems essential, and FULLTEXT indexes doesn’t work together with other indexes.
3. I’d say: Use InnoDB and Sphinx, and have a primary index on id & a regular index on price.

The most important thing for you to understand is that when writing a code for specific software, you must be well familiar with that software and it’s caveats. You should read High performance MySQL – extremely recommended.

---

Edit:
If you want to add an indexes in the products table, you can do that with
ALTER TABLE /* etc */ when the table is empty or contains small amount of data. If the table has a lot of data, then it’s recommended to create another table that’s similar to products, altering that new table and populating it with data from the old products table, e.g.:

CREATE TABLE `products_new` LIKE `products`;
ALTER TABLE `products_new` ADD FULLTEXT (`name`);
LOCK TABLES `products` READ, `products_new` WRITE;
INSERT INTO `products_new` SELECT * FROM `products`;
LOCK TABLES `products` WRITE, `products_new` WRITE;
ALTER TABLE `products` RENAME TO `products_bad`;
ALTER TABLE `products_new` RENAME TO `products`;
/* The following doesn't work:
      RENAME TABLE `products` TO `products_bad`, `products_new` TO `products`;
   See: http://bugs.mysql.com/bug.php?id=22246
*/
DROP TABLE `products_bad`;