Question

I have made code that stores utf-8 in a database.

It shows it well in the browser but looks distorted in the database. Since the functionality seems to work and it doesn’t look like I have had any problems with processing the string input, is it any point in ‘fixing what is not broken’ and make utf-8 characters like Japanese show in the database?

I don’t search the database since the strings are serialized anyway.

Answer 1

You have to specify the text encoding of the queries, you are sending to MySQL with for instance

SET NAMES `utf8` COLLATE `utf8_unicode_ci`

If you don’t, MySQL may interpret your query with the servers default text-encoding that can be different to UTF-8, e.g. iso-latin. So you will have strings in your tables, that are UTF-8 encoded, but MySQL marked them as iso-latin. That won’t have much effect on your code, because MySQL just returns your UTF-8 strings back to you and you ignore the text-encoding. If you view the data in phpMyAdmin or any other application, that sets the connections character encoding, you will end up with distorted strings.

You could on the other hand utf8_decode your query strings and utf8_encode the result’s provided by MySQL and don’t change the connections text encoding from iso-latin. but if you query a different MySQL server that uses UTF-8 as default text encoding, you will end up with the same problem the other way around. so just set the connection’s text encoding once after connecting.