Question

I sometimes import data from CSV files that were provided to me, into a mysql table.

In the last one I did, some of the entries has a weird bad character in front of the actual data, and it got imported in my database. Now I’m looking for a way to clean it up.

The bad data is in the mysql column ’email’, it seems to be always right in front of the actual data. When trying to print it on my screen using PHP, it shows up as �. When exporting it to a CSV file, it looks like  , and if I SET CHARACTER SET utf8 before printing it on the screen using PHP, it looks like a normal space ‘ ‘.

I was thinking of writing a PHP script that goes over all my rows one at a time, fix the email address field, and update the row. However I’m not quite sure about the “fix the email” part!

I was thinking maybe to do a “explode” and use the bad character as a delimiter, but I don’t know how to type that character into my code.

Is there maybe a way to find the underlying value/utf8/hex or whatever of that character, then find it in the string?

I hope it’s clear enough.

Thanks

EDIT:
In Hex, it looks like it’s A0. What can I do to search and delete a character by its hex value? Either in PHP or directly in MySQL I guess …

Answer 1

I think I found a PHP answer that seems to work more reliably:

$newemail = preg_replace('/\xA0/', '', $row['oldemail']);

And then I’m going to update the row with the new email