Question

My content contains multiple BOM (EF BB BF) characters and I want to remove them. The characters are in the middle of strings I want to simply remove them all.

The data containing the BOMS comes from a JavaScript source, which I POST to the backend. For now, they are saved as is, but this results in errors in post-processing when the characters are interpreted and start showing up mid-content. I suspect they come from something that was copypasted into my editor.

I can step through the string char by char, but I don’t know how to compare against the BOM. Would it somehow be possible to compare the hex values of the string bytes and compare three byte sequences?

Answer 1

The utf-8 BOM bytes get translated to \ufeff. Unicode character “Zero width no-break space”, can’t see them, can’t hear them. Filter them out with:

   var good = bad.Replace("\ufeff", "");