Home/ Questions/Q 203349
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-11T17:22:15+00:00

First, some disclosure: I am not a Linux admin, and my Linux admin is

  • 0

First, some disclosure: I am not a Linux admin, and my Linux admin is not a programmer.

That said, we have a cronjob that runs a mysqlimport command to import a text file that’s generated daily. I have no control or involvement in how this file is created. Through trial and error, we discovered that the text file is generated on a Windows machine, so for the lines-terminated-by argument we had to specify \r\n. Last week it stopped working correctly, and we determined it was because the file was now being generated in Linux, so we changed it to just \n. My understanding (which isn’t entirely clear) is that it depends on who generates the text file that determines what platform and encoding is used.

We have a shell script that’s executing the mysqlimport command. When we provide the correct encoding, everything works perfectly. But since we don’t know who’s going to create the text file in the first place, is there a way to determine what the encoding is and implement the proper line-break character(s)? (And is “encoding” the proper term here?)

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I think you can use dos2unix or unix2dos commands on linux to convert between ‘Windows’ and Linux encoding. So you don’t have to detect what encoding is used, just run the command to make sure the file has correct encoding.

    It depends on the version of the utility but generally the command would be executed like this:

    dos2unix input.txt output.txt
dos2unix input.txt > output.txt
    • 0