Question

This has been killing me – I have a massive file that I need to read in as a DataTable.

After a lot of messing about I am using this:

using (OleDbConnection connection = new OleDbConnection(connString))
{
    using (OleDbCommand command = new OleDbCommand(sql, connection))
    {
        using (OleDbDataAdapter adapter = new OleDbDataAdapter(command))
        {
            dataTable = new DataTable();
            dataTable.Locale = CultureInfo.CurrentCulture;
            adapter.Fill(dataTable);
        }
    }
}

which works if the text file is comma seperated but does not work if it is tab delimited – Can anyone please help??

My connection string looks like :

string connString = @"Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" + pathOnly + @";Extended Properties='text;HDR=YES'";

I ve tried to set the FMT property with no luck….

Answer 1

Here is a good library use it.

http://www.codeproject.com/KB/database/CsvReader.aspx

Here is the code which use the library.

TextReader tr = new StreamReader(HttpContext.Current.Server.MapPath(Filename));
string data = tr.ReadToEnd();
tr.Close();

for comma delimited;

CachedCsvReader cr = new CachedCsvReader(new StringReader(csv), true);

for tab delimited;

CachedCsvReader cr = new CachedCsvReader(new StringReader(csv), true, '\t');

And here you can load it into DataTable by having this code

DataTable dt = new DataTable();
dt.Load(cr);

Hope you find it helpful. Thanks