Question

I have a requirement to read an Excel file with its headers and data and create a table in a Database (MySQL) on the basis of header and put value which is extracted from file. For that I am using JDBC for creating and inserting data (used prepared statement) in DB Table.

It works nicely but when the number of records are increased -suppose file contains 200000 or more records- it’s going to be slow. Please guide me how I am able to optimize the processing speed of inserting data into an DB Table.

Thanks, Sameek

Answer 1

To optimize it you should first use the same PreparedStatement object in all of the inserts.

To further optimize the code you can send batches of updates.

e.g. batches of 5:

//create table
PreparedStatement ps = conn.prepareStatement(sql);
for(int i =0; i < rows.length; ++i) {
  if(i != 0 && i%5 == 0) {
    pstmt.executeBatch();
  }
  pstmt.setString(1, rows[i].getName());
  pstmt.setLong(2, rows[i].getId());
  pstmt.addBatch();
}
pstmt.executeBatch();