Question

I need to parse a very large file and store the resulting entities in a database.
I am expecting up to 150k records per file and would liek to process those in batches.

Is there a way to perform batch insert of a Play entity with JPA?

Answer 1

To save memory you must make sure that the session is cleared regularly, so

Customer.em().getTransaction().begin(); 
for ( int i=1; i<=100000; i++ ) {
   ....
   myCustomer.save();
   if (i%1000==0) { 
       //Customer.em().getTransaction().commit();           
       Customer.em().flush(); 
       Customer.em().clear();
       //Customer.em().getTransaction().begin(); 
   }
}
Customer.em().getTransaction().commit();           

How ever you can improve your performance if you optimize the batch size
hibernate.jdbc.batch_size 100

You can simply add the last line to the application.conf, all hibernate.* properties go directly to hibernate. See the code of the JPAPlugin for details.