Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I need to parse large XML Feeds (>100 mb) and persist into mysql database. XML files are well formatted and contain many child elements. I was thinking to use Java + XMLbeans and SAX to process the XML feeds and persist.
Please suggest me right approach to handle this case. I am worried about performance.
thanks in advance.
XML to class object mapping is definitely the most easy to maintain and one of the sensible way to handle parse+persist problems. I’ll suggest to check other solutions for XML mapping. Jibx comes to mind if you are looking for good performance. Please go through: this article before deciding. [WARNING : The article is ancient (2003) and may not reflect today’s versions of the frameworks. Although you can use similar comparison to try out various options.]
XML Pull parsing is also a good (but obscure) option for very large XML files. (IMO 100MB is not that big.) Try to look at XPP and XML Pull Parsing. But this takes care of parsing only. However you can easily implement your own persist code over the pull parser. Maintaining such code is another story though.