I have a large XML document (50G+) to process. Loading this to normal dom (saxon) require more than 160G. Not that much RAM or swap space.
Is there any library that provides h a disk based DOM tree? Any thing for Java?
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have a large XML document (50G+) to process. Loading this to normal dom (saxon) require more than 160G. Not that much RAM or swap space.
Is there any library that provides h a disk based DOM tree? Any thing for Java?
No, afaik all DOM implementations are memory bound.
You should use a streaming parser like StAX or Xpp3.