I have a 15 GB XML file which I would want to split it .It has approximately 300 Million lines in it . It doesn’t have any top nodes which are interdependent .Is there any tool available which readily does this for me ?
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have a 15 GB XML file which I would want to split it .It has approximately 300 Million lines in it . It doesn’t have any top nodes which are interdependent .Is there any tool available which readily does this for me ?
I think you’ll have to split manually unless you are interested in doing it programmatically. Here’s a sample that does that, though it doesn’t mention the max size of handled XML files. When doing it manually, the first problem that arises is how to open the file itself.
I would recommend a very simple text editor – something like Vim. When handling such large files, it is always useful to turn off all forms of syntax highlighting and/or folding.
Other options worth considering:
EditPadPro – I’ve never tried it with anything this size, but if it’s anything like other JGSoft products, it should work like a breeze. Remember to turn off syntax highlighting.
VEdit – I’ve used this with files of 1GB in size, works as if it were nothing at all.
EmEditor