Home/ Questions/Q 649725
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-13T21:58:31+00:00

Is there a input class to deal with [multiple] large XML files based on

  • 0

Is there a input class to deal with [multiple] large XML files based on their tree structure in Hadoop? I have a set of XML files that are of the same schema, but I need to split them into sections of data, as opposed to breaking the sections up.

For example the XML file would be:

<root>
  <parent> data </parent>
  <parent> more data</parent>
  <parent> even more data</parent>
</root>

I would define each section as:
/root/parent.

What I’m asking is: Is there a record input reader already included for Hadoop to do this?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I think the Cloud9 project at UMD might help you with this.

    The library provides has an XMLInputFormat class which might be of use.

    Also of interest is this page in the Cloud9 documentation which looks at how you can deal with an XML dump of Wikipedia in MapReduce.

    • 0