Home/ Questions/Q 4329944
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-21T09:53:34+00:00

How do I programmatically add tasks to hadoop and run in my Java application?

  • 0

How do I programmatically add tasks to hadoop and run in my Java application?
Any ideas? Thanks.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    In java this is quite easy:

    Configuration conf = new Configuration();
Job job = new Job(conf);
job.setJarByClass(YOUR_MAPPER.class);
job.setMapperClass(YOUR_MAPPER.class);
job.setReducerClass(YOUR_REDUCER.class);
job.setOutputKeyClass(YOUR_OUTPUT_KEY.class);
job.setOutputValueClass(YOUR_OUTPUT_VALUE.class);
FileInputFormat.addInputPath(job, new Path("YOUR_INPUT_PATH"));
FileOutputFormat.setOutputPath(job, new Path("YOUR_OUTPUT_PATH"));
System.exit(job.waitForCompletion(true) ? 0 : 1);

    If you need to submit it to a cluster you have to add these values to the configuration object:

    conf.set("fs.default.name", "hdfs://localhost:9000");
conf.set("mapred.job.tracker", "localhost:9001");

    You should replace the ports and hostname to the configured values in the cluster conf’s directory.

    • 0