Question

How can I open file inside native application when I execute it using hadoop streaming?

For example I have code which looks like below:

int main(int argc, char** argv){
   FILE* fp = fopen(argv[1], "a+");
   ...
   fscanf(fp, "%d", val);
   ...
   fclose(fp);
}

If it is nt possible can you suggest any other way to do it or recommendations related to it.

If possible are there any docs for this topic. How to not program for hadoop-streaming.

Sorry for my English.

Thanks

Answer 1

How can I open file inside native application when I execute it using Hadoop streaming?

HDFS provides a REST API through WebHDFS and HttpFS for various operations. The REST API can be pragmatically accessed from all the languages. Also note that these languages also have libraries to program against REST API easily.