Home/ Questions/Q 7079895
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-28T06:43:40+00:00

I read that whenever the client needs to create a file in HDFS (The

  • 0

I read that whenever the client needs to create a file in HDFS (The Hadoop Distributed File System), client’s file must be of 64mb. Is that true? How can we load a file in HDFS which is less than 64 MB? Can we load a file which will be just for reference for processing other file and it has to be available to all datanodes?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I read that whenever the client needs to create a file in HDFS (The Hadoop Distributed File System), client’s file must be of 64mb.

    Could you provide the reference for the same? File of any size can be put into HDFS. The file is split into 64 MB (default) blocks and saved on different data nodes in the cluster.

    Can we load a file which will be just for reference for processing other file and it has to be available to all datanodes?

    It doesn’t matter if a block or file is on a particular data node or on all the data nodes. Data nodes can fetch data from each other as long as they are part of a cluster.

    Think of HDFS as a very big hard drive and write the code for reading/writing data from HDFS. Hadoop will take care of the internals like ‘reading from’ or ‘writing to’ multiple data nodes if required.

    Would suggest to read the following 1 2 3 on HDFS, especially the 2nd one which is a comic on HDFS.

    • 0