-
AFAIK, passwordless ssh is needed so that the master node can start the daemon processes on each slave node. Apart from that, is there any use of having passwordless ssh for Hadoop’s operation?
-
How are the user code jars and data chunks transferred across the slave nodes? I want to know the mechanism and the protocol used.
-
The passwordless SSH should ONLY be configured for master-slave pairs or even for amongst the slaves?
AFAIK, passwordless ssh is needed so that the master node can start the daemon
Share
You are correct. If ssh is not passwordless, you have to go on each individual machine and start all the processes there, manually.
For your second question, all the communication in HDFS happens over TCP/IP and for the data movement HTTP is used. Mechanism goes like this :
And for the third question, it’s not necessary to have a passwordless ssh among the slave nodes.