2.1 Apache Hadoop Installation on all Nodesĭownload Apache Hadoop latest version using wget command. In this section, you will download Apache Hadoop and install on all nodes in a cluster (1 name node and 3 data nodes). Post JDK install, check if it installed successfully by running java -version 2 Download and Install Apache Hadoop Sudo apt-get -y install openjdk-8-jdk-headless If you wanted to to use other JDK please do so according to your need. ssh/authorized_keys datanode3:/home/ubuntu/.ssh/authorized_keysĪpache hadoop build on Java hence it need Java to run. ssh/authorized_keys datanode2:/home/ubuntu/.ssh/authorized_keys ssh/authorized_keys datanode1:/home/ubuntu/.ssh/authorized_keys This enables name node to connect to data nodes password less (without prompting for password) Now copy authorized_keys to all data nodes in a cluster. By using > it appends the contents of the id_rsa.pub file to authorized_keysĬat. rw- 1 ubuntu ubuntu 1679 Dec 9 00:17 id_rsaĬopy id_rsa.pub to authorized_keys under ~/.ssh folder. rw-r-r- 1 ubuntu ubuntu 397 Dec 9 00:17 id_rsa.pub hence let’s generate key-pair using ssh-keygen The name node will use an ssh-connection to connect to other nodes in a cluster with key-pair authentication, to manage the cluster. 1.3 Setup Passwordless login Between Name Node and all Data Nodes.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |