Automating Hadoop Cluster Using Ansible
🔰 Task Description📄
Configure Hadoop and start cluster services using Ansible Playbook
🔰 STEPS:
step 1. Copy java and Hadoop software
step 2. Install java and Hadoop software
step 3. create directory for namenode and datanode
step 4. Configure hdfs-site.xml and core-site.xml file
step 5. format namenode and start services for both the nodes
step 6. check the report
🔰 Practical:
- Setup the controller node with installed and configured ansible
Now, create inventory and write managed node ip , user name , password in it.
To, create ansible config file.
2. To check all the hosts
To check , managed nodes are ping or not.
3. As Now, we can see previously java and hadoop software are not installed in managed node.
4. Now, Create a playbook for NameNode.
To install java and hadoop software.
To create directory and configure hdfs-site.xml file
To configure core-site.xml file ,then format namenode and start services
Now, run the playbook .
5. Now, create a playbook for DataNode.
Now, to check the syntax of playbook
then run the playbook.
6. Now, to check .
Here , softwares are installed and services is also started in both Namenode and Datanode .
7. Now, to check the report of hadoop setup , use
hadoop dfsadmin -report