Posts

Showing posts with the label Hadoop

How to configure Hadoop cluster using Ansible playbook

Image
  Automation is the new future of today's industry now most of the industry is heading towards automation as it reduces human efforts and errors which can be performed by humans also will be reduced. Nowadays companies have to configure a large number of servers daily and doing manually every server is not practically possible and time-consuming as well and today's era we don't have time to waste for this so we have to need some automation tool which performs all the task in every server in a single click and one of the automation tool is Ansible. First, let's talk about what is Hadoop Apa c he Hadoop is open-source software that provides us with the facility to build our own distributed storage cluster and computing cluster by Hdfs and Mapreducers programming methods. So what is the Hadoop cluster? Hadoop cluster is a very great program which allows us to join many storages of the data node and give as single storage to the client creating an illusion that the client h...

Adding Elasticity in Hadoop Datanode Using LVM

Image
  So what is Hadoop? Apache Hadoop is an open-source software used for maintaining the environment of distributed storage and computing cluster, as in real life we need storage in real used we need storage which is not possible to provide by a single storage device, so here Hadoop comes into play which combines all its slave node storage and creates an illusion so that client feels a lot of storage in a single device. Hadoop is mainly used for achieving greater computational at a reduced cost. So what is LVM? LVM is a tool for logical volume management that allows us to create dynamic storage units that can be resized as per our needs without worrying about the issues of data leakage. Everything is done by a single command. In this article, Firstly we would be creating a physical volume. Next, we would create the volume groups. Next, we will use the volume group as a storage device we will create a logical volume from it and format it as we do always with the partition. We would th...

Automation Using Python Menu-Driven Program

Image
  Automation is the key to the future, as in industry we don't want any delay in providing service to the client and the implementation of automation technologies, techniques and processes improve the efficiency, reliability of many tasks that were previously performed by humans manually. Today almost all the organization are using automation in their system and keeps on increasing on daily basis both in the software/hardware and machine layer. In this article, we will see how automation reduces human effort and how the menu-driven program functions.