We will see how to use the concept of LVM (Logical Volume Management) with Hadoop cluster to provide elasticity to the storage shared by datanode.

Image for post
Image for post

knowledge of creating basic Hadoop cluster is required.

What we want to achieve,

◾ Integrating LVM with Hadoop and providing Elasticity to DataNode Storage.

We are performing this task on virtual machine in RHEL8 operating system.

I attached a disk of size 8 GiB (/dev/sdb here)

Image for post
Image for post

We are creating two primary partitions in the attached disk each of size 3 GiB, to enter the disk use fdisk command

fdisk /dev/sdb

when creating new partition it by default selects primary type, and type +3G in last sector for creating partition of 3…


Vikas Verma

Tech and Programming, MLOps, DevOps Assembly Lines, Hybrid Multi Cloud, Flutter and Ansible Automation

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store