Elastic Storage Hadoop Cluster using LVM

Automating LVM on Hadoop Clusters

What are PVs , VGs and LVs ????

Initial Hadoop Cluster

pvcreate /dev/xvdf /dev/xvdg

vgcreate lvm-test /dev/xvdf /dev/xvdg

lvcreate -n lvm-part-1 — size 6G lvm-test

mkfs.ext4 /dev/lvm-test/lvm-part-1

Datanode contribution to cluster
Updated storage contribution to cluster
  1. Creating volume groups from the physical volumes
  2. Creating Logical volumes from the Volume Groups
  3. Extending the attached LV’s storage
Executing python script to automate
Finally updated cluster




Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

The Futures Abstraction

Builder Design Pattern in Software Development

Builder Designer Pattern UML Class Diagram

What is Dependency Inversion Principle (DIP)?

Python lists shallow and deep copy.

This is what Google uses for Software Development

[Mobile] iOS v2.8.6 update : Support of Thai language, etc

Explain about Oracle Database Data Block ? | Interview A

Should Linux Mint Come To An End?

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Yashwanth Medisetti

Yashwanth Medisetti

More from Medium

What is Apache Spark? A Beginners Guide

Apache Druid — Druid SQL in Java

PySpark UDF (User Defined Function)