Posts

Showing posts with the label hadoop

Integration of LVM with Hadoop

Image
In this blog, we are going to do two things: 🔅 Integrating LVM with Hadoop and providing Elasticity to DataNode Storage 🔅Increase or Decrease the Size of Static Partition in Linux. LVM (Logical Volume Manager) Logical volume management (LVM) is a form of storage virtualization  that offers system administrators a more flexible approach to managing disk storage space than traditional partitioning. This type of   virtualization  tool is located within the device driver  stack on the operating system. It works by chunking the physical volumes (PVs) into physical extents (PEs). The PEs are mapped onto logical extents (LEs) which are then pooled into volume groups (VGs). These groups are linked together into logical volumes (LVs) that act as virtual disk partitions  and that can be managed as such by using LVM. LVM is an amazing technique using which you can  increase the storage of device on the fly , without loosing data, without shutting down the syste...

Automation Using Python

Image
  Welcome to my menu program This program contains fully automated technologies that can be run directly in any flavor of linux operating system This menu program contains some great technologies like : 1. Amazon Web Services (AWS) 2. Big Data Hadoop 3. LVM partition technique 4. Web Server 5. Yum  6. Docker This menu-driven program is built in python that can be useful in automation of above mentioned technologies. 1. Amazon Web Services (AWS) Using this menu program, you can do following things : - AWS key pairs      - Describe key pair     - create key pair     - Delete key pair - EC2 instance     - Create Instance     - Describe Instance     - Start Instance     - Stop Instance     - Reboot Instance     - Terminate Instance - Create AWS security group - EBS volume     - Create EBS volume     - Attach EBS volume     - Detach EBS volume     ...