We will see how to use the concept of LVM (Logical Volume Management) with Hadoop cluster to provide elasticity to the storage shared by datanode.
knowledge of creating basic Hadoop cluster is required.
What we want to achieve,
◾ Integrating LVM with Hadoop and providing Elasticity to DataNode Storage.
We are performing this task on virtual machine in RHEL8 operating system.
I attached a disk of size 8 GiB (/dev/sdb here)
We are creating two primary partitions in the attached disk each of size 3 GiB, to enter the disk use fdisk command
when creating new partition it by default selects primary type, and type +3G in last sector for creating partition of 3…
We will be creating a small architecture using the CloudFront service of AWS that provides facility of CDN ( Content Delivery Network ) which helps in providing static data with high security and low latency across the globe.
The architecture includes-
🔹 Web server configured on EC2 Instance.
🔹 Document Root(/var/www/html) made persistent by mounting on EBS Block Device.
🔹 Static objects used in code such as pictures stored in S3.
🔹 Setting up Content Delivery Network using CloudFront and using the origin domain as S3 bucket.
🔹 Finally place the Cloud Front URL on the webapp code for security and low latency. …
AWS provide lots of products or services and for using those services multiple ways are available for us, we can use the GUI console of AWS (Web App) or we can write some automation codes to create our infrastructure. At starting, we always like and are comfortable with GUI as it easy to use but it will not provide us all the options available to satisfy some customized requirements. So, here we are going to use command line interface (CLI) to connect with AWS and use its services.
First of all we should have the AWS CLI software which is very simple to install. …
AWS is at the top in providing cloud computing services for businesses across the globe. Back in the 2000s, businesses were completely dependent on purchased servers, and those servers had limited functionality and steep prices. Plus, a functioning server required countless validations. The more growth businesses experienced, the more servers and optimization practices they needed. Acquiring those items proved inefficient, and sometimes, prohibitively expensive.
The advantages of AWS have solved many of those problems. Companies using AWS have servers available instantly, and AWS provides various workloads, increased storage options, and enhanced security measures. AWS provide more that 175 products on a pay-as-you-go basis. This means that you pay only for the services you use. And it works on a relative scale. That means the less you use it, the less you pay. …
We are going to deploy a WordPress application on top of Kubernetes cluster using Kubernetes service of Google Cloud Platform (GCP) along with Load Balancer and for database, we will be creating a MySQL db instance using RDS of Amazon Web Services (AWS). All of these using Terraform.
So, these are the steps -
Every resource on GCP needs to be created inside a project, so first we should have a project. We can create or delete projects using the cloud shell as shown in the image. ( the project should be connected with billing account and also required APIs should be…