Today I would like to have a dive into Job Performance with Hadoop, running on the Managed Hadoop Framework of Amazon Web Services, which is Elastic MapReduce (EMR). Hadoop does not deal well with lots of small files, and I…
Hadoop
A collection of 4 posts
Bash Script setup a 3 Node Hadoop Cluster on LXC Containers
Just a quick post on setting up a 3 Node Hadoop Cluster on LXC Containers Instructions: Once the setup has completed, and you ssh to the master node, it will format hdfs and start the daemons, this section was configured…
AWS: Create EMR Cluster with Java SDK Examples
Today, providing some basic examples on creating a EMR Cluster and adding steps to the cluster with the AWS Java SDK. This tutorial will show how to create an EMR Cluster in eu-west-1 with 1x m3.xlarge Master Node and…
Setup Hadoop 2.7 MultiNode Cluster on Ubuntu
We will setup a 4 Node Hadoop Cluster using Hadoop 2.7.1 and Ubuntu 14.04. Our cluster will consist of: Ubuntu 14.04 Hadoop 2.7.1 HDFS 1 Master Node 3 Slave Nodes After we have setup…