Example 1: Top 3 Occurrences: In this tutorial we will generate 400,000 lines of data that consists of Name,Country,JobTitle Then we have a scenario where we would like to find out the Top 3 Occurences from our
Ruan Bekker
A collection of 244 posts
Setup PIG on Hadoop YARN Cluster
This is part 4 of our Big Data Cluster Setup. From our Previous Post I was going through the steps on setting up Spark on your Hadoop Cluster. In this tutorial, we will setup Apache Pig, on top of the
AWS DynamoDB Access Control
2017.04.19 - Note: VPC Endpoints has been Released for DynamoDB At the moment of writing this post, AWS currently does not offer VPC Endpoints for DynamoDB. Having said that, you can look into fine graining your IAM policy
Getting Started with MySQL
Getting started with MySQL This will cover the basic usage of using MySQL. If you should be interested in setting up MySQL, please refer to MySQL Documentation #carbonads { font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen-Sans, Ubuntu, Cantarell, "Helvetica Neue", Helvetica,
Setup HTTP Load Balancer with HAProxy
When it comes to ensuring that we need our website needs to be online at all times, we need to start looking at High Availability. Today we will be demonstrating a basic setup of Layer 4 (transport layer) load balancing
Creating a BASH init startup script
Create a simple bash init script, and pass the arguments to stop or start a process. In this example we will use the init script to control tcpdump. Pre-Requisites: Create, and apply permissions. $ touch /etc/init.d/tcpmonitor $ chmod +x
MongoDB Setup Sharded Cluster
Our Environment: #HOSTNAME IP_ADDR mongo-router 192.168.1.120 mongo-config 192.168.1.121 mongo-shard-1 192.168.1.126 mongo-shard-2 192.168.1.127 mongo-shard-3 192.168.1.128 Install Packages: yum install epel-release -y yum install mongodb-org* Setup
Deployment with Ansible on CentOS
Ansible is awesome! Personally, I'm a big fan of Ansible. Where other deployment technologies works on a pull model, ansible pushes out deployments to the targets in question. In this Guide, I will show you how to setup Ansible and
Subscribe to Sysadmins
Subscribe today and get access to a private newsletter and new content every week!