Blog Archives

Import MySQL data to HDFS through Sqoop

Create Database in MySQL [Database: adil] Create Table in MySQL Database [Table: employees] Insert some data Now try to import data from MySQL by using below command sqoop import –connect jdbc:mysql://192.168.1.7:3306/adil –username admin –password *********** –table employees -m 1 Successful

Posted in Big Data, Hadoop

How to Install Sqoop

Download latest Sqoop connector (ZIP file) from Apache site and Extract Now connect through FTP Create folder “sqoop” under “use/lib” and copy jar files to lib folder of Now move to sqoop folder Copy all files to sqoop folder

Posted in Big Data, Hadoop

Hadoop: How many people belong to each state, using Hue (Hive, PIG and Impala)

Login to Hue site Upload sample file to HDFS using File Browser Create folder using New à Directory option. I created “people” folder Now upload sample file to HDFS by using upload option. Select File File is uploaded to HDFS

Posted in Big Data, Hadoop

Hadoop: How many people belong to each state, using PIG?

Follow my previous article to move sample data file to HDFS http://wp.me/p2oyUE-IW Start pig Grunt Execute blow Statement

Posted in Big Data, Hadoop, SharePoint 2010

How to Install Eclipsec

Download Eclipsec IDE for JAVA from http://www.eclipse.org/downloads/ depend on your requirement. In my case I downloaded windows 64Bit “Eclipsec IDE for JAVA Developers” Extract the downloaded package and put it under “D:\EclipseForJava” Double click on “eclipsec” application to open the

Posted in Big Data, Hadoop, SharePoint 2010

Hadoop: How many people belong to each state, using HIVE?

Prepare sample file Move sample file to Hadoop server Create the users directory on HDFS by using the following command Directory created on HDFS Now move local file to HDFS directory by using below command hadoop fs -copyFromLocal ‘/home/cloudera/Adil/Hive/People.txt’ ‘/user/cloudera/People/’

Posted in Big Data, Hadoop, SharePoint 2010