Blog Archives

HIVE: Create table with data from 2 different tables

Scenario: In Cloudera default data base 2 table exist with sample data. Now to populate another table in different database after combining data from 2 tables Solution: Use below statements to see the tables under default database. Now we have

Posted in Big Data, HIVE

Import MySQL data to HDFS through Sqoop

Create Database in MySQL [Database: adil] Create Table in MySQL Database [Table: employees] Insert some data Now try to import data from MySQL by using below command sqoop import –connect jdbc:mysql://192.168.1.7:3306/adil –username admin –password *********** –table employees -m 1 Successful

Posted in Big Data, Hadoop

How to Install Sqoop

Download latest Sqoop connector (ZIP file) from Apache site and Extract Now connect through FTP Create folder “sqoop” under “use/lib” and copy jar files to lib folder of Now move to sqoop folder Copy all files to sqoop folder

Posted in Big Data, Hadoop

Installation and Configuration of JetBrains IDE’s for mongoDB

Download JetBrains IDE https://d1opms6zj7jotq.cloudfront.net/idea/ideaIC-15.0.3.exe Run EXE and Install Setup Run “IntelliJ IDEA Community Edition 15.0.3” Make sure “Mongo Plugin” install correctly. If not search and Install. Now Define the path of mongo executable and test. Now add Mongo Server and

Posted in Big Data, MongoDB

Install MongoDB on Windows 7 64bit

Download MongoDB https://www.mongodb.org/downloads?_ga=1.148407991.1803173613.1455436913#production Note: For Windows 7 64bit install Hot Fix from Microsoft before install MongoDB https://support.microsoft.com/en-us/kb/2731284 Run below code to install setup in background, in specific location and All Features msiexec.exe /q /i mongodb-win32-x86_64-2008plus-ssl-3.2.1-signed.msi ^ INSTALLLOCATION=”D:\mongodb” ^ ADDLOCAL=”all” Create

Posted in Big Data, MongoDB

Hadoop: How many people belong to each state, using Hue (Hive, PIG and Impala)

Login to Hue site Upload sample file to HDFS using File Browser Create folder using New à Directory option. I created “people” folder Now upload sample file to HDFS by using upload option. Select File File is uploaded to HDFS

Posted in Big Data, Hadoop

Hadoop: How many people belong to each state, using PIG?

Follow my previous article to move sample data file to HDFS http://wp.me/p2oyUE-IW Start pig Grunt Execute blow Statement

Posted in Big Data, Hadoop

How to Install Eclipsec

Download Eclipsec IDE for JAVA from http://www.eclipse.org/downloads/ depend on your requirement. In my case I downloaded windows 64Bit “Eclipsec IDE for JAVA Developers” Extract the downloaded package and put it under “D:\EclipseForJava” Double click on “eclipsec” application to open the

Posted in Big Data, Hadoop

Hadoop: How many people belong to each state, using HIVE?

Prepare sample file Move sample file to Hadoop server Create the users directory on HDFS by using the following command Directory created on HDFS Now move local file to HDFS directory by using below command hadoop fs -copyFromLocal ‘/home/cloudera/Adil/Hive/People.txt’ ‘/user/cloudera/People/’

Posted in Big Data, Hadoop

Connection Profile Using Teradata Studio

Open Tedadata Studio Express Create new Data Connection Select Teradata Database, Enter Name and Press <Next> Enter Required information and Test connection Database server name: TD-EXPRESS User Name: dbc Password: dbc If all the information correct, you will receive success

Posted in Teradata