Loading...

Messages

Proposals

Stuck in your homework and missing deadline? Get urgent help in $10/Page with 24 hours deadline

Get Urgent Writing Help In Your Essays, Assignments, Homeworks, Dissertation, Thesis Or Coursework & Achieve A+ Grades.

Privacy Guaranteed - 100% Plagiarism Free Writing - Free Turnitin Report - Professional And Experienced Writers - 24/7 Online Support

How to exit from hive

27/11/2021 Client: muhammad11 Deadline: 2 Day

8Lab 3: Hive

For this lab,

1. You will investigate how Hive works; create, load, query and store data in Apache Hive in

both our HU cloud platform and MapR sandbox.

2. You will compare the Hive performance between our HU cloud platform and MapR sandbox.

* Most contents are coming from https://learn.mapr.com/ by the permission of MapR

technology.

Prerequisite:

To our HU cloud platform,

For Hadoop Cluster Overview,

http://hdfs-namenode-hadoop.apps.myhu.cloud/dfshealth.html#tab-overview

For accessing Hadoop cluster nodes,

https://master1.myhu.cloud:8443/console/project/hadoop/browse/pods

User Name : hadoop, passwd: hadoop

To access the terminal of name node, please, click “hdfs-namenode-0” and then click

“Terminal”.

1. Create the folder named with your student id and work under the folder created.

2. To upload file, please use “wget” or other commands you like.

3. If you have any problem/issue with HU cloud, please report it to your submission and

use google cloud or Amazon cloud

4. If you have any problem/issue with HU cloud, google cloud or amazon cloud, please

report it to your submission and work only with MapR sandbox.

For using MapR sandbox,

Please, download the one of the MapR sandboxes listed below.

• VMware Course Sandbox: http://package.mapr.com/releases/v5.1.0/sandbox/MapR-

Sandbox-

https://learn.mapr.com/
http://hdfs-namenode-hadoop.apps.myhu.cloud/dfshealth.html#tab-overview
https://master1.myhu.cloud:8443/console/project/hadoop/browse/pods
For-Hadoop-5.1.0-vmware.ova

• VirtualBox Course Sandbox: http://package.mapr.com/releases/v5.1.0/sandbox/MapR-

Sandbox-

For-Hadoop-5.1.0.ova

For the installation, please refer to https://mapr.com/docs/52/SandboxHadoop/c_sandbox_overview.html

Logging in to the Command Line

● Before you get started, you'll want to have the IP address handy for your Sandbox VM.

See the screenshot below for an example of where to find that.

● Next, use an SSH client such as Putty (Windows) or Terminal (Mac) to login. See below

for an example:

● use userid: user01 and password: mapr.

● For VMWare use: $ ssh user01@ipaddress

● For Virtualbox use: $ ssh user01@127.0.0.1 -p 2222

For MapR sandbox,

Connect to the Hive CLI

The lab file contains data and source code you will use to complete the lab exercises.

1. Log in to your cluster as user01 (password is mapr).

2. Position yourself in the /user/user01 directory in the cluster file system:

$ cd /mapr/MyCluster/user/user01

3. Then, download and unzip the lab files

$ wget http://course-files.mapr.com/DA4400-R1/DA440-LabFiles.zip

$ unzip DA440-LabFiles.zip

Connect to the Hive Shell

1. Run the Hive shell program by typing hive in a terminal connected to the MapR Sandbox.

[user01@maprdemo ~]$ hive

hive>

Note: You are now in the Hive CLI. For the remainder of this lab, > is prompting a Hive

command in the Hive CLI, while $ is prompting a bash command in your terminal.

You may find it useful to type commands in a text editor rather than typing commands

directly into the command line. Copy and pasting commands from a text editor will allow you

to edit and save them, as well as allowing you to write longer queries.

2. Use the SHOW FUNCTIONS command to list available Hive Query Language functions.

3. Type the following SQL data definition in the Hive shell:

CREATE TABLE ebay.auction

(openingBid FLOAT,finalBid FLOAT,itemType STRING,days INT)

ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';

4. Load the eBay auction data with the following command:

LOAD DATA LOCAL INPATH

'file:///user/user01/DA440-LabFiles/auctiondata.csv'

INTO TABLE ebay.auction;

Submission!

5. Try querying this data with SQL commands you know. Do they work as you expect them to?

Create a Database

1. Use Hive data definition language (DDL) to create a database. Create the database in your home

directory, and name it the same as your user name. For example:

> CREATE DATABASE user01 LOCATION

'/user/user01/hive/user01.db';

2. Use the SHOW DATABASES command to list all the databases available in this Hive instance.

hive> SHOW DATABASES;

OK

default

user01

Time taken: 0.127 seconds, Fetched: 2 row(s)

You should see your new user01 database now.

Note: Hive Query Language (HQL) commands are shown in upper case. This is a

convention, not a requirement. HQL commands are case-insensitive, and may be

written in either upper or lowercase. All HQL statements must end with a semicolon.

3. Quit the Hive shell, and look at the database from your bash shell:

hive> quit;

$ hadoop fs -ls /user/user01/hive

You should see the user01 database.

Create a Simple Table

1. Log back in to the Hive shell:

$ hive

hive >

2. Create a location table inside the user01 database, with the characteristics listed below. Create a

location table with the following characteristics:

• A station column, of type string

• A latitude column, of type integer

• A longitude column, of type integer

• A row format of delimited

• Fields terminated by comma

• Lines terminated by the line feed character

• Stored as a text file

3. Show the tables in your database:

hive> SHOW TABLES IN user01;

4. Show the characteristics of the table:

Submission: Command and the result of command (Screen capture)

5. Drop the table:

hive: DROP TABLE user01.location;

6. Recreate the table, but this time name the second column city instead of latitude.

7. Show the table you created.

8. Rename the city column to latitude:

hive> ALTER TABLE user01.location CHANGE COLUMN city latitude INT;

Create Partitioned and External Tables

Partitioning data can speed up queries and optimize results. Create the windspeed table as a partitioned

table with the following characteristics

• A year column, of type integer

• A month column, of type string

• A knots column, of type float

• A partition using station as the column, of type string

• Delimited row format

• Fields terminated by comma

• Lines terminated by linefeed

• Stored as a text file

Create an External Table

Create an external table called temperature that uses a text file stored in your lab files folder, with the

following characteristics:

• A station column, of type string

• A year column, of type integer

• A month column, of type string

• A celsius column, of type float

• Delimited row format

• Fields terminated by comma

• Lines terminated by linefeed

• Stored as a text file

• A location pointing to the temperature folder in your lab files folder

Submission

Screen Capture for SELECT * FROM user01.temperature LIMIT 10;

Load Data into Tables

1. Use LOAD DATA to load the location table. Remember to replace user01 with your own

userID in the file path and the database notation if necessary.

2. Load data into the partitioned table, windspeed. Since this table is partitioned, we’ll have to add

the PARTITION clause to the LOAD DATA command.

3. You can also explore the warehouse directory using Hadoop FS commands to see

how the partitioned table is laid out. Exit Hive using QUIT;, then enter:

$ hadoop fs -ls /user/user01/hive/user01.db/windspeed

Submission

Screen Capture for $ hadoop fs -ls /user/user01/hive/user01.db/windspeed

Examine Databases and Tables

The location, windspeed and temperature tables should have data in them. If you are

familiar with SQL, run some basic queries on these tables. Here are some queries to try:

Submission

Screen Capture for SELECT * FROM location;

Screen Capture for SELECT count(*) FROM windspeed;

Screen Capture for SELECT * FROM windspeed LIMIT 20;

Screen Capture for SELECT * FROM temperature WHERE year = 2000;

Query Data with SELECT

1. First, explore the temperature table. This table holds the average monthly temperatures, in

degrees Celsius, from eight different weather stations in Antarctica from several decades.

2.Let’s look at all the temperatures from January, 1970, which is the time when Unix time began:

Submission

Command and Screen capture for the command

2. Let’s try the same query, but for July, when it is winter in Antarctica:

Submission

Command and Screen capture for the command

3. The name of the weather station at the South Pole is called Clean Air, because very little manmade

pollution can be found there. Let’s find the temperatures in July at the South Pole:

Submission

Command and Screen capture for the command

4. Find the average temperature in Antarctica in 1970:

Submission

Command and Screen capture for the command

5. Run #4 in HU Cloud

Submission

Compare the performance between MapR and HU Cloud.

5. Find the hottest and coldest temperatures recorded in Antarctica:

Submission

Command and Screen capture for the command

6. Run #5 in HU Cloud

Submission

Compare the performance between MapR and HU Cloud.

Homework is Completed By:

Writer Writer Name Amount Client Comments & Rating
Instant Homework Helper

ONLINE

Instant Homework Helper

$36

She helped me in last minute in a very reasonable price. She is a lifesaver, I got A+ grade in my homework, I will surely hire her again for my next assignments, Thumbs Up!

Order & Get This Solution Within 3 Hours in $25/Page

Custom Original Solution And Get A+ Grades

  • 100% Plagiarism Free
  • Proper APA/MLA/Harvard Referencing
  • Delivery in 3 Hours After Placing Order
  • Free Turnitin Report
  • Unlimited Revisions
  • Privacy Guaranteed

Order & Get This Solution Within 6 Hours in $20/Page

Custom Original Solution And Get A+ Grades

  • 100% Plagiarism Free
  • Proper APA/MLA/Harvard Referencing
  • Delivery in 6 Hours After Placing Order
  • Free Turnitin Report
  • Unlimited Revisions
  • Privacy Guaranteed

Order & Get This Solution Within 12 Hours in $15/Page

Custom Original Solution And Get A+ Grades

  • 100% Plagiarism Free
  • Proper APA/MLA/Harvard Referencing
  • Delivery in 12 Hours After Placing Order
  • Free Turnitin Report
  • Unlimited Revisions
  • Privacy Guaranteed

6 writers have sent their proposals to do this homework:

Assignment Guru
Financial Solutions Provider
Top Class Engineers
Premium Solutions
Exam Attempter
Professional Accountant
Writer Writer Name Offer Chat
Assignment Guru

ONLINE

Assignment Guru

I have read your project description carefully and you will get plagiarism free writing according to your requirements. Thank You

$39 Chat With Writer
Financial Solutions Provider

ONLINE

Financial Solutions Provider

I will be delighted to work on your project. As an experienced writer, I can provide you top quality, well researched, concise and error-free work within your provided deadline at very reasonable prices.

$37 Chat With Writer
Top Class Engineers

ONLINE

Top Class Engineers

I find your project quite stimulating and related to my profession. I can surely contribute you with your project.

$39 Chat With Writer
Premium Solutions

ONLINE

Premium Solutions

After reading your project details, I feel myself as the best option for you to fulfill this project with 100 percent perfection.

$16 Chat With Writer
Exam Attempter

ONLINE

Exam Attempter

I have worked on wide variety of research papers including; Analytical research paper, Argumentative research paper, Interpretative research, experimental research etc.

$29 Chat With Writer
Professional Accountant

ONLINE

Professional Accountant

I have worked on wide variety of research papers including; Analytical research paper, Argumentative research paper, Interpretative research, experimental research etc.

$44 Chat With Writer

Let our expert academic writers to help you in achieving a+ grades in your homework, assignment, quiz or exam.

Similar Homework Questions

Fitness fanatics is a regional chain of health - One step equations with fractions worksheet - Questions.... - William wharton green mile - Momentum and impulse worksheet - Johnson and johnson case study - Locke and lathams goal setting theory - What does oedipus accuse creon of doing - Social media isolation argumentative essay - The three primary privacy issues are accuracy property and - The earliest opera that has been preserved is jacopo peri's - Dap discussion - English 2 Page work - BW Texas Gov't Unit 2 Topic 4 - 38 macleay street potts point - Under armour marketing strategy 2012 - Professional Accountability, Standards of Practice, and Professional Development - Is 99 ranch market open on new year's day - West kilbride primary school - Westpac balance transfer offer - Case Study Analysis - Acl drayton thermostat instructions - 51 goldminers place epping - Hatchet chapter 17 summary - Preliminary stage cost drivers definition - Question (4) 75 words per question - Objects that represent communication - Continuous quality improvement worksheet hcs 451 - Character in the bible old testament - Brave and startling truth - Macquarie university student id card - The qualities of the prince - Sabre simulation tips - A shopper in a supermarket pushes a cart - Vce economics study design - Excel 2019 In Practice - Ch 3 Independent Project 3-4 - Commenced business with capital journal entry - American writer 1803 82 - Movie recommendation project report - A sociology experiment - Fad examples in fashion - Halifax quality of life survey - Assignment 4: Workplace Ethics - Sucrose concentration vs tubing permeability - Chapter 12 personal finance investing in stocks - Builders warranty insurance victoria - Nrs 490 individual success plan example - Allegorical Approaches - Auditing - Discussion - The private eye clinic - Reading level assessment tool - Ethical choices in business situations are most often made - Derivative of arcsin x - nursing research help - Chess holding statement commsec - WK9 10-19 - Quantitative Research - Factor riddles with answers - Hess's law magnesium oxide lab - Read Leaked Movie Trailer and a Confidentiality Agreement and complete the questions at the end of the case study. - Atonement essay thesis - National standards for disability services - Getting under the hood of an annual report - Describe an advertisement you dislike the most cue card - Download adobe dynamic stamps - Manova research question example - Which capital budgeting method ignores the time value of money - A large nuclear power plant delivers energy of about - Buenos aires in english translation - Macbeth act 1 scene 3 - Coca cola company strategy implementation - Mental health - Essay and power point presentation - M3 per hour to kw - Askacu centre north sydney - 1 pages(due)15 hrs - Dublin gaa training programme - The breadwinner questions and answers - Tata nano the people's car case study solution - Triple beam balance definition chemistry - All watched over by machines poem - As nzs 3500.1 2003 - Av jennings home plans - Bus 377 discussion question - Monster high 13 wishes - The ugly american quotes - How to calculate usual body weight - Bobby rupp in cold blood - True beauty farnham common - New zealand white rabbit weight chart - Psalm 119 105 kjv - The comparative balance sheet of yellow dog enterprises inc - DIT discussion3 - I say the hip hop the hibby - Rate law iodine clock reaction - First they came for the jews and i was silent - The island of sodor - Describe a polar covalent bond - Aldo leopold a sand county almanac sparknotes - Vladimir tatlin counter relief 1913