Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Apache Hive Cookbook
  • Table Of Contents Toc
  • Feedback & Rating feedback
Apache Hive Cookbook

Apache Hive Cookbook

By : Hanish Bansal, Saurabh Chauhan, Shrey Mehrotra
3 (4)
Buy this Book
close
close
Apache Hive Cookbook

Apache Hive Cookbook

3 (4)
By: Hanish Bansal, Saurabh Chauhan, Shrey Mehrotra
Buy this Book

Overview of this book

Hive was developed by Facebook and later open sourced in Apache community. Hive provides SQL like interface to run queries on Big Data frameworks. Hive provides SQL like syntax also called as HiveQL that includes all SQL capabilities like analytical functions which are the need of the hour in today’s Big Data world. This book provides you easy installation steps with different types of metastores supported by Hive. This book has simple and easy to learn recipes for configuring Hive clients and services. You would also learn different Hive optimizations including Partitions and Bucketing. The book also covers the source code explanation of latest Hive version. Hive Query Language is being used by other frameworks including spark. Towards the end you will cover integration of Hive with these frameworks.
Table of Contents (14 chapters)
close
close
close
Preface
Icon
Preface
Icon
What this book covers
Icon
What you need for this book
Icon
Who this book is for
Icon
Sections
Icon
Conventions
Icon
Reader feedback
Icon
Customer support
Free Chapter
1
1. Developing Hive
chevron up
Icon
1. Developing Hive
Icon
Introduction
Icon
Deploying Hive on a Hadoop cluster
Icon
Deploying Hive Metastore
Icon
Installing Hive
Icon
Configuring HCatalog
Icon
Understanding different components of Hive
Icon
Compiling Hive from source
Icon
Hive packages
Icon
Debugging Hive
Icon
Running Hive
Icon
Changing configurations at runtime
2
2. Services in Hive
Icon
2. Services in Hive
Icon
Introducing HiveServer2
Icon
Understanding HiveServer2 properties
Icon
Configuring HiveServer2 high availability
Icon
Using HiveServer2 clients
Icon
Introducing the Hive metastore service
Icon
Configuring high availability of metastore service
Icon
Introducing Hue
3
3. Understanding the Hive Data Model
Icon
3. Understanding the Hive Data Model
Icon
Introduction
Icon
Using numeric data types
Icon
Using string data types
Icon
Using Date/Time data types
Icon
Using miscellaneous data types
Icon
Using complex data types
Icon
Using operators
Icon
Partitioning
Icon
Partitioning a managed table
Icon
Partitioning an external table
Icon
Bucketing
4
4. Hive Data Definition Language
Icon
4. Hive Data Definition Language
Icon
Introduction
Icon
Creating a database schema
Icon
Dropping a database schema
Icon
Altering a database schema
Icon
Using a database schema
Icon
Showing database schemas
Icon
Describing a database schema
Icon
Creating tables
Icon
Dropping tables
Icon
Truncating tables
Icon
Renaming tables
Icon
Altering table properties
Icon
Creating views
Icon
Dropping views
Icon
Altering the view properties
Icon
Altering the view as select
Icon
Showing tables
Icon
Showing partitions
Icon
Show the table properties
Icon
Showing create table
Icon
HCatalog
Icon
WebHCat
5
5. Hive Data Manipulation Language
Icon
5. Hive Data Manipulation Language
Icon
Introduction
Icon
Loading files into tables
Icon
Inserting data into Hive tables from queries
Icon
Inserting data into dynamic partitions
Icon
Writing data into files from queries
Icon
Enabling transactions in Hive
Icon
Inserting values into tables from SQL
Icon
Updating data
Icon
Deleting data
6
6. Hive Extensibility Features
Icon
6. Hive Extensibility Features
Icon
Introduction
Icon
Serialization and deserialization formats and data types
Icon
Exploring views
Icon
Exploring indexes
Icon
Hive partitioning
Icon
Creating buckets in Hive
Icon
Analytics functions in Hive
Icon
Windowing in Hive
Icon
File formats
7
7. Joins and Join Optimization
Icon
7. Joins and Join Optimization
Icon
Understanding the joins concept
Icon
Using a left/right/full outer join
Icon
Using a left semi join
Icon
Using a cross join
Icon
Using a map-side join
Icon
Using a bucket map join
Icon
Using a bucket sort merge map join
Icon
Using a skew join
8
8. Statistics in Hive
Icon
8. Statistics in Hive
Icon
Bringing statistics in to Hive
Icon
Table and partition statistics in Hive
Icon
Column statistics in Hive
Icon
Top K statistics in Hive
9
9. Functions in Hive
Icon
9. Functions in Hive
Icon
Using built-in functions
Icon
Using the built-in User-defined Aggregation Function (UDAF)
Icon
Using the built-in User Defined Table Function (UDTF)
Icon
Creating custom User-Defined Functions (UDF)
10
10. Hive Tuning
Icon
10. Hive Tuning
Icon
Enabling predicate pushdown optimizations in Hive
Icon
Optimizations to reduce the number of map
Icon
Sampling
11
11. Hive Security
Icon
11. Hive Security
Icon
Securing Hadoop
Icon
Authorizing Hive
Icon
Configuring the SQL standards-based authorization
Icon
Authenticating Hive
12
12. Hive Integration with Other Frameworks
Icon
12. Hive Integration with Other Frameworks
Icon
Working with Apache Spark
Icon
Working with Accumulo
Icon
Working with HBase
Icon
Working with Google Drill
13
Index
Icon
Index

Understanding different components of Hive

Besides the Hive metastore, Hive components could be broadly classified as Hive clients and Hive servers. Hive servers provide interfaces to make the metastore available to external applications and check for user's authorization and authentication, and Hive clients are various applications used to access and execute Hive queries on the Hadoop cluster.

HiveServer

Let's take a look at its various components.

Hive metastore

Hive metastore URIs start a metastore service on the specified port. Metastore provides APIs to query the database, tables, schema, and other entities stored in the RDBMS datastore.

How to do it...

The metastore service starts as a Java process in the backend. You can start the Hive metastore service with the following command:

hive --service metastore &

HiveServer2

HiveServer2 is an interface that allows clients to execute Hive queries and get the result. It is based on Thrift RPC and supports multiple clients a against single client in HiveServer. It also provisioned for the authentication and authorization of the user.

How to do it...

The HiveServer2 service also starts as a Java process in the backend. You can start HiveServer2 with the following command:

hive --service hiveserver2 &

Hive clients

The following are the different clients available in Hive to query metastore data or to submit Hive queries to Hive servers.

Hive CLI

The following are the various sections included in Hive CLI.

Getting ready

Hive Command-line Interface (CLI) can be used to run Hive queries in either interactive or batch mode.

How to do it...

To run Hive CLI, use the following command:

$ HIVE_HOME/bin/hive

Queries are submitted by username of the user logged in to the UNIX system.

Beeline

The following are the various sections included in Beeline.

Getting ready

If you have configured HiveServer2, then a Beeline client can be used to interact with Hive.

How to do it...

To run Beeline, use the following command:

$ HIVE_HOME/bin/beeline

Using beeline, a connection could be made to any HiveServer2 instance with any username and password.

End of Section 7
Next Section

Create a Note

Modal Close icon
You need to login to use this feature.
notes
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Delete Note

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Edit Note

Modal Close icon
Write a note (max 255 characters)
Cancel
Update Note

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY