Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • ElasticSearch Cookbook
  • Toc
  • feedback
ElasticSearch Cookbook

ElasticSearch Cookbook

By : Alberto Paro
4.1 (7)
close
ElasticSearch Cookbook

ElasticSearch Cookbook

4.1 (7)
By: Alberto Paro

Overview of this book

ElasticSearch is one of the most promising NoSQL technologies available and is built to provide a scalable search solution with built-in support for near real-time search and multi-tenancy. This practical guide is a complete reference for using ElasticSearch and covers 360 degrees of the ElasticSearch ecosystem. We will get started by showing you how to choose the correct transport layer, communicate with the server, and create custom internal actions for boosting tailored needs. Starting with the basics of the ElasticSearch architecture and how to efficiently index, search, and execute analytics on it, you will learn how to extend ElasticSearch by scripting and monitoring its behaviour. Step-by-step, this book will help you to improve your ability to manage data in indexing with more tailored mappings, along with searching and executing analytics with facets. The topics explored in the book also cover how to integrate ElasticSearch with Python and Java applications. This comprehensive guide will allow you to master storing, searching, and analyzing data with ElasticSearch.
Table of Contents (14 chapters)
close
close
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Free Chapter
1
1. Getting Started
chevron up
1. Getting Started
Introduction
Understanding node and cluster
Understanding node services
Managing your data
Understanding cluster, replication, and sharding
Communicating with ElasticSearch
Using the HTTP protocol
Using the Native protocol
Using the Thrift protocol
2
2. Downloading and Setting Up ElasticSearch
2. Downloading and Setting Up ElasticSearch
Introduction
Downloading and installing ElasticSearch
Networking setup
Setting up a node
Setting up ElasticSearch for Linux systems (advanced)
Setting up different node types (advanced)
Installing a plugin
Installing a plugin manually
Removing a plugin
Changing logging settings (advanced)
3
3. Managing Mapping
3. Managing Mapping
Introduction
Using explicit mapping creation
Mapping base types
Mapping arrays
Mapping an object
Mapping a document
Using dynamic templates in document mapping
Managing nested objects
Managing a child document
Mapping a multifield
Mapping a GeoPoint field
Mapping a GeoShape field
Mapping an IP field
Mapping an attachment field
Adding generic data to mapping
Mapping different analyzers
4
4. Standard Operations
4. Standard Operations
Introduction
Creating an index
Deleting an index
Opening/closing an index
Putting a mapping in an index
Getting a mapping
Deleting a mapping
Refreshing an index
Flushing an index
Optimizing an index
Checking if an index or type exists
Managing index settings
Using index aliases
Indexing a document
Getting a document
Deleting a document
Updating a document
Speeding up atomic operations (bulk)
Speeding up GET
5
5. Search, Queries, and Filters
5. Search, Queries, and Filters
Introduction
Executing a search
Sorting a search
Highlighting results
Executing a scan query
Suggesting a correct query
Counting
Deleting by query
Matching all the documents
Querying/filtering for term
Querying/filtering for terms
Using a prefix query/filter
Using a Boolean query/filter
Using a range query/filter
Using span queries
Using the match query
Using the IDS query/filter
Using the has_child query/filter
Using the top_children query
Using the has_parent query/filter
Using a regexp query/filter
Using exists and missing filters
Using and/or/not filters
Using the geo_bounding_box filter
Using the geo_polygon filter
Using the geo_distance filter
6
6. Facets
6. Facets
Introduction
Executing facets
Executing terms facets
Executing range facets
Executing histogram facets
Executing date histogram facets
Executing filter/query facets
Executing statistical facets
Executing term statistical facets
Executing geo distance facets
7
7. Scripting
7. Scripting
Introduction
Installing additional script plugins
Sorting using script
Computing return fields with scripting
Filtering a search via scripting
Updating with scripting
8
8. Rivers
8. Rivers
Introduction
Managing a river
Using the CouchDB river
Using the MongoDB river
Using the RabbitMQ river
Using the JDBC river
Using the Twitter river
9
9. Cluster and Nodes Monitoring
9. Cluster and Nodes Monitoring
Introduction
Controlling cluster health via API
Controlling cluster state via API
Getting nodes information via API
Getting node statistic via API
Installing and using BigDesk
Installing and using ElasticSerach-head
Installing and using SemaText SPM
10
10. Java Integration
10. Java Integration
Introduction
Creating an HTTP client
Creating a native client
Managing indices with the native client
Managing mappings
Managing documents
Managing bulk action
Creating a query
Executing a standard search
Executing a facet search
Executing a scroll/scan search
11
11. Python Integration
11. Python Integration
Introduction
Creating a client
Managing indices
Managing mappings
Managing documents
Executing a standard search
Executing a facet search
12
12. Plugin Development
12. Plugin Development
Introduction
Creating a site plugin
Creating a simple plugin
Creating a REST plugin
Creating a cluster action
Creating an analyzer plugin
Creating a river plugin
13
Index
Index

Using the Thrift protocol

Thrift is an interface definition language, initially developed by Facebook, used to define and create services. This protocol is now in the Apache Software Foundation.

Its usage is similar to HTTP, but it bypasses the limit of HTTP protocol (latency, handshake, and so on) and it's faster.

Getting ready

You need a working ElasticSearch cluster with the thrift plugin installed (https://github.com/elasticsearch/elasticsearch-transport-thrift/) the standard port for thrift protocol is 9500.

How to do it…

In java using ElasticSearch generated classes, creating a client is quite easy as shown in the following code snippet:

import org.apache.thrift.protocol.TBinaryProtocol;
import org.apache.thrift.protocol.TProtocol;
import org.apache.thrift.transport.TSocket;
import org.apache.thrift.transport.TTransport;
import org.apache.thrift.transport.TTransportException;
import org.elasticsearch.thrift.*;


TTransport transport = new TSocket("127.0.0.1", 9500);
TProtocol protocol = new TBinaryProtocol(transport);
Rest.Client client = new Rest.Client(protocol);
transport.open();

How it works…

To initialize a connection, first we need to open a socket transport. This is done with the TSocket (host/port), using the ElasticSearch thrift standard port 9500.

Then the Socket Transport Protocol must be encapsulated in a Binary Protocol—this is done with the TBinaryProtocol (transport).

Now, a client can be initialized by passing the protocol. The Rest-Client and other utilities classes are generated by elasticsearch.thrift, and live in the org.elasticsearch.thrift namespace.

To have a fully working client, we must open the socket (transport.open()).

At the end of program, we should clean the socket closing it (transport.close()).

There's more...

Some drivers to connect to ElasticSearch provide a simple to use API to interact with thrift without the boulder that this protocol needs.

For advanced usage, I suggest the use of the Thrift protocol to bypass some problems related with HTTP limits. They are as follows:

  • The number of simultaneous connections required in HTTP—thrift transport is less resource angry
  • The network traffic is light reduced to its binary nature

A big advantage of this protocol is that on server side it wraps the REST entry points so it can be also used with calls provided by external REST plugins.

See also

End of Chapter 1
Next Chapter
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete