Sign In Start Free Trial

Learning Elastic Stack 7.0

By : Pranav Shukla, Sharath Kumar M N

3.8 (6)

Learning Elastic Stack 7.0

3.8 (6)

By: Pranav Shukla, Sharath Kumar M N

Overview of this book

The Elastic Stack is a powerful combination of tools that help in performing distributed search, analytics, logging, and visualization of data. Elastic Stack 7.0 encompasses new features and capabilities that will enable you to find unique insights into analytics using these techniques. This book will give you a fundamental understanding of what the stack is all about, and guide you in using it efficiently to build powerful real-time data processing applications. The first few sections of the book will help you understand how to set up the stack by installing tools and exploring their basic configurations. You’ll then get up to speed with using Elasticsearch for distributed search and analytics, Logstash for logging, and Kibana for data visualization. As you work through the book, you will discover the technique of creating custom plugins using Kibana and Beats. This is followed by coverage of the Elastic X-Pack, a useful extension for effective security and monitoring. You’ll also find helpful tips on how to use Elastic Cloud and deploy Elastic Stack in production environments. By the end of this book, you’ll be well-versed with fundamental Elastic Stack functionalities and the role of each component in the stack to solve different data processing problems.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Section 1: Introduction to Elastic Stack and Elasticsearch

Section 1: Introduction to Elastic Stack and Elasticsearch

Introducing Elastic Stack

Introducing Elastic Stack

What is Elasticsearch, and why use it?

Exploring the components of the Elastic Stack

Use cases of Elastic Stack

Downloading and installing

Summary

Getting Started with Elasticsearch

Getting Started with Elasticsearch

Using the Kibana Console UI

Core concepts of Elasticsearch

CRUD operations

Creating indexes and taking control of mapping

REST API overview

Summary

Section 2: Analytics and Visualizing Data

Section 2: Analytics and Visualizing Data

Searching - What is Relevant

Searching - What is Relevant

The basics of text analysis

Searching from structured data

Searching from the full text

Writing compound queries

Modeling relationships

Summary

Analytics with Elasticsearch

Analytics with Elasticsearch

The basics of aggregations

Preparing data for analysis

Metric aggregations

Bucket aggregations

Pipeline aggregations

Summary

Analyzing Log Data

Analyzing Log Data

Log analysis challenges

Using Logstash

The Logstash architecture

Overview of Logstash plugins

Ingest node

Summary

Building Data Pipelines with Logstash

Building Data Pipelines with Logstash

Parsing and enriching logs using Logstash

Introducing Beats

Filebeat

Summary

Visualizing Data with Kibana

Visualizing Data with Kibana

Downloading and installing Kibana

Preparing data

Kibana UI

Timelion

Using plugins

Summary

Section 3: Elastic Stack Extensions

Section 3: Elastic Stack Extensions

Elastic X-Pack

Elastic X-Pack

Installing Elasticsearch and Kibana with X-Pack

Configuring X-Pack

Securing Elasticsearch and Kibana

Monitoring Elasticsearch

Alerting

Summary

Section 4: Production and Server Infrastructure

Section 4: Production and Server Infrastructure

Running Elastic Stack in Production

Running Elastic Stack in Production

Hosting Elastic Stack on a managed cloud

Hosting Elastic Stack on your own

Backing up and restoring

Setting up index aliases

Setting up index templates

Modeling time series data

Summary

Building a Sensor Data Analytics Application

Building a Sensor Data Analytics Application

Introduction to the application

Modeling data in Elasticsearch

Setting up the metadata database

Building the Logstash data pipeline

Sending data to Logstash over HTTP

Visualizing the data in Kibana

Summary

Monitoring Server Infrastructure

Monitoring Server Infrastructure

Metricbeat

Configuring Metricbeat

Capturing system metrics

Deployment architecture

Summary

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

3.8 (6)

5 star

50%

4 star

0

3 star

33.3%

2 star

16.7%

1 star

0

Setting up the metadata database

We need to have a database that has metadata about the sensors. This database will hold the tables that we discussed in the Introduction to the application section.

We are storing the data in a relational database MySQL, but you can use any other relational database equally well. Since we are using MySQL, we will be using the MySQL JDBC driver to connect to the database. Please ensure that you have the following things set up on your system:

MySQL database community version 5.5, 5.6, or 5.7. You can use an existing database if you already have it on your system.
Install the downloaded MySQL database and log in with the root user. Execute the script available https://github.com/pranav-shukla/learningelasticstack/tree/v7.0/chapter-10/files/create_sensor_metadata.sql.
Log in to the newly created sensor_metadata database and verify that the three...

Search

Your notes and bookmarks