Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Scalable Data Streaming with Amazon Kinesis
  • Table Of Contents Toc
  • Feedback & Rating feedback
Scalable Data Streaming with Amazon Kinesis

Scalable Data Streaming with Amazon Kinesis

By : Makota, Brian Maguire, Gagne, Chakrabarti
5 (4)
close
close
Scalable Data Streaming with Amazon Kinesis

Scalable Data Streaming with Amazon Kinesis

5 (4)
By: Makota, Brian Maguire, Gagne, Chakrabarti

Overview of this book

Amazon Kinesis is a collection of secure, serverless, durable, and highly available purpose-built data streaming services. This data streaming service provides APIs and client SDKs that enable you to produce and consume data at scale. Scalable Data Streaming with Amazon Kinesis begins with a quick overview of the core concepts of data streams, along with the essentials of the AWS Kinesis landscape. You'll then explore the requirements of the use case shown through the book to help you get started and cover the key pain points encountered in the data stream life cycle. As you advance, you'll get to grips with the architectural components of Kinesis, understand how they are configured to build data pipelines, and delve into the applications that connect to them for consumption and processing. You'll also build a Kinesis data pipeline from scratch and learn how to implement and apply practical solutions. Moving on, you'll learn how to configure Kinesis on a cloud platform. Finally, you’ll learn how other AWS services can be integrated into Kinesis. These services include Redshift, Dynamo Database, AWS S3, Elastic Search, and third-party applications such as Splunk. By the end of this AWS book, you’ll be able to build and deploy your own Kinesis data pipelines with Kinesis Data Streams (KDS), Kinesis Data Firehose (KFH), Kinesis Video Streams (KVS), and Kinesis Data Analytics (KDA).
Table of Contents (13 chapters)
close
close
1
Section 1: Introduction to Data Streaming and Amazon Kinesis
5
Section 2: Deep Dive into Kinesis
10
Section 3: Integrations

Creating operational insights using Apache Flink

Amazon Kinesis Data Analytics for Apache Flink allows us to go beyond SQL and use Java or Scala as programming languages and a data stream API to build our analytics applications. In this section, we are going to focus on KDA for Flink.

Note

If you are not familiar with Apache Flink, we recommend you first go through the Flink overview: https://ci.apache.org/projects/flink/flink-docs-release-1.11/learn-flink/.

Apache Flink deserves a book in itself, and we are going to cover how to run Flink applications on KDA specifically.

When we create applications with KDA for Flink, we follow the same pattern as we did with KDA SQL, with a number of differences outlined in the following table:

Figure 6.9 – KDA SQL and KDA Flink comparison

KDA Flink applications come with more options and flexibility, which can be a determining factor in selecting which engine to use. For example, it is common for companies...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech

Create a Note

Modal Close icon
You need to login to use this feature.
notes
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Delete Note

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Edit Note

Modal Close icon
Write a note (max 255 characters)
Cancel
Update Note

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY