Sign In Start Free Trial

Hands-On Deep Learning with Apache Spark

By : Iozzia

Hands-On Deep Learning with Apache Spark

By: Iozzia

Overview of this book

Deep learning is a subset of machine learning where datasets with several layers of complexity can be processed. Hands-On Deep Learning with Apache Spark addresses the sheer complexity of technical and analytical parts and the speed at which deep learning solutions can be implemented on Apache Spark. The book starts with the fundamentals of Apache Spark and deep learning. You will set up Spark for deep learning, learn principles of distributed modeling, and understand different types of neural nets. You will then implement deep learning models, such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long short-term memory (LSTM) on Spark. As you progress through the book, you will gain hands-on experience of what it takes to understand the complex datasets you are dealing with. During the course of this book, you will use popular deep learning frameworks, such as TensorFlow, Deeplearning4j, and Keras to train your distributed models. By the end of this book, you'll have gained experience with the implementation of your models on a variety of use cases.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

The Apache Spark Ecosystem

The Apache Spark Ecosystem

Apache Spark fundamentals

Getting Spark

RDD programming

Spark SQL, Datasets, and DataFrames

Spark Streaming

Cluster mode using different managers

Summary

Deep Learning Basics

Deep Learning Basics

Introducing DL

DNNs overview

Practical applications of DL

Summary

Extract, Transform, Load

Extract, Transform, Load

Training data ingestion through Spark

Training data ingestion from a database with Spark

Data ingestion from S3

Raw data transformation with Spark

Summary

Streaming

Streaming

Streaming data with Apache Spark

Streaming data with Kafka and Spark

Streaming data with DL4J and Spark

Summary

Convolutional Neural Networks

Convolutional Neural Networks

Convolutional layers

Pooling layers

Fully connected layers

Weights

GoogleNet Inception V3 model

Hands-on CNN with Spark

Summary

Recurrent Neural Networks

Recurrent Neural Networks

LSTM

Use cases

Hands-on RNNs with Spark

Summary

Training Neural Networks with Spark

Training Neural Networks with Spark

Distributed network training with Spark and DeepLearning4j

Hyperparameter optimization

Summary

Monitoring and Debugging Neural Network Training

Monitoring and Debugging Neural Network Training

Monitoring and debugging neural networks during their training phases

Summary

Interpreting Neural Network Output

Interpreting Neural Network Output

Evaluation techniques with DL4J

Other types of evaluation

Summary

Deploying on a Distributed System

Deploying on a Distributed System

Setup of a distributed environment with DeepLearning4j

Spark distributed training architecture details

Importing Python models into the JVM with DL4J

Alternatives to DL4J for the Scala programming language

Summary

NLP Basics

NLP Basics

NLP

Hands-on NLP with Spark

Summary

Textual Analysis and Deep Learning

Textual Analysis and Deep Learning

Hands-on NLP with DL4J

Hands-on NLP with TensorFlow

Hand-on NLP with Keras and a TensorFlow backend

Hands-on NLP with Keras model import into DL4J

Summary

Convolution

Convolution

Convolution

Object recognition strategies

Convolution applied to image recognition

Summary

Image Classification

Image Classification

Implementing an end-to-end image classification web application

Summary

What's Next for Deep Learning?

What's Next for Deep Learning?

What to expect next for deep learning and AI

Topics to watch for

Is Spark ready for RL?

DeepLearning4J future support for GANs

Summary

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Appendix A: Functional Programming in Scala

Appendix A: Functional Programming in Scala

Functional programming (FP)

Appendix B: Image Data Preparation for Spark

Appendix B: Image Data Preparation for Spark

Image preprocessing

Customer Reviews

5 star

0

4 star

0

3 star

0

2 star

0

1 star

0

GoogleNet Inception V3 model

As a concrete implementation of a CNN, in this section, I am going to present the GoogleNet (https://ai.google/research/pubs/pub43022) architecture by Google (https://www.google.com/) and its inception layers. It has been presented at the ImageNet Large Scale Visual Recognition Challenge 2014 (ILSVRC2014, http://www.image-net.org/challenges/LSVRC/2014/). Needless to say, it won that competition. The distinct characteristic of this implementation is the following: increased depth and width and, at the same time, a constant computational budget. Improved computing resources utilization is part of the network design.

This chart summarizes all of the layers for this network implementation presented in the context:

Figure 5.4: GoogleNet layers

There are 22 layers with parameters (excluding the pooling layers; the total is 27 if they are included) and almost...

Search

Your notes and bookmarks