Deep Learning with Keras

By : Antonio Gulli , Sujit Pal

3.5 (20)

Buy this Book

Deep Learning with Keras

3.5 (20)

By: Antonio Gulli , Sujit Pal

Buy this Book

Overview of this book

This book starts by introducing you to supervised learning algorithms such as simple linear regression, the classical multilayer perceptron and more sophisticated deep convolutional networks. You will also explore image processing with recognition of handwritten digit images, classification of images into different categories, and advanced objects recognition with related image annotations. An example of identification of salient points for face detection is also provided. Next you will be introduced to Recurrent Networks, which are optimized for processing sequence data such as text, audio or time series. Following that, you will learn about unsupervised learning algorithms such as Autoencoders and the very popular Generative Adversarial Networks (GANs). You will also explore non-traditional uses of neural networks as Style Transfer. Finally, you will look at reinforcement learning and its application to AI game playing, another popular direction of research and application of neural networks.

Preface

Mission

How deep learning is different from machine learning and artificial intelligence

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

Neural Networks Foundations

Perceptron

Multilayer perceptron — the first example of a network

A real example — recognizing handwritten digits

A practical overview of backpropagation

Towards a deep learning approach

Summary

Keras Installation and API

Installing Keras

Configuring Keras

Installing Keras on Docker

Installing Keras on Google Cloud ML

Installing Keras on Amazon AWS

Installing Keras on Microsoft Azure

Keras API

Callbacks for customizing the training process

Summary

Deep Learning with ConvNets

Deep convolutional neural network — DCNN

An example of DCNN — LeNet

Recognizing CIFAR-10 images with deep learning

Very deep convolutional networks for large-scale image recognition

Summary

Generative Adversarial Networks and WaveNet

What is a GAN?

Deep convolutional generative adversarial networks

Keras adversarial GANs for forging MNIST

Keras adversarial GANs for forging CIFAR

WaveNet — a generative model for learning how to produce audio

Summary

Word Embeddings

Distributed representations

word2vec

Exploring GloVe

Using pre-trained embeddings

Summary

Recurrent Neural Network — RNN

SimpleRNN cells

RNN topologies

Vanishing and exploding gradients

Long short term memory — LSTM

Gated recurrent unit — GRU

Bidirectional RNNs

Stateful RNNs

Other RNN variants

Summary

Additional Deep Learning Models

Keras functional API

Regression networks

Unsupervised learning — autoencoders

Composing deep networks

Customizing Keras

Generative models

Summary

AI Game Playing

Reinforcement learning

Example - Keras deep Q-network for catch

The road ahead

Summary

Conclusion

Keras 2.0 — what is new

Customer Reviews

3.5 (20)

5 star

25%

4 star

20%

3 star

35%

2 star

15%

1 star

Word Embeddings

Wikipedia defines word embedding as the collective name for a set of language modeling and feature learning techniques in natural language processing (NLP) where words or phrases from the vocabulary are mapped to vectors of real numbers.

Word embeddings are a way to transform words in text to numerical vectors so that they can be analyzed by standard machine learning algorithms that require vectors as numerical input.

You have already learned about one type of word embedding called one-hot encoding, in Chapter 1, Neural Networks Foundations. One-hot encoding is the most basic embedding approach. To recap, one-hot encoding represents a word in the text by a vector of the size of the vocabulary, where only the entry corresponding to the word is a one and all the other entries are zero.

A major problem with one-hot encoding is that there is no way to represent the similarity between words...