Deep Learning with Keras

By : Antonio Gulli , Sujit Pal

3.5 (20)

Buy this Book

Deep Learning with Keras

3.5 (20)

By: Antonio Gulli , Sujit Pal

Buy this Book

Overview of this book

This book starts by introducing you to supervised learning algorithms such as simple linear regression, the classical multilayer perceptron and more sophisticated deep convolutional networks. You will also explore image processing with recognition of handwritten digit images, classification of images into different categories, and advanced objects recognition with related image annotations. An example of identification of salient points for face detection is also provided. Next you will be introduced to Recurrent Networks, which are optimized for processing sequence data such as text, audio or time series. Following that, you will learn about unsupervised learning algorithms such as Autoencoders and the very popular Generative Adversarial Networks (GANs). You will also explore non-traditional uses of neural networks as Style Transfer. Finally, you will look at reinforcement learning and its application to AI game playing, another popular direction of research and application of neural networks.

Preface

Mission

How deep learning is different from machine learning and artificial intelligence

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

Neural Networks Foundations

Perceptron

Multilayer perceptron — the first example of a network

A real example — recognizing handwritten digits

A practical overview of backpropagation

Towards a deep learning approach

Summary

Keras Installation and API

Installing Keras

Configuring Keras

Installing Keras on Docker

Installing Keras on Google Cloud ML

Installing Keras on Amazon AWS

Installing Keras on Microsoft Azure

Keras API

Callbacks for customizing the training process

Summary

Deep Learning with ConvNets

Deep convolutional neural network — DCNN

An example of DCNN — LeNet

Recognizing CIFAR-10 images with deep learning

Very deep convolutional networks for large-scale image recognition

Summary

Generative Adversarial Networks and WaveNet

What is a GAN?

Deep convolutional generative adversarial networks

Keras adversarial GANs for forging MNIST

Keras adversarial GANs for forging CIFAR

WaveNet — a generative model for learning how to produce audio

Summary

Word Embeddings

Distributed representations

word2vec

Exploring GloVe

Using pre-trained embeddings

Summary

Recurrent Neural Network — RNN

SimpleRNN cells

RNN topologies

Vanishing and exploding gradients

Long short term memory — LSTM

Gated recurrent unit — GRU

Bidirectional RNNs

Stateful RNNs

Other RNN variants

Summary

Additional Deep Learning Models

Keras functional API

Regression networks

Unsupervised learning — autoencoders

Composing deep networks

Customizing Keras

Generative models

Summary

AI Game Playing

Reinforcement learning

Example - Keras deep Q-network for catch

The road ahead

Summary

Conclusion

Keras 2.0 — what is new

Customer Reviews

3.5 (20)

5 star

25%

4 star

20%

3 star

35%

2 star

15%

1 star

word2vec

The word2vec group of models was created in 2013 by a team of researchers at Google led by Tomas Mikolov. The models are unsupervised, taking as input a large corpus of text and producing a vector space of words. The dimensionality of the word2vec embedding space is usually lower than the dimensionality of the one-hot embedding space, which is the size of the vocabulary. The embedding space is also more dense compared to the sparse embedding of the one-hot embedding space.

The two architectures for word2vec are as follows:

Continuous Bag Of Words (CBOW)
Skip-gram

In the CBOW architecture, the model predicts the current word given a window of surrounding words. In addition, the order of the context words does not influence the prediction (that is, the bag of words assumption). In the case of skip-gram architecture, the model predicts the surrounding words given the center word. According to the authors...