Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Hands-On Deep Learning Algorithms with Python

By : Sudharsan Ravichandiran

4.1 (13)

Hands-On Deep Learning Algorithms with Python

4.1 (13)

By: Sudharsan Ravichandiran

Overview of this book

Deep learning is one of the most popular domains in the AI space that allows you to develop multi-layered models of varying complexities. This book introduces you to popular deep learning algorithms—from basic to advanced—and shows you how to implement them from scratch using TensorFlow. Throughout the book, you will gain insights into each algorithm, the mathematical principles involved, and how to implement it in the best possible manner. The book starts by explaining how you can build your own neural networks, followed by introducing you to TensorFlow, the powerful Python-based library for machine learning and deep learning. Moving on, you will get up to speed with gradient descent variants, such as NAG, AMSGrad, AdaDelta, Adam, and Nadam. The book will then provide you with insights into recurrent neural networks (RNNs) and LSTM and how to generate song lyrics with RNN. Next, you will master the math necessary to work with convolutional and capsule networks, widely used for image recognition tasks. You will also learn how machines understand the semantics of words and documents using CBOW, skip-gram, and PV-DM. Finally, you will explore GANs, including InfoGAN and LSGAN, and autoencoders, such as contractive autoencoders and VAE. By the end of this book, you will be equipped with all the skills you need to implement deep learning in your own projects.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Section 1: Getting Started with Deep Learning

Section 1: Getting Started with Deep Learning

Introduction to Deep Learning

Introduction to Deep Learning

What is deep learning?

Biological and artificial neurons

ANN and its layers

Exploring activation functions

Forward propagation in ANN

How does ANN learn?

Debugging gradient descent with gradient checking

Putting it all together

Summary

Questions

Further reading

Getting to Know TensorFlow

Getting to Know TensorFlow

What is TensorFlow?

Understanding computational graphs and sessions

Variables, constants, and placeholders

Introducing TensorBoard

Handwritten digit classification using TensorFlow

Introducing eager execution

Math operations in TensorFlow

TensorFlow 2.0 and Keras

Should we use Keras or TensorFlow?

Summary

Questions

Further reading

Section 2: Fundamental Deep Learning Algorithms

Section 2: Fundamental Deep Learning Algorithms

Gradient Descent and Its Variants

Gradient Descent and Its Variants

Demystifying gradient descent

Gradient descent versus stochastic gradient descent

Momentum-based gradient descent

Adaptive methods of gradient descent

Summary

Questions

Further reading

Generating Song Lyrics Using RNN

Generating Song Lyrics Using RNN

Introducing RNNs

Generating song lyrics using RNNs

Different types of RNN architectures

Summary

Questions

Further reading

Improvements to the RNN

Improvements to the RNN

LSTM to the rescue

Gated recurrent units

Bidirectional RNN

Going deep with deep RNN

Language translation using the seq2seq model

Summary

Questions

Further reading

Demystifying Convolutional Networks

Demystifying Convolutional Networks

What are CNNs?

The architecture of CNNs

The math behind CNNs

Implementing a CNN in TensorFlow

CNN architectures

Capsule networks

Building Capsule networks in TensorFlow

Summary

Questions

Further reading

Learning Text Representations

Learning Text Representations

Understanding the word2vec model

Building the word2vec model using gensim

Visualizing word embeddings in TensorBoard

Doc2vec

Understanding skip-thoughts algorithm

Quick-thoughts for sentence embeddings

Summary

Questions

Further reading

Section 3: Advanced Deep Learning Algorithms

Section 3: Advanced Deep Learning Algorithms

Generating Images Using GANs

Generating Images Using GANs

Differences between discriminative and generative models

Say hello to GANs!

DCGAN – Adding convolution to a GAN

Least squares GAN

GANs with Wasserstein distance

Summary

Questions

Further reading

Learning More about GANs

Learning More about GANs

Conditional GANs

Understanding InfoGAN

Translating images using a CycleGAN

StackGAN

Summary

Questions

Further reading

Reconstructing Inputs Using Autoencoders

Reconstructing Inputs Using Autoencoders

What is an autoencoder?

Autoencoders with convolutions

Exploring denoising autoencoders

Understanding sparse autoencoders

Learning to use contractive autoencoders

Dissecting variational autoencoders

Summary

Questions

Further reading

Exploring Few-Shot Learning Algorithms

Exploring Few-Shot Learning Algorithms

What is few-shot learning?

Siamese networks

Architecture of siamese networks

Prototypical networks

Relation networks

Matching networks

Summary

Questions

Further reading

Assessments

Assessments

Chapter 1 - Introduction to Deep Learning

Chapter 2 - Getting to Know TensorFlow

Chapter 3 - Gradient Descent and Its Variants

Chapter 4 - Generating Song Lyrics Using an RNN

Chapter 5 - Improvements to the RNN

Chapter 6 - Demystifying Convolutional Networks

Chapter 7 - Learning Text Representations

Chapter 8 - Generating Images Using GANs

Chapter 9 - Learning More about GANs

Chapter 10 - Reconstructing Inputs Using Autoencoders

Chapter 11 - Exploring Few-Shot Learning Algorithms

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

4.1 (13)

5 star

61.5%

4 star

15.4%

3 star

0

2 star

15.4%

1 star

7.7%

What is TensorFlow?

TensorFlow is an open source software library from Google, which is extensively used for numerical computation. It is one of the most popularly used libraries for building deep learning models. It is highly scalable and runs on multiple platforms, such as Windows, Linux, macOS, and Android. It was originally developed by the researchers and engineers of the Google Brain team.

TensorFlow supports execution on everything, including CPUs, GPUs, and TPUs, which are tensor processing units, and on mobile and embedded platforms. Due to its flexible architecture and ease of deployment, it has become a popular choice of library among many researchers and scientists for building deep learning models.

In TensorFlow, every computation is represented by a data flow graph, also known as a computational graph, where a node represents operations, such as addition or multiplication...

Search

Your notes and bookmarks