Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Python Deep Learning
  • Toc
  • feedback
Python Deep Learning

Python Deep Learning

By : Zocca, Spacagna, Daniel Slater, Roelants
4.1 (10)
close
Python Deep Learning

Python Deep Learning

4.1 (10)
By: Zocca, Spacagna, Daniel Slater, Roelants

Overview of this book

With an increasing interest in AI around the world, deep learning has attracted a great deal of public attention. Every day, deep learning algorithms are used broadly across different industries. The book will give you all the practical information available on the subject, including the best practices, using real-world use cases. You will learn to recognize and extract information to increase predictive accuracy and optimize results. Starting with a quick recap of important machine learning concepts, the book will delve straight into deep learning principles using Sci-kit learn. Moving ahead, you will learn to use the latest open source libraries such as Theano, Keras, Google's TensorFlow, and H20. Use this guide to uncover the difficulties of pattern recognition, scaling data with greater accuracy and discussing deep learning algorithms and techniques. Whether you want to dive deeper into Deep Learning, or want to investigate how to get more out of this powerful technology, you’ll find everything inside.
Table of Contents (12 chapters)
close
close
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Errata
Free Chapter
1
1. Machine Learning – An Introduction
1. Machine Learning – An Introduction
What is machine learning?
Different machine learning approaches
Summary
2
2. Neural Networks
2. Neural Networks
Why neural networks?
Fundamentals
Summary
3
3. Deep Learning Fundamentals
3. Deep Learning Fundamentals
What is deep learning?
Deep learning applications
GPU versus CPU
Popular open source libraries – an introduction
Summary
4
4. Unsupervised Feature Learning
4. Unsupervised Feature Learning
Autoencoders
Restricted Boltzmann machines
Summary
5
5. Image Recognition
5. Image Recognition
Similarities between artificial and biological models
Intuition and justification
Convolutional layers
Pooling layers
Dropout
Convolutional layers in deep learning
Convolutional layers in Theano
A convolutional layer example with Keras to recognize digits
A convolutional layer example with Keras for cifar10
Pre-training
Summary
6
6. Recurrent Neural Networks and Language Models
6. Recurrent Neural Networks and Language Models
Recurrent neural networks
Language modeling
Speech recognition
Summary
Bibliography
7
7. Deep Learning for Board Games
7. Deep Learning for Board Games
Early game playing AI
Using the min-max algorithm to value game states
Implementing a Python Tic-Tac-Toe game
Learning a value function
Training AI to master Go
Upper confidence bounds applied to trees
Deep learning in Monte Carlo Tree Search
Quick recap on reinforcement learning
Policy gradients for learning policy functions
Policy gradients in AlphaGo
Summary
8
8. Deep Learning for Computer Games
chevron up
8. Deep Learning for Computer Games
A supervised learning approach to games
Applying genetic algorithms to playing games
Q-Learning
Q-learning in action
Dynamic games
Atari Breakout
Actor-critic methods
Asynchronous methods
Model-based approaches
Summary
9
9. Anomaly Detection
9. Anomaly Detection
What is anomaly and outlier detection?
Real-world applications of anomaly detection
Popular shallow machine learning techniques
Anomaly detection using deep auto-encoders
H2O
Examples
Summary
10
10. Building a Production-Ready Intrusion Detection System
10. Building a Production-Ready Intrusion Detection System
What is a data product?
Training
Testing
Model validation
Hyper-parameters tuning
End-to-end evaluation
Deployment
Summary
11
Index
Index

Q-Learning

Imagine that we have an agent who will be moving through a maze environment, somewhere in which is a reward. The task we have is to find the best path for getting to the reward as quickly as possible. To help us think about this, let's start with a very simple maze environment:

Figure 2: A simple maze, the agent can move along the lines to go from one state to another. A reward of 4 is received if the agent gets to state D.

In the maze pictured, the agent can move between any of the nodes, in both directions, by following the lines. The node the agent is in is its state; moving along a line to a different node is an action. There is a reward of 4 if the agent gets to the goal in state D. We want to come up with the optimum path through the maze from any starting node.

Let's think about this problem for a moment. If moving along a line puts us in state D, then that will always be the path we want to take as that will give us the 4 reward in the next time step. Then going back a step...

End of Section 4
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete