Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Hands-On Reinforcement Learning with Python
  • Toc
  • feedback
Hands-On Reinforcement Learning with Python

Hands-On Reinforcement Learning with Python

By : Sudharsan Ravichandiran
2.6 (18)
close
Hands-On Reinforcement Learning with Python

Hands-On Reinforcement Learning with Python

2.6 (18)
By: Sudharsan Ravichandiran

Overview of this book

Reinforcement Learning (RL) is the trending and most promising branch of artificial intelligence. Hands-On Reinforcement learning with Python will help you master not only the basic reinforcement learning algorithms but also the advanced deep reinforcement learning algorithms. The book starts with an introduction to Reinforcement Learning followed by OpenAI Gym, and TensorFlow. You will then explore various RL algorithms and concepts, such as Markov Decision Process, Monte Carlo methods, and dynamic programming, including value and policy iteration. This example-rich guide will introduce you to deep reinforcement learning algorithms, such as Dueling DQN, DRQN, A3C, PPO, and TRPO. You will also learn about imagination-augmented agents, learning from human preference, DQfD, HER, and many more of the recent advancements in reinforcement learning. By the end of the book, you will have all the knowledge and experience needed to implement reinforcement learning and deep reinforcement learning in your projects, and you will be all set to enter the world of artificial intelligence.
Table of Contents (16 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
What is RL?
RL algorithm
How RL differs from other ML paradigms
Elements of RL
Agent environment interface
Types of RL environment
RL platforms
Applications of RL
Summary
Questions
Further reading
2
Getting Started with OpenAI and TensorFlow
Getting Started with OpenAI and TensorFlow
Setting up your machine
OpenAI Gym
OpenAI Universe
TensorFlow
Summary
Questions
Further reading
3
The Markov Decision Process and Dynamic Programming
The Markov Decision Process and Dynamic Programming
The Markov chain and Markov process
Markov Decision Process
The Bellman equation and optimality
Solving the Bellman equation
Solving the frozen lake problem
Summary
Questions
Further reading
4
Gaming with Monte Carlo Methods
Gaming with Monte Carlo Methods
Monte Carlo methods
Monte Carlo prediction
Monte Carlo control
Summary
Questions
Further reading
5
Temporal Difference Learning
Temporal Difference Learning
TD learning
TD prediction
TD control
The difference between Q learning and SARSA
Summary
Questions
Further reading
6
Multi-Armed Bandit Problem
Multi-Armed Bandit Problem
The MAB problem
Applications of MAB
Identifying the right advertisement banner using MAB
Contextual bandits
Summary
Questions
Further reading
7
Deep Learning Fundamentals
Deep Learning Fundamentals
Artificial neurons
ANNs
Deep diving into ANN
Neural networks in TensorFlow
RNN
Long Short-Term Memory RNN
Convolutional neural networks
Classifying fashion products using CNN
Summary
Questions
Further reading
8
Atari Games with Deep Q Network
Atari Games with Deep Q Network
What is a Deep Q Network?
Architecture of DQN
Building an agent to play Atari games
Double DQN
Prioritized experience replay
Dueling network architecture
Summary
Questions
Further reading
9
Playing Doom with a Deep Recurrent Q Network
chevron up
Playing Doom with a Deep Recurrent Q Network
DRQN
Training an agent to play Doom
DARQN
Summary
Questions
Further reading
10
The Asynchronous Advantage Actor Critic Network
The Asynchronous Advantage Actor Critic Network
The Asynchronous Advantage Actor Critic
Driving up a mountain with A3C
Summary
Questions
Further reading
11
Policy Gradients and Optimization
Policy Gradients and Optimization
Policy gradient
Deep deterministic policy gradient
Trust Region Policy Optimization
Proximal Policy Optimization
Summary
Questions
Further reading
12
Capstone Project – Car Racing Using DQN
Capstone Project – Car Racing Using DQN
Environment wrapper functions
Dueling network
Replay memory
Training the network
Car racing
Summary
Questions
Further reading
13
Recent Advancements and Next Steps
Recent Advancements and Next Steps
Imagination augmented agents
Learning from human preference
Deep Q learning from demonstrations
Hindsight experience replay
Hierarchical reinforcement learning
Inverse reinforcement learning
Summary
Questions
Further reading
14
Assessments
Assessments
Chapter 1
Chapter 2
Chapter 3
Chapter 4
Chapter 5
Chapter 6
Chapter 7
Chapter 8
Chapter 9
Chapter 10
Chapter 11
Chapter 12
Chapter 13
15
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Training an agent to play Doom

Doom is a very popular first-person shooter game. The goal of the game is to kill monsters. Doom is another example of a partially observable MDP as the agent's (player) view is limited to 90 degrees. The agent has no idea about the rest of the environment. Now, we will see how can we use DRQN to train our agent to play Doom.

Instead of OpenAI Gym, we will use the ViZDoom package to simulate the Doom environment to train our agent. To learn more about the ViZDoom package, check out its official website at http://vizdoom.cs.put.edu.pl/. We can install ViZDoom simply by using the following command:

pip install vizdoom

ViZDoom provides a lot of Doom scenarios and those scenarios can be found in the package folder vizdoom/scenarios.

Basic Doom game...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 3
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete