- Why do we choose to use the words state and observation interchangeably? When would be a more appropriate time to use the word state?
- How do we know when the Q-function has converged?
- What happens to the Q-table when the Q-function has converged?
- When do we know the agent has found the optimal path to the goal? Describe in terms of the previous two questions.
- What does numpy.argmax() return?
- What does numpy.max() return?
- Why does the randomly-acting agent take thousands of time steps to reach the goal? How does the Q-learning agent perform better?
- Describe one benefit of decaying alpha.
- What is overfitting and how does it apply in the context of an RL model?
- By what order of magnitude does the number of time steps needed to reach the goal reduce when the number of training episodes is multiplied by 10? Give a general response to this; there may be multiple valid...
Hands-On Q-Learning with Python
By :
Hands-On Q-Learning with Python
By:
Overview of this book
Q-learning is a machine learning algorithm used to solve optimization problems in artificial intelligence (AI). It is one of the most popular fields of study among AI researchers.
This book starts off by introducing you to reinforcement learning and Q-learning, in addition to helping you become familiar with OpenAI Gym as well as libraries such as Keras and TensorFlow. A few chapters into the book, you will gain insights into model-free Q-learning and use deep Q-networks and double deep Q-networks to solve complex problems. This book will guide you in exploring use cases such as self-driving vehicles and OpenAI Gym’s CartPole problem. You will also learn how to tune and optimize Q-networks and their hyperparameters. As you progress, you will understand the reinforcement learning approach to solving real-world problems. You will also explore how to use Q-learning and related algorithms in scientific research. Toward the end, you’ll gain insight into what’s in store for reinforcement learning.
By the end of this book, you will be equipped with the skills you need to solve reinforcement learning problems using Q-learning algorithms with OpenAI Gym, Keras, and TensorFlow.
Table of Contents (14 chapters)
Preface
Brushing Up on Reinforcement Learning Concepts
Getting Started with the Q-Learning Algorithm
Setting Up Your First Environment with OpenAI Gym
Teaching a Smartcab to Drive Using Q-Learning
Section 2: Building and Optimizing Q-Learning Agents
Building Q-Networks with TensorFlow
Digging Deeper into Deep Q-Networks with Keras and TensorFlow
Section 3: Advanced Q-Learning Challenges with Keras, TensorFlow, and OpenAI Gym
Decoupling Exploration and Exploitation in Multi-Armed Bandits
Further Q-Learning Research and Future Projects
Assessments
Other Books You May Enjoy
How would like to rate this book
Customer Reviews
