There are a number of text conventions used throughout this book.
CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "The three functions make_atari, wrap_deepmind, and wrap_pytorch are all located in the new wrappers.py file we imported earlier."
A block of code is set as follows:
env_id = 'PongNoFrameskip-v4'
env = make_atari(env_id)
env = wrap_deepmind(env)
env = wrap_pytorch(env)
When we wish to draw your attention to a particular part of a code block, the relevant lines or items are set in bold:
epsilon_start = 1.0
epsilon_final = 0.01
epsilon_decay = 30000
epsilon_by_episode = lambda episode: epsilon_final + (epsilon_start - epsilon_final) * math.exp(-1. * episode / epsilon_decay)
plt.plot([epsilon_by_episode(i) for i in range(1000000)])
plt.show()
Any command-line input or output is written as follows:
pip install mujoco
Bold: Indicates a new term, an important word, or words that you see onscreen. For example, words in menus or dialog boxes appear in the text like this. Here is an example: "Building on that, we'll look at a variant of the DQN called the DDQN, or double (dueling) DQN."
Warnings or important notes appear like this.
Tips and tricks appear like this.