Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Python Machine Learning By Example
  • Toc
  • feedback
Python Machine Learning By Example

Python Machine Learning By Example

By : Yuxi (Hayden) Liu
4.9 (9)
close
Python Machine Learning By Example

Python Machine Learning By Example

4.9 (9)
By: Yuxi (Hayden) Liu

Overview of this book

The fourth edition of Python Machine Learning By Example is a comprehensive guide for beginners and experienced machine learning practitioners who want to learn more advanced techniques, such as multimodal modeling. Written by experienced machine learning author and ex-Google machine learning engineer Yuxi (Hayden) Liu, this edition emphasizes best practices, providing invaluable insights for machine learning engineers, data scientists, and analysts. Explore advanced techniques, including two new chapters on natural language processing transformers with BERT and GPT, and multimodal computer vision models with PyTorch and Hugging Face. You’ll learn key modeling techniques using practical examples, such as predicting stock prices and creating an image search engine. This hands-on machine learning book navigates through complex challenges, bridging the gap between theoretical understanding and practical application. Elevate your machine learning and deep learning expertise, tackle intricate problems, and unlock the potential of advanced techniques in machine learning with this authoritative guide.
Table of Contents (18 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Getting Started with Machine Learning and Python
Getting Started with Machine Learning and Python
An introduction to machine learning
Knowing the prerequisites
Getting started with three types of machine learning
Digging into the core of machine learning
Data preprocessing and feature engineering
Combining models
Installing software and setting up
Summary
Exercises
Join our book’s Discord space
2
Building a Movie Recommendation Engine with Naïve Bayes
Building a Movie Recommendation Engine with Naïve Bayes
Getting started with classification
Exploring Naïve Bayes
Implementing Naïve Bayes
Building a movie recommender with Naïve Bayes
Evaluating classification performance
Tuning models with cross-validation
Summary
Exercises
References
Join our book’s Discord space
3
Predicting Online Ad Click-Through with Tree-Based Algorithms
Predicting Online Ad Click-Through with Tree-Based Algorithms
A brief overview of ad click-through prediction
Getting started with two types of data – numerical and categorical
Exploring a decision tree from the root to the leaves
Implementing a decision tree from scratch
Implementing a decision tree with scikit-learn
Predicting ad click-through with a decision tree
Ensembling decision trees – random forests
Ensembling decision trees – gradient-boosted trees
Summary
Exercises
Join our book’s Discord space
4
Predicting Online Ad Click-Through with Logistic Regression
Predicting Online Ad Click-Through with Logistic Regression
Converting categorical features to numerical – one-hot encoding and ordinal encoding
Classifying data with logistic regression
Training a logistic regression model
Training on large datasets with online learning
Handling multiclass classification
Implementing logistic regression using TensorFlow
Summary
Exercises
Join our book’s Discord space
5
Predicting Stock Prices with Regression Algorithms
Predicting Stock Prices with Regression Algorithms
What is regression?
Mining stock price data
Getting started with feature engineering
Estimating with linear regression
Estimating with decision tree regression
Implementing a regression forest
Evaluating regression performance
Predicting stock prices with the three regression algorithms
Summary
Exercises
Join our book’s Discord space
6
Predicting Stock Prices with Artificial Neural Networks
Predicting Stock Prices with Artificial Neural Networks
Demystifying neural networks
Building neural networks
Picking the right activation functions
Preventing overfitting in neural networks
Predicting stock prices with neural networks
Summary
Exercises
Join our book’s Discord space
7
Mining the 20 Newsgroups Dataset with Text Analysis Techniques
Mining the 20 Newsgroups Dataset with Text Analysis Techniques
How computers understand language – NLP
Touring popular NLP libraries and picking up NLP basics
Getting the newsgroups data
Exploring the newsgroups data
Thinking about features for text data
Visualizing the newsgroups data with t-SNE
Summary
Exercises
Join our book’s Discord space
8
Discovering Underlying Topics in the Newsgroups Dataset with Clustering and Topic Modeling
Discovering Underlying Topics in the Newsgroups Dataset with Clustering and Topic Modeling
Learning without guidance – unsupervised learning
Getting started with k-means clustering
Clustering newsgroups dataset
Discovering underlying topics in newsgroups
Summary
Exercises
Join our book’s Discord space
9
Recognizing Faces with Support Vector Machine
Recognizing Faces with Support Vector Machine
Finding the separating boundary with SVM
Classifying face images with SVM
Estimating with support vector regression
Summary
Exercises
Join our book’s Discord space
10
Machine Learning Best Practices
Machine Learning Best Practices
Machine learning solution workflow
Best practices in the data preparation stage
Best practices in the training set generation stage
Best practices in the model training, evaluation, and selection stage
Best practices in the deployment and monitoring stage
Summary
Exercises
Join our book’s Discord space
11
Categorizing Images of Clothing with Convolutional Neural Networks
Categorizing Images of Clothing with Convolutional Neural Networks
Getting started with CNN building blocks
Architecting a CNN for classification
Exploring the clothing image dataset
Classifying clothing images with CNNs
Boosting the CNN classifier with data augmentation
Improving the clothing image classifier with data augmentation
Advancing the CNN classifier with transfer learning
Summary
Exercises
Join our book’s Discord space
12
Making Predictions with Sequences Using Recurrent Neural Networks
chevron up
Making Predictions with Sequences Using Recurrent Neural Networks
Introducing sequential learning
Learning the RNN architecture by example
Training an RNN model
Overcoming long-term dependencies with LSTM
Analyzing movie review sentiment with RNNs
Revisiting stock price forecasting with LSTM
Writing your own War and Peace with RNNs
Summary
Exercises
Join our book’s Discord space
13
Advancing Language Understanding and Generation with the Transformer Models
Advancing Language Understanding and Generation with the Transformer Models
Understanding self-attention
Exploring the Transformer’s architecture
Improving sentiment analysis with BERT and Transformers
Generating text using GPT
Summary
Exercises
Join our book’s Discord space
14
Building an Image Search Engine Using CLIP: a Multimodal Approach
Building an Image Search Engine Using CLIP: a Multimodal Approach
Introducing the CLIP model
Getting started with the dataset
Finding images with words
Summary
Exercises
References
Join our book’s Discord space
15
Making Decisions in Complex Environments with Reinforcement Learning
Making Decisions in Complex Environments with Reinforcement Learning
Setting up the working environment
Introducing OpenAI Gym and Gymnasium
Introducing reinforcement learning with examples
Solving the FrozenLake environment with dynamic programming
Performing Monte Carlo learning
Solving the Blackjack problem with the Q-learning algorithm
Summary
Exercises
Join our book’s Discord space
16
Other Books You May Enjoy
Other Books You May Enjoy
17
Index
Index

Overcoming long-term dependencies with LSTM

Let’s start with the vanishing gradient issue in vanilla RNNs. Where does it come from? Recall that during backpropagation, the gradient decays along with each time step in the RNN (that is, st=a(Uxt+Wst-1); early elements in a long input sequence will have little contribution to the computation of the current gradient. This means that vanilla RNNs can only capture the temporal dependencies within a short time window. However, dependencies between time steps that are far away are sometimes critical signals to the prediction. RNN variants, including LSTM and gated recurrent units (GRUs), are specifically designed to solve problems that require learning long-term dependencies.

We will be focusing on LSTM in this book as it is a lot more popular than GRU. LSTM was introduced a decade earlier and is more mature than GRU. If you are interested in learning more about GRU and its applications, feel free to check out Hands-On Deep...

End of Section 5
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete