Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Python Machine Learning By Example
  • Toc
  • feedback
Python Machine Learning By Example

Python Machine Learning By Example

By : Yuxi (Hayden) Liu
4.9 (9)
close
Python Machine Learning By Example

Python Machine Learning By Example

4.9 (9)
By: Yuxi (Hayden) Liu

Overview of this book

The fourth edition of Python Machine Learning By Example is a comprehensive guide for beginners and experienced machine learning practitioners who want to learn more advanced techniques, such as multimodal modeling. Written by experienced machine learning author and ex-Google machine learning engineer Yuxi (Hayden) Liu, this edition emphasizes best practices, providing invaluable insights for machine learning engineers, data scientists, and analysts. Explore advanced techniques, including two new chapters on natural language processing transformers with BERT and GPT, and multimodal computer vision models with PyTorch and Hugging Face. You’ll learn key modeling techniques using practical examples, such as predicting stock prices and creating an image search engine. This hands-on machine learning book navigates through complex challenges, bridging the gap between theoretical understanding and practical application. Elevate your machine learning and deep learning expertise, tackle intricate problems, and unlock the potential of advanced techniques in machine learning with this authoritative guide.
Table of Contents (18 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Getting Started with Machine Learning and Python
Getting Started with Machine Learning and Python
An introduction to machine learning
Knowing the prerequisites
Getting started with three types of machine learning
Digging into the core of machine learning
Data preprocessing and feature engineering
Combining models
Installing software and setting up
Summary
Exercises
Join our book’s Discord space
2
Building a Movie Recommendation Engine with Naïve Bayes
Building a Movie Recommendation Engine with Naïve Bayes
Getting started with classification
Exploring Naïve Bayes
Implementing Naïve Bayes
Building a movie recommender with Naïve Bayes
Evaluating classification performance
Tuning models with cross-validation
Summary
Exercises
References
Join our book’s Discord space
3
Predicting Online Ad Click-Through with Tree-Based Algorithms
Predicting Online Ad Click-Through with Tree-Based Algorithms
A brief overview of ad click-through prediction
Getting started with two types of data – numerical and categorical
Exploring a decision tree from the root to the leaves
Implementing a decision tree from scratch
Implementing a decision tree with scikit-learn
Predicting ad click-through with a decision tree
Ensembling decision trees – random forests
Ensembling decision trees – gradient-boosted trees
Summary
Exercises
Join our book’s Discord space
4
Predicting Online Ad Click-Through with Logistic Regression
Predicting Online Ad Click-Through with Logistic Regression
Converting categorical features to numerical – one-hot encoding and ordinal encoding
Classifying data with logistic regression
Training a logistic regression model
Training on large datasets with online learning
Handling multiclass classification
Implementing logistic regression using TensorFlow
Summary
Exercises
Join our book’s Discord space
5
Predicting Stock Prices with Regression Algorithms
Predicting Stock Prices with Regression Algorithms
What is regression?
Mining stock price data
Getting started with feature engineering
Estimating with linear regression
Estimating with decision tree regression
Implementing a regression forest
Evaluating regression performance
Predicting stock prices with the three regression algorithms
Summary
Exercises
Join our book’s Discord space
6
Predicting Stock Prices with Artificial Neural Networks
Predicting Stock Prices with Artificial Neural Networks
Demystifying neural networks
Building neural networks
Picking the right activation functions
Preventing overfitting in neural networks
Predicting stock prices with neural networks
Summary
Exercises
Join our book’s Discord space
7
Mining the 20 Newsgroups Dataset with Text Analysis Techniques
Mining the 20 Newsgroups Dataset with Text Analysis Techniques
How computers understand language – NLP
Touring popular NLP libraries and picking up NLP basics
Getting the newsgroups data
Exploring the newsgroups data
Thinking about features for text data
Visualizing the newsgroups data with t-SNE
Summary
Exercises
Join our book’s Discord space
8
Discovering Underlying Topics in the Newsgroups Dataset with Clustering and Topic Modeling
Discovering Underlying Topics in the Newsgroups Dataset with Clustering and Topic Modeling
Learning without guidance – unsupervised learning
Getting started with k-means clustering
Clustering newsgroups dataset
Discovering underlying topics in newsgroups
Summary
Exercises
Join our book’s Discord space
9
Recognizing Faces with Support Vector Machine
Recognizing Faces with Support Vector Machine
Finding the separating boundary with SVM
Classifying face images with SVM
Estimating with support vector regression
Summary
Exercises
Join our book’s Discord space
10
Machine Learning Best Practices
Machine Learning Best Practices
Machine learning solution workflow
Best practices in the data preparation stage
Best practices in the training set generation stage
Best practices in the model training, evaluation, and selection stage
Best practices in the deployment and monitoring stage
Summary
Exercises
Join our book’s Discord space
11
Categorizing Images of Clothing with Convolutional Neural Networks
Categorizing Images of Clothing with Convolutional Neural Networks
Getting started with CNN building blocks
Architecting a CNN for classification
Exploring the clothing image dataset
Classifying clothing images with CNNs
Boosting the CNN classifier with data augmentation
Improving the clothing image classifier with data augmentation
Advancing the CNN classifier with transfer learning
Summary
Exercises
Join our book’s Discord space
12
Making Predictions with Sequences Using Recurrent Neural Networks
Making Predictions with Sequences Using Recurrent Neural Networks
Introducing sequential learning
Learning the RNN architecture by example
Training an RNN model
Overcoming long-term dependencies with LSTM
Analyzing movie review sentiment with RNNs
Revisiting stock price forecasting with LSTM
Writing your own War and Peace with RNNs
Summary
Exercises
Join our book’s Discord space
13
Advancing Language Understanding and Generation with the Transformer Models
chevron up
Advancing Language Understanding and Generation with the Transformer Models
Understanding self-attention
Exploring the Transformer’s architecture
Improving sentiment analysis with BERT and Transformers
Generating text using GPT
Summary
Exercises
Join our book’s Discord space
14
Building an Image Search Engine Using CLIP: a Multimodal Approach
Building an Image Search Engine Using CLIP: a Multimodal Approach
Introducing the CLIP model
Getting started with the dataset
Finding images with words
Summary
Exercises
References
Join our book’s Discord space
15
Making Decisions in Complex Environments with Reinforcement Learning
Making Decisions in Complex Environments with Reinforcement Learning
Setting up the working environment
Introducing OpenAI Gym and Gymnasium
Introducing reinforcement learning with examples
Solving the FrozenLake environment with dynamic programming
Performing Monte Carlo learning
Solving the Blackjack problem with the Q-learning algorithm
Summary
Exercises
Join our book’s Discord space
16
Other Books You May Enjoy
Other Books You May Enjoy
17
Index
Index

Exploring the Transformer’s architecture

The Transformer architecture was proposed as an alternative to RNNs for sequence-to-sequence tasks. It heavily relies on the self-attention mechanism to process both input and output sequences.

We’ll start by looking at the high-level architecture of the Transformer model (image based on that in the paper Attention Is All You Need, by Vaswani et al.):

Figure 13.1: Transformer architecture

As you can see, the Transformer consists of two parts: the encoder (the big rectangle on the left-hand side) and the decoder (the big rectangle on the right-hand side). The encoder encrypts the input sequence. It has a multi-head attention layer and a regular feedforward layer. On the other hand, the decoder generates the output sequence. It has a masked multi-head attention (we will talk about this in detail later) layer, along with a multi-head attention layer and a regular feedforward layer.

At step t, the Transformer...

End of Section 3
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete