Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Scala for Machine Learning
  • Toc
  • feedback
Scala for Machine Learning

Scala for Machine Learning

By : R. Nicolas
3.8 (12)
close
Scala for Machine Learning

Scala for Machine Learning

3.8 (12)
By: R. Nicolas

Overview of this book

Are you curious about AI? All you need is a good understanding of the Scala programming language, a basic knowledge of statistics, a keen interest in Big Data processing, and this book!
Table of Contents (15 chapters)
close
close
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Free Chapter
1
1. Getting Started
1. Getting Started
Mathematical notation for the curious
Why machine learning?
Why Scala?
Model categorization
Taxonomy of machine learning algorithms
Tools and frameworks
Source code
Let's kick the tires
Summary
2
2. Hello World!
2. Hello World!
Modeling
Designing a workflow
Assessing a model
Summary
3
3. Data Preprocessing
3. Data Preprocessing
Time series
Moving averages
Fourier analysis
The Kalman filter
Alternative preprocessing techniques
Summary
4
4. Unsupervised Learning
4. Unsupervised Learning
Clustering
Dimension reduction
Performance considerations
Summary
5
5. Naïve Bayes Classifiers
5. Naïve Bayes Classifiers
Probabilistic graphical models
Naïve Bayes classifiers
Multivariate Bernoulli classification
Naïve Bayes and text mining
Pros and cons
Summary
6
6. Regression and Regularization
6. Regression and Regularization
Linear regression
Regularization
Numerical optimization
The logistic regression
Summary
7
7. Sequential Data Models
7. Sequential Data Models
Markov decision processes
The hidden Markov model (HMM)
Conditional random fields
CRF and text analytics
Comparing CRF and HMM
Performance consideration
Summary
8
8. Kernel Models and Support Vector Machines
8. Kernel Models and Support Vector Machines
Kernel functions
The support vector machine (SVM)
Support vector classifier (SVC)
Anomaly detection with one-class SVC
Support vector regression (SVR)
Performance considerations
Summary
9
9. Artificial Neural Networks
9. Artificial Neural Networks
Feed-forward neural networks (FFNN)
The multilayer perceptron (MLP)
Evaluation
Benefits and limitations
Summary
10
10. Genetic Algorithms
10. Genetic Algorithms
Evolution
Genetic algorithms and machine learning
Genetic algorithm components
Implementation
GA for trading strategies
Advantages and risks of genetic algorithms
Summary
11
11. Reinforcement Learning
chevron up
11. Reinforcement Learning
Introduction
Learning classifier systems
Summary
12
12. Scalable Frameworks
12. Scalable Frameworks
Overview
Scala
Scalability with Actors
Akka
Apache Spark
Summary
13
A. Basic Concepts
A. Basic Concepts
Scala programming
Mathematics
Finances 101
Suggested online courses
References
14
Index
Index

Chapter 11. Reinforcement Learning

This chapter presents the concept of reinforcement learning, which is widely used in gaming and robotics. The second part of this chapter is dedicated to learning classifier systems, which combine reinforcement learning techniques with evolutionary computing introduced in the previous chapter. Learning classifiers are an interesting breed of algorithms that are not commonly included in literature dedicated to machine learning. I highly recommend you to read the seminal book on reinforcement learning by R. Sutton and A. Barto [11:1] if you are interested to know about the origin, purpose, and scientific foundation of reinforcement learning.

In this chapter, you will learn the following:

  • Basic concepts behind reinforcement learning
  • Detailed implementation of the Q-learning algorithm
  • A simple approach to manage and balance an investment portfolio using reinforcement learning
  • An introduction to learning classifier systems
  • A simple implementation of extended...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 1
Next Section
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete