The Foundation of Self-Driving Cars | Applied Deep Learning and Computer Vision for Self-Driving Cars

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Applied Deep Learning and Computer Vision for Self-Driving Cars

By : Sumit Ranjan, Dr. S. Senthamilarasu

4.3 (9)

Applied Deep Learning and Computer Vision for Self-Driving Cars

4.3 (9)

By: Sumit Ranjan, Dr. S. Senthamilarasu

Overview of this book

Thanks to a number of recent breakthroughs, self-driving car technology is now an emerging subject in the field of artificial intelligence and has shifted data scientists' focus to building autonomous cars that will transform the automotive industry. This book is a comprehensive guide to use deep learning and computer vision techniques to develop autonomous cars. Starting with the basics of self-driving cars (SDCs), this book will take you through the deep neural network techniques required to get up and running with building your autonomous vehicle. Once you are comfortable with the basics, you'll delve into advanced computer vision techniques and learn how to use deep learning methods to perform a variety of computer vision tasks such as finding lane lines, improving image classification, and so on. You will explore the basic structure and working of a semantic segmentation model and get to grips with detecting cars using semantic segmentation. The book also covers advanced applications such as behavior-cloning and vehicle detection using OpenCV, transfer learning, and deep learning methodologies to train SDCs to mimic human driving. By the end of this book, you'll have learned how to implement a variety of neural networks to develop your own autonomous vehicle using modern Python libraries.

Preface

Preface

Who this book is for

What this book covers

To get the most out of this book

Download the example code files

Download the color images

Conventions used

Get in touch

Reviews

Section 1: Deep Learning Foundation and SDC Basics

Section 1: Deep Learning Foundation and SDC Basics

Free Chapter

The Foundation of Self-Driving Cars

The Foundation of Self-Driving Cars

Introduction to SDCs

Benefits of SDCs

Advancements in SDCs

Challenges in current deployments

Building safe systems

The cheapest computer and hardware

Software programming

Fast internet

Levels of autonomy

Level 0 – manual cars

Level 1 – driver support

Level 2 – partial automation

Level 3 – conditional automation

Level 4 – high automation

Level 5 – complete automation

Deep learning and computer vision approaches for SDCs

LIDAR and computer vision for SDC vision

Summary

Dive Deep into Deep Neural Networks

Dive Deep into Deep Neural Networks

Diving deep into neural networks

Introduction to neurons

Understanding neurons and perceptrons

The workings of ANNs

Understanding activation functions

The threshold function

The sigmoid function

The rectifier linear function

The hyperbolic tangent activation function

The cost function of neural networks

Optimizers

Understanding hyperparameters

Model training-specific hyperparameters

Learning rate

Batch size

Number of epochs

Network architecture-specific hyperparameters

Number of hidden layers

Regularization

L1 and L2 regularization

Dropout

Activation functions as hyperparameters

TensorFlow versus Keras

Summary

Implementing a Deep Learning Model Using Keras

Implementing a Deep Learning Model Using Keras

Starting work with Keras

Advantages of Keras

The working principle behind Keras

Building Keras models

The sequential model

The functional model

Types of Keras execution

Keras for deep learning

Building your first deep learning model

Description of the Auto-Mpg dataset

Importing the data

Splitting the data

Standardizing the data

Building and compiling the model

Training the model

Predicting new, unseen data

Evaluating the model's performance

Saving and loading models

Summary

Section 2: Deep Learning and Computer Vision Techniques for SDC

Section 2: Deep Learning and Computer Vision Techniques for SDC

Computer Vision for Self-Driving Cars

Computer Vision for Self-Driving Cars

Introduction to computer vision

Challenges in computer vision

Artificial eyes versus human eyes

Building blocks of an image

Digital representation of an image

Converting images from RGB to grayscale

Road-marking detection

Detection with the grayscale image

Detection with the RGB image

Challenges in color selection techniques

Color space techniques

Introducing the RGB space

HSV space

Color space manipulation

Introduction to convolution

Sharpening and blurring

Edge detection and gradient calculation

Introducing Sobel

Introducing the Laplacian edge detector

Canny edge detection

Image transformation

Affine transformation

Projective transformation

Image rotation

Image translation

Image resizing

Perspective transformation

Cropping, dilating, and eroding an image

Masking regions of interest

The Hough transform

Summary

Finding Road Markings Using OpenCV

Finding Road Markings Using OpenCV

Finding road markings in an image

Loading the image using OpenCV

Converting the image into grayscale

Smoothing the image

Canny edge detection

Masking the region of interest

Applying bitwise_and

Applying the Hough transform

Optimizing the detected road markings

Detecting road markings in a video

Summary

Improving the Image Classifier with CNN

Improving the Image Classifier with CNN

Images in computer format

The need for CNNs

The intuition behind CNNs

Introducing CNNs

Why 3D layers?

Understanding the convolution layer

Depth, stride, and padding

Depth

Stride

Zero-padding

ReLU

Fully connected layers

The softmax function

Introduction to handwritten digit recognition

Problem and aim

Loading the data

Reshaping the data

The transformation of data

One-hot encoding the output

Building and compiling our model

Compiling the model

Training the model

Validation versus train loss

Validation versus test accuracy

Saving the model

Visualizing the model architecture

Confusion matrix

The accuracy report

Summary

Road Sign Detection Using Deep Learning

Road Sign Detection Using Deep Learning

Dataset overview

Dataset structure

Image format

Loading the data

Image exploration

Data preparation

Model training

Model accuracy

Summary

Section 3: Semantic Segmentation for Self-Driving Cars

Section 3: Semantic Segmentation for Self-Driving Cars

The Principles and Foundations of Semantic Segmentation

The Principles and Foundations of Semantic Segmentation

Introduction to semantic segmentation

Understanding the semantic segmentation architecture

Overview of different semantic segmentation architectures

U-Net

SegNet

Encoder

Decoder

PSPNet

DeepLabv3+

E-Net

Summary

Implementing Semantic Segmentation

Implementing Semantic Segmentation

Semantic segmentation in images

Semantic segmentation in videos

Summary

Section 4: Advanced Implementations

Section 4: Advanced Implementations

Behavioral Cloning Using Deep Learning

Behavioral Cloning Using Deep Learning

Neural network for regression

Behavior cloning using deep learning

Data collection

Data preparation

Model development

Evaluating the simulator

Summary

Vehicle Detection Using OpenCV and Deep Learning

Vehicle Detection Using OpenCV and Deep Learning

What makes YOLO different?

The YOLO loss function

The YOLO architecture

Fast YOLO

YOLO v2

YOLO v3

Implementation of YOLO object detection

Importing the libraries

Processing the image function

The get class function

Draw box function

Detect image function

Detect video function

Importing YOLO

Detecting objects in images

Detecting objects in videos

Summary

Next Steps

Next Steps

SDC sensors

Camera

RADAR

Ultrasonic sensors

Odometric sensors

LIDAR

Introduction to sensor fusion

Kalman filter

Summary

Other Books You May Enjoy

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

4.3 (9)

5 star

55.6%

4 star

33.3%

3 star

0

2 star

11.1%

1 star

0

The Foundation of Self-Driving Cars

The driverless car is popularly known as an self-driving car (SDC), an autonomous vehicle, or a robot car. The purpose of an autonomous car is to drive automatically without a driver. The SDC is the sleeping giant that might improve everything from road safety to universal mobility, while dramatically reducing the costs of driving. According to McKinsey & Company, the widespread use of robotic cars in the US could save up to $180 billion annually in healthcare and automotive maintenance alone based on a realistic estimate of a 90% reduction in crash rates.

Although self-driving automotive technologies have been in development for many decades, it is only in recent years that breakthroughs have been achieved. SDCs have proved to be much safer than human drivers, and automotive firms as well as other tech firms are investing billions in bringing this technology into the real world. They struggle to find great engineers to contribute to the field. This book will teach you what you need to know to kick-start a career in the autonomous driving industry. Whether you're coming from academia, or from within the industry, this book will provide you with the foundational knowledge and practical skills you will need to help build a future with Advanced Driver-Assistance Systems (ADAS) engineers or SDC engineers. Throughout this book, you will study real-world data and scenarios from recent research in autonomous cars.

This book can also help you learn and implement the state-of-the-art technologies for computer vision that are currently used in the automotive industry in the real world. By the end of this book, you will be familiar with different deep learning and computer vision techniques for SDCs. We'll finish this book off with six projects that will give you a detailed insight into various real-world issues that are important to SDC engineers.

In this chapter, we will cover the following topics:

Introduction to SDCs
Advancement in SDCs
Levels of autonomy
Deep learning and computer vision approaches for SDCs

Let's get started!

Search

Your notes and bookmarks