Bayesian Analysis with Python

By : Osvaldo Martin

3.2 (17)

Buy this Book

Bayesian Analysis with Python

3.2 (17)

By: Osvaldo Martin

Buy this Book

Overview of this book

The second edition of Bayesian Analysis with Python is an introduction to the main concepts of applied Bayesian inference and its practical implementation in Python using PyMC3, a state-of-the-art probabilistic programming library, and ArviZ, a new library for exploratory analysis of Bayesian models. The main concepts of Bayesian statistics are covered using a practical and computational approach. Synthetic and real data sets are used to introduce several types of models, such as generalized linear models for regression and classification, mixture models, hierarchical models, and Gaussian processes, among others. By the end of the book, you will have a working knowledge of probabilistic modeling and you will be able to design and implement Bayesian models for your own data science problems. After reading the book you will be better prepared to delve into more advanced material or specialized statistical modeling if you need to.

Preface

Who this book is for

What this book covers

To get the most out of this book

Get in touch

Free Chapter

Thinking Probabilistically

Statistics, models, and this book's approach

Probability theory

Single-parameter inference

Communicating a Bayesian analysis

Posterior predictive checks

Summary

Exercises

Programming Probabilistically

Probabilistic programming

PyMC3 primer

Summarizing the posterior

Gaussians all the way down

Groups comparison

Hierarchical models

Summary

Exercises

Modeling with Linear Regression

Simple linear regression

Robust linear regression

Hierarchical linear regression

Polynomial regression

Multiple linear regression

Variable variance

Summary

Exercises

Generalizing Linear Models

Generalized linear models

Logistic regression

Multiple logistic regression

Poisson regression

Robust logistic regression

The GLM module

Summary

Exercises

Model Comparison

Posterior predictive checks

Occam's razor – simplicity and accuracy

Information criteria

Bayes factors

Regularizing priors

WAIC in depth

Summary

Exercises

Mixture Models

Mixture models

Finite mixture models

Non-finite mixture model

Continuous mixtures

Summary

Exercises

Gaussian Processes

Linear models and non-linear data

Modeling functions

Gaussian process regression

Regression with spatial autocorrelation

Gaussian process classification

Cox processes

Summary

Exercises

Inference Engines

Inference engines

Non-Markovian methods

Markovian methods

Diagnosing the samples

Summary

Exercises

Where To Go Next?

Other Books You May Enjoy

Leave a review - let other readers know what you think

Customer Reviews

3.2 (17)

5 star

41.2%

4 star

5.9%

3 star

5.9%

2 star

23.5%

1 star

23.5%

Exercises

Check the following definition of a probabilistic model. Identify the likelihood, the prior, and the posterior:

For the model in exercise 1, how many parameters have the posterior? In other words, how many dimensions does it have?
Write down Bayes' theorem for the model in exercise 1.

Check the following model. Identify the linear model and identify the likelihood. How many parameters does the posterior have?

For the model in exercise 1, assume that you have a dataset with 57 data points coming from a Gaussian with a mean of 4 and a standard deviation of 0.5. Using PyMC3, compute:
- The posterior distribution
- The prior distribution
- The posterior predictive distribution
- The prior predictive distribution

Tip: Besides pm.sample(), PyMC3 has other functions to compute samples.