Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Mastering pandas
  • Table Of Contents Toc
  • Feedback & Rating feedback
Mastering pandas

Mastering pandas

By : Kumar
Buy this Book
close
close
Mastering pandas

Mastering pandas

By: Kumar
Buy this Book

Overview of this book

pandas is a popular Python library used by data scientists and analysts worldwide to manipulate and analyze their data. This book presents useful data manipulation techniques in pandas to perform complex data analysis in various domains. An update to our highly successful previous edition with new features, examples, updated code, and more, this book is an in-depth guide to get the most out of pandas for data analysis. Designed for both intermediate users as well as seasoned practitioners, you will learn advanced data manipulation techniques, such as multi-indexing, modifying data structures, and sampling your data, which allow for powerful analysis and help you gain accurate insights from it. With the help of this book, you will apply pandas to different domains, such as Bayesian statistics, predictive analytics, and time series analysis using an example-based approach. And not just that; you will also learn how to prepare powerful, interactive business reports in pandas using the Jupyter notebook. By the end of this book, you will learn how to perform efficient data analysis using pandas on complex data, and become an expert data analyst or data scientist in the process.
Table of Contents (21 chapters)
close
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Overview of Data Analysis and pandas
Section 1: Overview of Data Analysis and pandas
2
Introduction to pandas and Data Analysis
chevron up
Introduction to pandas and Data Analysis
Motivation for data analysis
Data analytics pipeline
How Python and pandas fit into the data analytics pipeline
What is pandas?
Where does pandas fit in the pipeline?
Benefits of using pandas
History of pandas
Usage pattern and adoption of pandas
pandas on the technology adoption curve
Popular applications of pandas
Summary
References
3
Installation of pandas and Supporting Software
Installation of pandas and Supporting Software
Selecting a version of Python to use
Standalone Python installation
Installation of Python and pandas using Anaconda
Dependency packages for pandas
Review of items installed with Anaconda
Cross tooling – combining pandas awesomeness with R, Julia, H20.ai, and Azure ML Studio
Command line tricks for pandas
Options and settings for pandas
Summary
Further reading
4
Section 2: Data Structures and I/O in pandas
Section 2: Data Structures and I/O in pandas
5
Using NumPy and Data Structures with pandas
Using NumPy and Data Structures with pandas
NumPy ndarrays
Implementing neural networks with NumPy
Practical applications of multidimensional arrays
Data structures in pandas
Summary
References
6
I/Os of Different Data Formats with pandas
I/Os of Different Data Formats with pandas
Data sources and pandas methods
CSV and TXT
Excel
URL and S3
HTML
JSON
Reading HDF formats
Reading feather files
Reading parquet files
Reading a SQL file
Reading a SAS/Stata file
Reading from Google BigQuery
Reading from a clipboard
Managing sparse data
Writing JSON objects to a file
Serialization/deserialization
Writing to exotic file types
GeoPandas
Open source APIs – Quandl
Pandas plotting
pandas-datareader
Summary
7
Section 3: Mastering Different Data Operations in pandas
Section 3: Mastering Different Data Operations in pandas
8
Indexing and Selecting in pandas
Indexing and Selecting in pandas
Basic indexing
Labels, integer, and mixed indexing
Multi-indexing
Boolean indexing
Operations on indexes
Summary
9
Grouping, Merging, and Reshaping Data in pandas
Grouping, Merging, and Reshaping Data in pandas
Grouping data
Merging and joining
Pivots and reshaping data
Other methods for reshaping DataFrames
Summary
10
Special Data Operations in pandas
Special Data Operations in pandas
Writing and applying one-liner custom functions
Handling missing values
A survey of methods on series
pandas string methods
Binary operations on DataFrames and series
Binning values
Using mathematical methods on DataFrames
Summary
11
Time Series and Plotting Using Matplotlib
Time Series and Plotting Using Matplotlib
Handling time series data
A summary of time series-related objects
Plotting using matplotlib
Summary
12
Section 4: Going a Step Beyond with pandas
Section 4: Going a Step Beyond with pandas
13
Making Powerful Reports In Jupyter Using pandas
Making Powerful Reports In Jupyter Using pandas
pandas styling
Navigating Jupyter Notebook
Summary
14
A Tour of Statistics with pandas and NumPy
A Tour of Statistics with pandas and NumPy
Descriptive statistics versus inferential statistics
Measures of central tendency and variability
Hypothesis testing – the null and alternative hypotheses
Summary
15
A Brief Tour of Bayesian Statistics and Maximum Likelihood Estimates
A Brief Tour of Bayesian Statistics and Maximum Likelihood Estimates
Introduction to Bayesian statistics
The mathematical framework for Bayesian statistics
Probability distributions
Bayesian statistics versus frequentist statistics
Conducting Bayesian statistical analysis
Monte Carlo estimation of the likelihood function and PyMC
References
Summary
16
Data Case Studies Using pandas
Data Case Studies Using pandas
End-to-end exploratory data analysis
Web scraping with Python
Data validation
Summary
17
The pandas Library Architecture
The pandas Library Architecture
Understanding the pandas file hierarchy
Improving performance using Python extensions
Summary
18
pandas Compared with Other Tools
pandas Compared with Other Tools
Comparison with R
Slicing and selection
Comparison with SQL
Comparison with SAS
Summary
19
A Brief Tour of Machine Learning
A Brief Tour of Machine Learning
The role of pandas in machine learning
Installation of scikit-learn
Introduction to machine learning
Application of machine learning – Kaggle Titanic competition
Data analysis and preprocessing using pandas
A naive approach to the Titanic problem
The scikit-learn ML/classifier interface
Supervised learning algorithms
Unsupervised learning algorithms
Summary
20
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

Motivation for data analysis

In this section, we discuss the trends that are making data analysis an increasingly important field in today's fast-moving technological landscape.

We live in a big data world

The term big data has become one of the hottest technology buzzwords in the past two years. We now increasingly hear about big data in various media outlets, and big data start-ups have increasingly been attracting venture capital. A good example in the area of retail is Target Corporation, which has invested substantially in big data and is now able to identify potential customers by using big data to analyze people's shopping habits online; refer to a related article at http://nyti.ms/19LT8ic.

Loosely speaking...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 2
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY