Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • The Pandas Workshop
  • Toc
  • feedback
The Pandas Workshop

The Pandas Workshop

By : Blaine Bateman, Saikat Basak , Thomas Joseph, William So
4.8 (16)
close
The Pandas Workshop

The Pandas Workshop

4.8 (16)
By: Blaine Bateman, Saikat Basak , Thomas Joseph, William So

Overview of this book

The Pandas Workshop will teach you how to be more productive with data and generate real business insights to inform your decision-making. You will be guided through real-world data science problems and shown how to apply key techniques in the context of realistic examples and exercises. Engaging activities will then challenge you to apply your new skills in a way that prepares you for real data science projects. You’ll see how experienced data scientists tackle a wide range of problems using data analysis with pandas. Unlike other Python books, which focus on theory and spend too long on dry, technical explanations, this workshop is designed to quickly get you to write clean code and build your understanding through hands-on practice. As you work through this Python pandas book, you’ll tackle various real-world scenarios, such as using an air quality dataset to understand the pattern of nitrogen dioxide emissions in a city, as well as analyzing transportation data to improve bus transportation services. By the end of this data analytics book, you’ll have the knowledge, skills, and confidence you need to solve your own challenging data science problems with pandas.
Table of Contents (21 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Download the example code files
Download the color images
Conventions used
Get in touch
Share Your Thoughts
1
Part 1 – Introduction to pandas
Part 1 – Introduction to pandas
Free Chapter
2
Chapter 1: Introduction to pandas
chevron up
Chapter 1: Introduction to pandas
Introduction to the world of pandas
Exploring the history and evolution of pandas
Components and applications of pandas
Understanding the basic concepts of pandas
Activity 1.01 – comparing sales data for two stores
Summary
3
Chapter 2: Working with Data Structures
Chapter 2: Working with Data Structures
Introduction to data structures
The need for data structures
Indexes and columns
Series
Activity 2.01 – Working with pandas data structures
Summary
4
Chapter 3: Data I/O
Chapter 3: Data I/O
The world of data
Exploring data sources
Fundamental formats
Additional text formats
Manipulating SQL data
Activity 3.01 – using SQL data for pandas analytics
Summary
5
Chapter 4: Pandas Data Types
Chapter 4: Pandas Data Types
Introducing pandas dtypes
Missing data types
Activity 4.01 – optimizing memory usage by converting into the appropriate dtypes
Subsetting by data types
Summary
6
Part 2 – Working with Data
Part 2 – Working with Data
7
Chapter 5: Data Selection – DataFrames
Chapter 5: Data Selection – DataFrames
Introduction to DataFrames
Data selection in pandas DataFrames
Activity 5.01 – Creating a multi-index from columns
Bracket and dot notation
Changing DataFrame values using bracket or dot notation
Summary
8
Chapter 6: Data Selection – Series
Chapter 6: Data Selection – Series
Introduction to pandas Series
The Series index
Preparing Series from DataFrames and vice versa
Activity 6.01 – Series data selection
Understanding the differences between base Python and pandas data selection
Activity 6.02 – DataFrame data selection
Summary
9
Chapter 7: Data Exploration and Transformation
Chapter 7: Data Exploration and Transformation
Introduction to data transformation
Dealing with messy data
Dealing with missing data
Summarizing data
Activity 7.01 – data analysis using pivot tables
Summary
10
Chapter 8: Understanding Data Visualization
Chapter 8: Understanding Data Visualization
Introduction to data visualization
Understanding the basics of pandas visualization
Exploring matplotlib
Visualizing data of different types
Activity 8.01 – Using data visualization for exploratory data analysis
Summary
11
Part 3 – Data Modeling
Part 3 – Data Modeling
12
Chapter 9: Data Modeling – Preprocessing
Chapter 9: Data Modeling – Preprocessing
An introduction to data modeling
Exploring dependent and independent variables
Understanding data scaling and normalization
Activity 9.01 – Data splitting, scaling, and modeling
Summary
13
Chapter 10: Data Modeling – Modeling Basics
Chapter 10: Data Modeling – Modeling Basics
Introduction to data modeling
Learning the modeling basics
Predicting future values of time series
Activity 10.01 – Normalizing and smoothing data
Summary
14
Chapter 11: Data Modeling – Regression Modeling
Chapter 11: Data Modeling – Regression Modeling
An introduction to regression modeling
Exploring regression modeling
Model diagnostics
Activity 11.01 – Multiple regression with non-linear models
Summary
15
Part 4 – Additional Use Cases for pandas
Part 4 – Additional Use Cases for pandas
16
Chapter 12: Using Time in pandas
Chapter 12: Using Time in pandas
Introduction to time series
What are datetimes?
Activity 12.01 – understanding power usage
Datetime math operations
Summary
17
Chapter 13: Exploring Time Series
Chapter 13: Exploring Time Series
The time series as an index
Resampling, grouping, and aggregation by time
Activity 13.01 – Creating a time series model
Summary
18
Chapter 14: Applying pandas Data Processing for Case Studies
Chapter 14: Applying pandas Data Processing for Case Studies
Introduction to the case studies and datasets
Recap of the preprocessing steps
Activity 14.01 – analyzing air quality data
Summary
19
Chapter 15: Appendix
Solution 1.1
Solution 2.1
Solution 3.1
Solution 4.1
Solution 5.1
Solution 6.1
Solution 6.2
Solution 7.1
Solution 8.1
Solution 9.1
Solution 10.1
Solution 11.1
Solution 12.1
Solution 13.1
Solution 14.1
Why subscribe?
20
Other Books You May Enjoy
Other Books You May Enjoy
Packt is searching for authors like you
Share Your Thoughts

Exploring the history and evolution of pandas

pandas, in its basic version, was open sourced in 2009 by Wes McKinney, an MIT graduate with experience in quantitative finance. He was unhappy with the tools available at the time, so he started building a tool that was intuitive and elegant and required minimal code. pandas went on to become one of the most popular tools in the data science community, so much so that it even helped increase Python's popularity to a great extent.

One of the primary reasons for the popularity of pandas is its ability to handle different types of data. pandas is well suited for handling the following:

  • Tabular data with columns that are capable of storing different types of data (such as numerical data and text data)
  • Ordered and unordered series data (an arbitrary sequence of numbers in a list, such as [2,4,8,9,10])
  • Multi-dimensional matrix data (three-dimensional, four-dimensional, and so on)
  • Any other form of observational/statistical data (such as SQL data and R data)

Besides this, a large repertoire of intuitive and easy-to-use functions/methods makes pandas the go-to tool for data analytics. In the next section, we'll cover the components of pandas and their main applications.

End of Section 3
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete