Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Hands-On Data Analysis with Pandas
  • Toc
  • feedback
Hands-On Data Analysis with Pandas

Hands-On Data Analysis with Pandas

By : Stefanie Molin
4.7 (11)
close
Hands-On Data Analysis with Pandas

Hands-On Data Analysis with Pandas

4.7 (11)
By: Stefanie Molin

Overview of this book

Data analysis has become a necessary skill in a variety of domains where knowing how to work with data and extract insights can generate significant value. Hands-On Data Analysis with Pandas will show you how to analyze your data, get started with machine learning, and work effectively with Python libraries often used for data science, such as pandas, NumPy, matplotlib, seaborn, and scikit-learn. Using real-world datasets, you will learn how to use the powerful pandas library to perform data wrangling to reshape, clean, and aggregate your data. Then, you will be able to conduct exploratory data analysis by calculating summary statistics and visualizing the data to find patterns. In the concluding chapters, you will explore some applications of anomaly detection, regression, clustering, and classification using scikit-learn to make predictions based on past data. By the end of this book, you will be equipped with the skills you need to use pandas to ensure the veracity of your data, visualize it for effective decision-making, and reliably reproduce analyses across multiple datasets.
Table of Contents (21 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Conventions used
Get in touch
Free Chapter
1
Section 1: Getting Started with Pandas
Section 1: Getting Started with Pandas
2
Introduction to Data Analysis
chevron up
Introduction to Data Analysis
Chapter materials
Fundamentals of data analysis
Statistical foundations
Setting up a virtual environment
Summary
Exercises
Further reading
3
Working with Pandas DataFrames
Working with Pandas DataFrames
Chapter materials
Pandas data structures
Bringing data into a pandas DataFrame
Inspecting a DataFrame object
Grabbing subsets of the data
Adding and removing data
Summary
Exercises
Further reading
4
Section 2: Using Pandas for Data Analysis
Section 2: Using Pandas for Data Analysis
5
Data Wrangling with Pandas
Data Wrangling with Pandas
Chapter materials
What is data wrangling?
Collecting temperature data
Cleaning up the data
Restructuring the data
Handling duplicate, missing, or invalid data
Summary
Exercises
Further reading
6
Aggregating Pandas DataFrames
Aggregating Pandas DataFrames
Chapter materials
Database-style operations on DataFrames
DataFrame operations
Aggregations with pandas and numpy
Time series
Summary
Exercises
Further reading
7
Visualizing Data with Pandas and Matplotlib
Visualizing Data with Pandas and Matplotlib
Chapter materials
An introduction to matplotlib
Plotting with pandas
The pandas.plotting subpackage
Summary
Exercises
Further reading
8
Plotting with Seaborn and Customization Techniques
Plotting with Seaborn and Customization Techniques
Chapter materials
Utilizing seaborn for advanced plotting
Formatting
Customizing visualizations
Summary
Exercises
Further reading
9
Section 3: Applications - Real-World Analyses Using Pandas
Section 3: Applications - Real-World Analyses Using Pandas
10
Financial Analysis - Bitcoin and the Stock Market
Financial Analysis - Bitcoin and the Stock Market
Chapter materials
Building a Python package
Data extraction with pandas
Exploratory data analysis
Technical analysis of financial instruments
Modeling performance
Summary
Exercises
Further reading
11
Rule-Based Anomaly Detection
Rule-Based Anomaly Detection
Chapter materials
Simulating login attempts
Exploratory data analysis
Rule-based anomaly detection
Summary
Exercises
Further reading
12
Section 4: Introduction to Machine Learning with Scikit-Learn
Section 4: Introduction to Machine Learning with Scikit-Learn
13
Getting Started with Machine Learning in Python
Getting Started with Machine Learning in Python
Chapter materials
Learning the lingo
Exploratory data analysis
Preprocessing data
Clustering
Regression
Classification
Summary
Exercises
Further reading
14
Making Better Predictions - Optimizing Models
Making Better Predictions - Optimizing Models
Chapter materials
Hyperparameter tuning with grid search
Feature engineering
Ensemble methods
Inspecting classification prediction confidence
Addressing class imbalance
Regularization
Summary
Exercises
Further reading
15
Machine Learning Anomaly Detection
Machine Learning Anomaly Detection
Chapter materials
Exploring the data
Unsupervised methods
Supervised methods
Online learning
Summary
Exercises
Further reading
16
Section 5: Additional Resources
Section 5: Additional Resources
17
The Road Ahead
The Road Ahead
Data resources
Practicing working with data
Python practice
Summary
Exercises
Further reading
18
Solutions
Solutions
19
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Appendix
Appendix
Data analysis workflow
Choosing the appropriate visualization
Machine learning workflow

Exercises

Run through the introduction_to_data_analysis.ipynb notebook for a review of this chapter's content, and then complete the following exercises to practice working with JupyterLab and calculating summary statistics in Python:

  1. Explore the JupyterLab interface and look at some of the shortcuts that are available. Don't worry about memorizing them for now (eventually, they will become second nature and save you a lot of time)—just get comfortable using Jupyter Notebooks.
  2. Is all data normally distributed? Explain why or why not.
  1. When would it make more sense to use the median instead of the mean for the measure of center?
  2. Run the code in the first cell of the exercises.ipynb notebook. It will give you a list of 100 values to work with for the rest of the exercises in this chapter.
  3. Using the data from exercise #4, calculate the following statistics without...
End of Section 7
Next Section
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete