Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Hands-On Exploratory Data Analysis with Python
  • Toc
  • feedback
Hands-On Exploratory Data Analysis with Python

Hands-On Exploratory Data Analysis with Python

By : Kumar Mukhiya, Ahmed
2.5 (2)
close
Hands-On Exploratory Data Analysis with Python

Hands-On Exploratory Data Analysis with Python

2.5 (2)
By: Kumar Mukhiya, Ahmed

Overview of this book

Exploratory Data Analysis (EDA) is an approach to data analysis that involves the application of diverse techniques to gain insights into a dataset. This book will help you gain practical knowledge of the main pillars of EDA - data cleaning, data preparation, data exploration, and data visualization. You’ll start by performing EDA using open source datasets and perform simple to advanced analyses to turn data into meaningful insights. You’ll then learn various descriptive statistical techniques to describe the basic characteristics of data and progress to performing EDA on time-series data. As you advance, you’ll learn how to implement EDA techniques for model development and evaluation and build predictive models to visualize results. Using Python for data analysis, you’ll work with real-world datasets, understand data, summarize its characteristics, and visualize it for business intelligence. By the end of this EDA book, you’ll have developed the skills required to carry out a preliminary investigation on any dataset, yield insights into data, present your results with visual aids, and build a model that correctly predicts future outcomes.
Table of Contents (17 chapters)
close
close
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
1
Section 1: The Fundamentals of EDA
Section 1: The Fundamentals of EDA
Free Chapter
2
Exploratory Data Analysis Fundamentals
Exploratory Data Analysis Fundamentals
Understanding data science
The significance of EDA
Making sense of data
Comparing EDA with classical and Bayesian analysis
Software tools available for EDA
Getting started with EDA
Summary
Further reading
3
Visual Aids for EDA
Visual Aids for EDA
Technical requirements
Line chart
Bar charts
Scatter plot
Area plot and stacked plot
Pie chart
Table chart
Polar chart
Histogram
Lollipop chart
Choosing the best chart
Other libraries to explore
Summary
Further reading
4
EDA with Personal Email
chevron up
EDA with Personal Email
Technical requirements
Loading the dataset
Data transformation
Data analysis
Summary
Further reading
5
Data Transformation
Data Transformation
Technical requirements
Background
Merging database-style dataframes
Transformation techniques
Benefits of data transformation
Summary
Further reading
6
Section 2: Descriptive Statistics
Section 2: Descriptive Statistics
7
Descriptive Statistics
Descriptive Statistics
Technical requirements
Understanding statistics
Measures of central tendency
Measures of dispersion
Summary
Further reading
8
Grouping Datasets
Grouping Datasets
Technical requirements
Understanding groupby()
Groupby mechanics
Data aggregation
Pivot tables and cross-tabulations
Summary
Further reading
9
Correlation
Correlation
Technical requirements
Introducing correlation
Types of analysis
Discussing multivariate analysis using the Titanic dataset
Outlining Simpson's paradox
Correlation does not imply causation
Summary
Further reading
10
Time Series Analysis
Time Series Analysis
Technical requirements
Understanding the time series dataset
TSA with Open Power System Data
Summary
Further reading
11
Section 3: Model Development and Evaluation
Section 3: Model Development and Evaluation
12
Hypothesis Testing and Regression
Hypothesis Testing and Regression
Technical requirements
Hypothesis testing
p-hacking
Understanding regression
Model development and evaluation
Summary
Further reading
13
Model Development and Evaluation
Model Development and Evaluation
Technical requirements
Types of machine learning
Understanding supervised learning
Understanding unsupervised learning
Understanding reinforcement learning
Unified machine learning workflow
Summary
Further reading
14
EDA on Wine Quality Data Analysis
EDA on Wine Quality Data Analysis
Technical requirements
Disclosing the wine quality dataset
Analyzing red wine
Analyzing white wine
Model development and evaluation
Summary
Further reading
15
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think
Appendix
Appendix
String manipulation
Using pandas vectorized string functions
Using regular expressions
Further reading

Technical requirements

The code for this chapter can found inside the GitHub repository shared with this book inside the Chapter 3 folder. This dataset consists of email data taken from my personal Gmail account. Due to privacy issues, the dataset cannot be shared with you. However, in this chapter, we will guide you on how you can download your own emails from Gmail to perform initial data analysis.

Here are the steps to follow:

  1. Log in to your personal Gmail account.
  2. Go to the following link: https://takeout.google.com/settings/takeout.
  3. Deselect all the items but Gmail, as shown in the following screenshot:
  1. Select the archive format, as shown in the following screenshot:

Note that I selected Send download link by email, One-time archive, .zip, and the maximum allowed size. You can customize the format. Once done, hit Create archive.

You will get an email archive that...

End of Section 2
Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete