Basic Data Analysis with NumPy | Learning NumPy Array

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Learning NumPy Array

By : Ivan Idris

4 (9)

Learning NumPy Array

4 (9)

By: Ivan Idris

Overview of this book

Learning NumPy Array

Learning NumPy Array

Credits

Credits

About the Author

About the Author

About the Reviewers

About the Reviewers

www.PacktPub.com

www.PacktPub.com

Preface

Preface

Free Chapter

Getting Started with NumPy

Getting Started with NumPy

Python

Installing NumPy, Matplotlib, SciPy, and IPython on Windows

Installing NumPy, Matplotlib, SciPy, and IPython on Linux

Installing NumPy, Matplotlib, and SciPy on Mac OS X

Building from source

NumPy arrays

Online resources and help

Summary

NumPy Basics

NumPy Basics

The NumPy array object

Creating a multidimensional array

Selecting array elements

NumPy numerical types

Creating a record data type

One-dimensional slicing and indexing

Manipulating array shapes

Creating views and copies

Fancy indexing

Indexing with a list of locations

Indexing arrays with Booleans

Stride tricks for Sudoku

Broadcasting arrays

Summary

Basic Data Analysis with NumPy

Basic Data Analysis with NumPy

Introducing the dataset

Determining the daily temperature range

Looking for evidence of global warming

Comparing solar radiation versus temperature

Analyzing wind direction

Analyzing wind speed

Analyzing precipitation and sunshine duration

Analyzing monthly precipitation in De Bilt

Analyzing atmospheric pressure in De Bilt

Analyzing atmospheric humidity in De Bilt

Summary

Simple Predictive Analytics with NumPy

Simple Predictive Analytics with NumPy

Examining autocorrelation of average temperature with pandas

Describing data with pandas DataFrames

Correlating weather and stocks with pandas

Predicting temperature

Analyzing intra-year daily average temperatures

Introducing the day-of-the-year temperature model

Modeling temperature with the SciPy leastsq function

Day-of-year temperature take two

Moving-average temperature model with lag 1

The Autoregressive Moving Average temperature model

The time-dependent temperature mean adjusted autoregressive model

Outliers analysis of average De Bilt temperature

Using more robust statistics

Summary

Signal Processing Techniques

Signal Processing Techniques

Introducing the Sunspot data

Moving averages

Smoothing functions

Forecasting with an ARMA model

Filtering a signal

Demonstrating cointegration

Summary

Profiling, Debugging, and Testing

Profiling, Debugging, and Testing

Assert functions

Profiling a program with IPython

Debugging with IPython

Performing Unit tests

Nose tests decorators

Summary

The Scientific Python Ecosystem

The Scientific Python Ecosystem

Numerical integration

Interpolation

Using Cython with NumPy

Clustering stocks with scikit-learn

Detecting corners

Comparing NumPy to Blaze

Summary

Index

Index

Customer Reviews

4 (9)

5 star

55.6%

4 star

22.2%

3 star

0

2 star

11.1%

1 star

11.1%

Analyzing atmospheric pressure in De Bilt

Atmospheric pressure is the pressure exerted by air in the atmosphere. It is defined as force divided by area. The KNMI De Bilt data file has measurements in 0.1 hPa for average, minimum, and maximum daily pressures. We will plot a histogram of the average pressure and monthly minimums, maximums, and averages:

We will load the dates converted to months, average, minimum, and maximum pressure into NumPy arrays. Again, missing values needed to be converted to NaNs. The code is as follows:

to_float = lambda x: 0.1 * float(x.strip() or np.nan)
to_month = lambda x: dt.strptime(x, "%Y%m%d").month
months, avg_p, max_p, min_p = np.loadtxt(sys.argv[1], delimiter=',', usecols=(1, 25, 26, 28), unpack=True, converters={1: to_month, 25: to_float, 26: to_float, 28: to_float})

Values are missing from the pressure value columns, so we have to create masked arrays out of NumPy arrays. The following code snippet prints some simple statistics:
```
max_p = ma.masked_invalid...
```

Search

Your notes and bookmarks