Basic Data Analysis with NumPy | Learning NumPy Array

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Learning NumPy Array

By : Ivan Idris

4 (9)

Learning NumPy Array

4 (9)

By: Ivan Idris

Overview of this book

Learning NumPy Array

Learning NumPy Array

Credits

Credits

About the Author

About the Author

About the Reviewers

About the Reviewers

www.PacktPub.com

www.PacktPub.com

Preface

Preface

Free Chapter

Getting Started with NumPy

Getting Started with NumPy

Python

Installing NumPy, Matplotlib, SciPy, and IPython on Windows

Installing NumPy, Matplotlib, SciPy, and IPython on Linux

Installing NumPy, Matplotlib, and SciPy on Mac OS X

Building from source

NumPy arrays

Online resources and help

Summary

NumPy Basics

NumPy Basics

The NumPy array object

Creating a multidimensional array

Selecting array elements

NumPy numerical types

Creating a record data type

One-dimensional slicing and indexing

Manipulating array shapes

Creating views and copies

Fancy indexing

Indexing with a list of locations

Indexing arrays with Booleans

Stride tricks for Sudoku

Broadcasting arrays

Summary

Basic Data Analysis with NumPy

Basic Data Analysis with NumPy

Introducing the dataset

Determining the daily temperature range

Looking for evidence of global warming

Comparing solar radiation versus temperature

Analyzing wind direction

Analyzing wind speed

Analyzing precipitation and sunshine duration

Analyzing monthly precipitation in De Bilt

Analyzing atmospheric pressure in De Bilt

Analyzing atmospheric humidity in De Bilt

Summary

Simple Predictive Analytics with NumPy

Simple Predictive Analytics with NumPy

Examining autocorrelation of average temperature with pandas

Describing data with pandas DataFrames

Correlating weather and stocks with pandas

Predicting temperature

Analyzing intra-year daily average temperatures

Introducing the day-of-the-year temperature model

Modeling temperature with the SciPy leastsq function

Day-of-year temperature take two

Moving-average temperature model with lag 1

The Autoregressive Moving Average temperature model

The time-dependent temperature mean adjusted autoregressive model

Outliers analysis of average De Bilt temperature

Using more robust statistics

Summary

Signal Processing Techniques

Signal Processing Techniques

Introducing the Sunspot data

Moving averages

Smoothing functions

Forecasting with an ARMA model

Filtering a signal

Demonstrating cointegration

Summary

Profiling, Debugging, and Testing

Profiling, Debugging, and Testing

Assert functions

Profiling a program with IPython

Debugging with IPython

Performing Unit tests

Nose tests decorators

Summary

The Scientific Python Ecosystem

The Scientific Python Ecosystem

Numerical integration

Interpolation

Using Cython with NumPy

Clustering stocks with scikit-learn

Detecting corners

Comparing NumPy to Blaze

Summary

Index

Index

Customer Reviews

4 (9)

5 star

55.6%

4 star

22.2%

3 star

0

2 star

11.1%

1 star

11.1%

Determining the daily temperature range

The daily temperature range, or diurnal temperature variation as it is called in meteorology, is not so big a deal on Earth. In desert areas on Earth or generally on different planets, the variation is greater. We will have a look at the daily temperature range for the data we downloaded in the previous example:

To analyze temperature ranges, we will need to import the NumPy package and the NumPy masked arrays:
```
import numpy as np
import sys
import numpy.ma as ma
from datetime import datetime as dt
```
We will load a bit more data than that loaded in the previous section: dates of measurements in the YYYYMMDD format and the average daily temperature. Dates require special conversion. Firstly date strings are converted to dates and then to numbers as follows:
```
to_float = lambda x: float(x.strip() or np.nan)
to_date = lambda x: dt.strptime(x, "%Y%m%d").toordinal()
 
dates, avg_temp, min_temp, max_temp = np.loadtxt(sys.argv[1], delimiter=',', usecols=(1, 11, 12...
```

Search

Your notes and bookmarks