Simple Predictive Analytics with NumPy | Learning NumPy Array

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents
Feedback & Rating

Learning NumPy Array

By : Ivan Idris

4 (9)

Learning NumPy Array

4 (9)

By: Ivan Idris

Overview of this book

Learning NumPy Array

Learning NumPy Array

Credits

Credits

About the Author

About the Author

About the Reviewers

About the Reviewers

www.PacktPub.com

www.PacktPub.com

Preface

Preface

Free Chapter

Getting Started with NumPy

Getting Started with NumPy

Python

Installing NumPy, Matplotlib, SciPy, and IPython on Windows

Installing NumPy, Matplotlib, SciPy, and IPython on Linux

Installing NumPy, Matplotlib, and SciPy on Mac OS X

Building from source

NumPy arrays

Online resources and help

Summary

NumPy Basics

NumPy Basics

The NumPy array object

Creating a multidimensional array

Selecting array elements

NumPy numerical types

Creating a record data type

One-dimensional slicing and indexing

Manipulating array shapes

Creating views and copies

Fancy indexing

Indexing with a list of locations

Indexing arrays with Booleans

Stride tricks for Sudoku

Broadcasting arrays

Summary

Basic Data Analysis with NumPy

Basic Data Analysis with NumPy

Introducing the dataset

Determining the daily temperature range

Looking for evidence of global warming

Comparing solar radiation versus temperature

Analyzing wind direction

Analyzing wind speed

Analyzing precipitation and sunshine duration

Analyzing monthly precipitation in De Bilt

Analyzing atmospheric pressure in De Bilt

Analyzing atmospheric humidity in De Bilt

Summary

Simple Predictive Analytics with NumPy

Simple Predictive Analytics with NumPy

Examining autocorrelation of average temperature with pandas

Describing data with pandas DataFrames

Correlating weather and stocks with pandas

Predicting temperature

Analyzing intra-year daily average temperatures

Introducing the day-of-the-year temperature model

Modeling temperature with the SciPy leastsq function

Day-of-year temperature take two

Moving-average temperature model with lag 1

The Autoregressive Moving Average temperature model

The time-dependent temperature mean adjusted autoregressive model

Outliers analysis of average De Bilt temperature

Using more robust statistics

Summary

Signal Processing Techniques

Signal Processing Techniques

Introducing the Sunspot data

Moving averages

Smoothing functions

Forecasting with an ARMA model

Filtering a signal

Demonstrating cointegration

Summary

Profiling, Debugging, and Testing

Profiling, Debugging, and Testing

Assert functions

Profiling a program with IPython

Debugging with IPython

Performing Unit tests

Nose tests decorators

Summary

The Scientific Python Ecosystem

The Scientific Python Ecosystem

Numerical integration

Interpolation

Using Cython with NumPy

Clustering stocks with scikit-learn

Detecting corners

Comparing NumPy to Blaze

Summary

Index

Index

Customer Reviews

4 (9)

5 star

55.6%

4 star

22.2%

3 star

0

2 star

11.1%

1 star

11.1%

Describing data with pandas DataFrames

Luckily, pandas has descriptive statistics utilities. We will read the average wind speed, temperature, and pressure values from the KNMI De Bilt data file into a pandas DataFrame. This object is similar to the R dataframe, which is like a data table in a spreadsheet or a database. The columns are labeled, the data can be indexed, and you can run computations on the data. We will then print out descriptive statistics and a correlation matrix as shown in the following steps:

Read the CSV file with the pandas read_csv function. This function works in a similar fashion to the NumPy load_txt function:

to_float = lambda x: .1 * float(x.strip() or np.nan)
to_date = lambda x: dt.strptime(x, "%Y%m%d")
cols = [4, 11, 25]
conv_dict = dict( (col, to_float) for col in cols) 

conv_dict[1] = to_date
cols.append(1)
 
headers = ['dates', 'avg_ws', 'avg_temp', 'avg_pres']
df = pd.read_csv(sys.argv[1], usecols=cols, names=headers, index_col=[0], converters=conv_dict)

Print...

Search

Your notes and bookmarks