Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Geospatial Development By Example with Python
  • Table Of Contents Toc
  • Feedback & Rating feedback
Geospatial Development By Example with Python

Geospatial Development By Example with Python

By : Pablo Carreira
5 (4)
close
close
Geospatial Development By Example with Python

Geospatial Development By Example with Python

5 (4)
By: Pablo Carreira

Overview of this book

From Python programming good practices to the advanced use of analysis packages, this book teaches you how to write applications that will perform complex geoprocessing tasks that can be replicated and reused. Much more than simple scripts, you will write functions to import data, create Python classes that represent your features, and learn how to combine and filter them. With pluggable mechanisms, you will learn how to visualize data and the results of analysis in beautiful maps that can be batch-generated and embedded into documents or web pages. Finally, you will learn how to consume and process an enormous amount of data very efficiently by using advanced tools and modern computers’ parallel processing capabilities.
Table of Contents (12 chapters)
close
close
close
Preface
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Free Chapter
1
1. Preparing the Work Environment
1. Preparing the Work Environment
Installing Python
Python packages and package manager
Installing packages and required software
Installing NumPy
Installing GDAL and OGR
Installing Mapnik
Installing Shapely
Installing other packages directly from pip
Installing an IDE
Creating the book project
Programming and running your first example
Transforming the coordinate system and calculating the area of all countries
Sort the countries by area size
Summary
2
2. The Geocaching App
2. The Geocaching App
Building the basic application structure
Downloading geocaching data
Opening the file and getting its contents
Combining functions into an application
Setting your current location
Finding the closest point
Summary
3
3. Combining Multiple Data Sources
3. Combining Multiple Data Sources
Representing geographic data
Making data homogeneous
Importing geocaching data
Integrating new functionality into the application
Summary
4
4. Improving the App Search Capabilities
4. Improving the App Search Capabilities
Working with polygons
Using Shapely to handle geometries
Importing polygons
Getting the attributes' values
Importing lines
Converting the spatial reference system and units
Geometry relationships
Filtering by attributes and relations
Filtering by multiple attributes
Integrating with the app
Summary
5
5. Making Maps
5. Making Maps
Knowing Mapnik
Creating utility functions to generate maps
Styling maps
Using Python objects as a source of data
Exporting geo objects
Creating the Map Maker app
Summary
6
6. Working with Remote Sensing Images
6. Working with Remote Sensing Images
Understanding how images are represented
Processing remote sensing images and data
Building an image processing pipeline
Summary
7
7. Extract Information from Raster Data
7. Extract Information from Raster Data
Getting the basic statistics
Creating color classified images
Blending images
Showing statistics with colors
Summary
8
8. Data Miner App
chevron up
8. Data Miner App
Measuring execution time
Code profiling
Storing information on a database
Importing massive amount of data
Searching for data and crossing information
Summary
9
9. Processing Big Images
9. Processing Big Images
Working with satellite images
Memory and images
Processing images in chunks
Creating image compositions
Summary
10
10. Parallel Processing
10. Parallel Processing
Multiprocessing basics
Block iteration
Improving the image resolution
Summary
11
Index
Index

Importing massive amount of data

Now that our environment is ready, we can begin working with bigger datasets. Let's start by profiling the import process and then optimize it. We will start with our small geocaching dataset and after the code is optimized we will move to bigger sets.

  1. In your geodata_app.py file, edit the if __name__ == '__main__': block to call the profiler.

    if __name__ == '__main__':
    profile = cProfile.Profile()
    profile.enable()
    import_initial_data("../data/geocaching.gpx", 'geocaching')
    profile.disable()
    profile.print_stats(sort='cumulative')

  2. Run the code and see the results. Don't worry about duplicated entries in the database now, we will clean it later. (I removed some information from the following output for space reasons.)

    Importing geocaching...
112 features.
Done!
 1649407 function calls (1635888 primitive calls) in 5.858 seconds

cumtime  percall filename:lineno(function)
  5.863    5.863 geodata_app.py:24(import_initial_data)
  5.862    5.862...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
Start a 7-day FREE trial
End of Section 4
Next Section
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete