Book Image

Python Parallel Programming Cookbook - Second Edition

By : Giancarlo Zaccone
Book Image

Python Parallel Programming Cookbook - Second Edition

By: Giancarlo Zaccone

Overview of this book

<p>Nowadays, it has become extremely important for programmers to understand the link between the software and the parallel nature of their hardware so that their programs run efficiently on computer architectures. Applications based on parallel programming are fast, robust, and easily scalable. </p><p> </p><p>This updated edition features cutting-edge techniques for building effective concurrent applications in Python 3.7. The book introduces parallel programming architectures and covers the fundamental recipes for thread-based and process-based parallelism. You'll learn about mutex, semaphores, locks, queues exploiting the threading, and multiprocessing modules, all of which are basic tools to build parallel applications. Recipes on MPI programming will help you to synchronize processes using the fundamental message passing techniques with mpi4py. Furthermore, you'll get to grips with asynchronous programming and how to use the power of the GPU with PyCUDA and PyOpenCL frameworks. Finally, you'll explore how to design distributed computing systems with Celery and architect Python apps on the cloud using PythonAnywhere, Docker, and serverless applications. </p><p> </p><p>By the end of this book, you will be confident in building concurrent and high-performing applications in Python.</p>
Table of Contents (16 chapters)
Title Page
Dedication

Technical requirements

You will need the mpich and mpi4py libraries for this chapter. 

The mpich library is a portable implementation of MPI. It is free software and is available for various versions of Unix (including Linux and macOS) and Microsoft Windows. 

To install mpichuse the installer downloaded from the downloads page (http://www.mpich.org/static/downloads/1.4.1p1/). Moreover, make sure to choose between the 32-bit or 64-bit versions to get the right one for your machine.

The mpi4py Python module provides Python bindings for the MPI (https://www.mpi-forum.org) standard. It is implemented on top of the MPI-1/2/3 specification and exposes an API that is based on the standard MPI-2 C++ bindings.

The installation procedure of mpi4py on a Windows machine is as follows:

C:>pip install mpi4py

Anaconda users...