IPython Parallel is the IPython API for parallel computing. We will set it up to use MPI for message passing. We may have to set environment variables as follows:

$ export LC_ALL=en_US.UTF-8
$ export LANG=en_US.UTF-8

Issue the following command at the command line:

$ ipython3 profile create --parallel --profile=mpi

The preceding command will create several files in the .ipython/profile_mpi folder located in your home directory.

Start a cluster that uses the MPI profile as follows:

$ ipcluster start --profile=mpi --engines=MPI --debug

The preceding command specifies that we are using the mpi profile and MPI engine with debug-level logging. We can now interact with the cluster from an IPython notebook. Start a notebook with plotting enabled and with NumPy, SciPy, and matplotlib automatically imported, as follows:

$ jupyter-notebook --profile=mpi --log-level=DEBUG 

The preceding command uses the mpi profile with debug log level. The notebook for this example is stored in the IPythonParallel...