-
Book Overview & Buying
-
Table Of Contents
-
Feedback & Rating

Data Processing with Optimus
By :

Before we deep dive into how to load and save data, let's explore how external storage systems, databases, CPUs, RAM, GPUs, and local storage systems interact to get your data ready for processing.
We'll divide the process of loading data into four categories.
A file is loaded from disk to RAM using the CPU:
Figure 2.1 – Loading and saving data from a file using CPUs
A file is loaded from disk to GPU memory using the CPU. To save the file to disk, the data is sent via the GPU to the CPU, and then to disk:
Figure 2.2 – Loading and saving data from a file using GPUs
The data is extracted from a database and sent via a JDBC driver to RAM on your local laptop or cluster:
Figure 2.3 – Loading and saving data from a database using CPUs
In Optimus, the data is extracted from...