In the cloud marketplace, spin up Confluent and Databricks. This will give you a Kafka and Spark system that is elastically scalable. Once you've spinned up these systems, go to the Confluent website at https://confluent.cloud and enter the username and password you set up in the cloud marketplace. Then, click on Create cluster. Follow the wizard to create your first cluster. Once you are in your cluster, click on API access in the menu. Then, find the Create key button that will allow you to create an API access key:
Once you've created a key, jot down its username and password; you will need these details later.
Next, go to the Topics section and, using the Create topic button, create two topics: one called Turbofan and another called Turbofan_RUL. Next, we will create a Python file so that we can test our new topic. Create a Python file with the following code to produce a message for the TurboFan topic:
from confluent_kafka import Producer
from...