Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Advanced Search Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • RAG-Driven Generative AI
  • Toc
  • feedback
RAG-Driven Generative AI

RAG-Driven Generative AI

By : Denis Rothman
4.3 (18)
close
RAG-Driven Generative AI

RAG-Driven Generative AI

4.3 (18)
By: Denis Rothman

Overview of this book

RAG-Driven Generative AI provides a roadmap for building effective LLM, computer vision, and generative AI systems that balance performance and costs. This book offers a detailed exploration of RAG and how to design, manage, and control multimodal AI pipelines. By connecting outputs to traceable source documents, RAG improves output accuracy and contextual relevance, offering a dynamic approach to managing large volumes of information. This AI book shows you how to build a RAG framework, providing practical knowledge on vector stores, chunking, indexing, and ranking. You’ll discover techniques to optimize your project’s performance and better understand your data, including using adaptive RAG and human feedback to refine retrieval accuracy, balancing RAG with fine-tuning, implementing dynamic RAG to enhance real-time decision-making, and visualizing complex data with knowledge graphs. You’ll be exposed to a hands-on blend of frameworks like LlamaIndex and Deep Lake, vector databases such as Pinecone and Chroma, and models from Hugging Face and OpenAI. By the end of this book, you will have acquired the skills to implement intelligent solutions, keeping you competitive in fields from production to customer service across any project.
Table of Contents (14 chapters)
close
close
Preface
chevron up
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Why Retrieval Augmented Generation?
Why Retrieval Augmented Generation?
What is RAG?
Naïve, advanced, and modular RAG configurations
RAG versus fine-tuning
The RAG ecosystem
Naïve, advanced, and modular RAG in code
Summary
Questions
References
Further reading
2
RAG Embedding Vector Stores with Deep Lake and OpenAI
RAG Embedding Vector Stores with Deep Lake and OpenAI
From raw data to embeddings in vector stores
Organizing RAG in a pipeline
A RAG-driven generative AI pipeline
Building a RAG pipeline
Evaluating the output with cosine similarity
Summary
Questions
References
Further reading
3
Building Index-Based RAG with LlamaIndex, Deep Lake, and OpenAI
Building Index-Based RAG with LlamaIndex, Deep Lake, and OpenAI
Why use index-based RAG?
Building a semantic search engine and generative agent for drone technology
Vector store index query engine
Tree index query engine
List index query engine
Keyword index query engine
Summary
Questions
References
Further reading
4
Multimodal Modular RAG for Drone Technology
Multimodal Modular RAG for Drone Technology
What is multimodal modular RAG?
Building a multimodal modular RAG program for drone technology
Summary
Questions
References
Further reading
5
Boosting RAG Performance with Expert Human Feedback
Boosting RAG Performance with Expert Human Feedback
Adaptive RAG
Building hybrid adaptive RAG in Python
Summary
Questions
References
Further reading
6
Scaling RAG Bank Customer Data with Pinecone
Scaling RAG Bank Customer Data with Pinecone
Scaling with Pinecone
Pipeline 1: Collecting and preparing the dataset
Pipeline 2: Scaling a Pinecone index (vector store)
Pipeline 3: RAG generative AI
Summary
Questions
References
Further reading
7
Building Scalable Knowledge-Graph-Based RAG with Wikipedia API and LlamaIndex
Building Scalable Knowledge-Graph-Based RAG with Wikipedia API and LlamaIndex
The architecture of RAG for knowledge-graph-based semantic search
Pipeline 1: Collecting and preparing the documents
Pipeline 2: Creating and populating the Deep Lake vector store
Pipeline 3: Knowledge graph index-based RAG
Summary
Questions
References
Further reading
8
Dynamic RAG with Chroma and Hugging Face Llama
Dynamic RAG with Chroma and Hugging Face Llama
The architecture of dynamic RAG
Installing the environment
Activating session time
Downloading and preparing the dataset
Embedding and upserting the data in a Chroma collection
Querying the collection
Prompt and retrieval
RAG with Llama
Total session time
Summary
Questions
References
Further reading
9
Empowering AI Models: Fine-Tuning RAG Data and Human Feedback
Empowering AI Models: Fine-Tuning RAG Data and Human Feedback
The architecture of fine-tuning static RAG data
Installing the environment
1. Preparing the dataset for fine-tuning
2. Fine-tuning the model
3. Using the fine-tuned OpenAI model
Metrics
Summary
Questions
References
Further reading
10
RAG for Video Stock Production with Pinecone and OpenAI
RAG for Video Stock Production with Pinecone and OpenAI
The architecture of RAG for video production
The environment of the video production ecosystem
Pipeline 1: Generator and Commentator
Pipeline 2: The Vector Store Administrator
Pipeline 3: The Video Expert
Summary
Questions
References
Further reading
11
Other Books You May Enjoy
Other Books You May Enjoy
12
Index
Index
Appendix
Appendix

To get the most out of this book

You should have basic Natural Processing Language (NLP) knowledge and some experience with Python. Additionally, most of the programs in this book are provided as Jupyter notebooks. To run them, all you need is a free Google Gmail account, allowing you to execute the notebooks on Google Colaboratory’s free virtual machine (VM). You will also need to generate API tokens for OpenAI, Activeloop, and Pinecone.

The following modules will need to be installed when running the notebooks:

Modules

Version

deeplake

3.9.18 (with Pillow)

openai

1.40.3 (requires regular upgrades)

transformers

4.41.2

numpy

>=1.24.1 (Upgraded to satisfy chex)

deepspeed

0.10.1

bitsandbytes

0.41.1

accelerate

0.31.0

tqdm

4.66.1

neural_compressor

2.2.1

onnx

1.14.1

pandas

2.0.3

scipy

1.11.2

beautifulsoup4

4.12.3

requests

2.31.0

Download the example code files

The code bundle for the book is hosted on GitHub at https://github.com/Denis2054/RAG-Driven-Generative-AI. We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/. Check them out!

Download the color images

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. You can download it here: https://packt.link/gbp/9781836200918.

Conventions used

There are a number of text conventions used throughout this book.

CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. For example: “self refers to the current instance of the class to access its variables, methods, and functions”.

A block of code is set as follows:

# Cosine Similarity
score = calculate_cosine_similarity(query, best_matching_record)
print(f"Best Cosine Similarity Score: {score:.3f}")

Any command-line input or output is written as follows:

Best Cosine Similarity Score: 0.126

Bold: Indicates a new term, an important word, or words that you see on the screen. For example, text in menus or dialog boxes appears like this. Here is an example: “Modular RAG implementing flexible retrieval methods”.

Warnings or important notes appear like this.

Tips and tricks appear like this.

Next Section
bookmark search playlist download
font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete