Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Building Natural Language and LLM Pipelines
  • Table Of Contents Toc
Building Natural Language and LLM Pipelines

Building Natural Language and LLM Pipelines

By : Laura Funderburk
close
close
Building Natural Language and LLM Pipelines

Building Natural Language and LLM Pipelines

By: Laura Funderburk

Overview of this book

Modern LLM applications often break in production due to brittle pipelines, loose tool definitions, and noisy context. This book shows you how to build production-ready, context-aware systems using Haystack and LangGraph. You’ll learn to design deterministic pipelines with strict tool contracts and deploy them as microservices. Through structured context engineering, you’ll orchestrate reliable agent workflows and move beyond simple prompt-based interactions. You'll start by understanding LLM behavior—tokens, embeddings, and transformer models—and see how prompt engineering has evolved into a full context engineering discipline. Then, you'll build retrieval-augmented generation (RAG) pipelines with retrievers, rankers, and custom components using Haystack’s graph-based architecture. You’ll also create knowledge graphs, synthesize unstructured data, and evaluate system behavior using Ragas and Weights & Biases. In LangGraph, you’ll orchestrate agents with supervisor-worker patterns, typed state machines, retries, fallbacks, and safety guardrails. By the end of the book, you’ll have the skills to design scalable, testable LLM pipelines and multi-agent systems that remain robust as the AI ecosystem evolves. *Email sign-up and proof of purchase required
Table of Contents (18 chapters)
close
close
Lock Free Chapter
1
Part 1: The Foundation of Reliable AI
4
Part 2: Building The Tool Layer with Haystack
9
Part 3: Deployment and Agentic Orchestration
12
Part 4: The Future of Agentic AI
16
Other Books You May Enjoy
17
Index

8

Hands-On Projects

In this chapter, we will explore key NLP techniques by constructing a series of hands-on projects. We will pivot from the concept of monolithic pipelines, which we have built in previous chapters, to a more advanced, scalable, and modern architecture: building discrete, high-performance tools. This approach is foundational to building agentic systems, where a central orchestrator, that is, an agent, intelligently selects from a set of tools to accomplish complex goals.

In this chapter, we will introduce another powerful, graph-based orchestration framework to focus on agentic implementation: LangGraph. This chapter's narrative arc is thus established: Haystack serves as our robust tool-builder, and LangGraph will be introduced as the agentic layer orchestrator.

In this chapter, through hands-on projects, we'll be covering the following topics:

  • Recap: The Haystack agent and pipelines as tools
  • Limitations of built-in agents
  • An alternative for agentic orchestration...
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Building Natural Language and LLM Pipelines
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon