Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Engineering Data Mesh in Azure Cloud
  • Table Of Contents Toc
  • Feedback & Rating feedback
Engineering Data Mesh in Azure Cloud

Engineering Data Mesh in Azure Cloud

By : Deswandikar
4.5 (6)
close
close
Engineering Data Mesh in Azure Cloud

Engineering Data Mesh in Azure Cloud

4.5 (6)
By: Deswandikar

Overview of this book

Decentralizing data and centralizing governance are practical, scalable, and modern approaches to data analytics. However, implementing a data mesh can feel like changing the engine of a moving car. Most organizations struggle to start and get caught up in the concept of data domains, spending months trying to organize domains. This is where Engineering Data Mesh in Azure Cloud can help. The book starts by assessing your existing framework before helping you architect a practical design. As you progress, you’ll focus on the Microsoft Cloud Adoption Framework for Azure and the cloud-scale analytics framework, which will help you quickly set up a landing zone for your data mesh in the cloud. The book also resolves common challenges related to the adoption and implementation of a data mesh faced by real customers. It touches on the concepts of data contracts and helps you build practical data contracts that work for your organization. The last part of the book covers some common architecture patterns used for modern analytics frameworks such as artificial intelligence (AI). By the end of this book, you’ll be able to transform existing analytics frameworks into a streamlined data mesh using Microsoft Azure, thereby navigating challenges and implementing advanced architecture patterns for modern analytics workloads.
Table of Contents (23 chapters)
close
close
Free Chapter
1
Part 1: Rolling Out the Data Mesh in the Azure Cloud
9
Part 2: Practical Challenges of Implementing a Data Mesh
16
Part 3: Popular Data Product Architectures
17
Chapter 14: Advanced Analytics Using Azure Machine Learning, Databricks, and the Lakehouse Architecture
19
Chapter 16: Event-Driven Analytics Using Azure Event Hubs, Azure Stream Analytics, and Azure Machine Learning

To get the most out of this book

While having read the original data mesh materials by Zhamak Dehghani would definitely be an advantage, it’s not a must. This book provides documentation references for all the Microsoft Azure services mentioned, but some working knowledge of Microsoft Azure will help you save time reading the docs.

Software/hardware covered in the book

Operating system requirements

Microsoft Azure

  • Azure SQL Database
  • Azure Synapse
  • Azure Data Lake Gen2
  • Microsoft Purview
  • Microsoft Active Directory
  • Azure Resource Manager
  • Azure Log Analytics Workspace
  • Azure Data Explorer

NA

Great Expectations

Windows or Linux with Python 3.8 to 3.11

Profisee

Deployed using Azure Marketplace

PowerShell, Azure Command Line Interface

Windows

Python 3.8 to 3.11

Windows 11 or Ubuntu 22.04

SQL Server Management Studio

Windows 10 or Windows 11

For installation and setup of the preceding tools and platforms, please see the following references:

Note that the format of Chapters 14, 15, 16, and 17 is different from those of the previous chapters. That is because these chapters are architectural references. The aim of these chapters is to provide guidance on how to set up analytics for a given workload. You might also observe portions of text being repeated across those chapters. This is also by design. At a later point, you might want to refer to a specific reference chapter directly. In order to make sure you have everything you need in those four chapters, we repeat some of the text in them. Each reference chapter is designed to be a quick read and lets you explore all the components of the architecture using the reference links provided.

If you are using the digital version of this book, we advise you to type the code yourself. Doing so will help you avoid any potential errors related to the copying and pasting of code.

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech
bookmark search playlist download font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY