Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Unlocking Creativity with Azure OpenAI
  • Toc
  • feedback
Unlocking Creativity with Azure OpenAI

Unlocking Creativity with Azure OpenAI

By : AMIT MUKHERJEE, Adithya Saladi
close
Unlocking Creativity with Azure OpenAI

Unlocking Creativity with Azure OpenAI

By: AMIT MUKHERJEE, Adithya Saladi

Overview of this book

Azure OpenAI, a cutting-edge service by Microsoft, harnesses the power of OpenAI's Large Language Model (LLM) to drive cloud-based innovations within enterprises. This service integrates advanced LLM models into business functions, transforming Microsoft products like GitHub Copilot, Microsoft 365 Copilot, and Bing Chat, making them more advanced and interactive. Azure OpenAI is accessible via REST APIs, Python SDK, or Azure OpenAI Studio, opening doors to build innovative AI applications. This book is a comprehensive guide to build GenAI applications using Azure OpenAI. It begins with the fundamentals, including how to access Azure OpenAI and how to effectively utilize its REST API and Python SDK. It takes a deep dive into various AI models and emphasizes the crucial aspects of prompt engineering and fine-tuning for optimal output. It further underlines the significance of content filters and prevention of misuse, maintaining a strong focus on safety and security protocols and finally the significance of Azure OpenAI Studio in deployment and administration is emphasized. Practical applications are showcased like content generations, summarization, semantic search, code documentation and code generation. Combining Azure Cognitive services amplifies Generative AI potential and finally aligns with Microsoft's ethical AI principles.
Table of Contents (19 chapters)
close
Free Chapter
1
Part 1: Foundations of Generative AI and Azure OpenAI
5
Part 2: Practical Applications of Azure OpenAI: Real-World Use Cases
13
Part 3: Mastering Governance, Operations, and AI Optimization with Azure OpenAI

Azure OpenAI Service quotas and limits

Azure OpenAI Pay-as-you-go model is a shared tenant GPU infrastructure for inferencing. Therefore, AOAI service has some service limit on how you can use this resource. In this section we will describe the various limits and quotas for different AOAI model and how to prevent throttling by following some best practices.

At this time of writing, each Azure subscription can access up to 30 OpenAI resources per region. For DALL-E models, the default quota limits are 2 concurrent requests for DALL-E 2 and 2 capacity units (equivalent to 6 requests per minute) for DALL-E 3. Whisper, another model, has a limit of 3 requests per minute. The maximum number of prompt tokens per request varies by model, and more detailed information can be found in the Azure OpenAI Service models documentation in the given link: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=python-secure%2Cglobal-standard%2Cstandard-chat-completions#gpt...

bookmark search playlist download font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete