
Unlocking Creativity with Azure OpenAI
By :

In the preceding chapters, we’ve demonstrated how you can use Azure OpenAI (AOAI) while your data is secure and private. In this chapter, our focus will shift to operationalizing Azure OpenAI. This means we will explore how to effectively deploy, manage, and optimize Azure OpenAI services. We will discuss best practices for logging and monitoring, ensuring you can track and analyze the performance of your AOAI service. Additionally, we will cover the various service quotas and limits, helping you to understand how to manage and allocate resources efficiently. We will also look at quota management and how you can request increases to support larger workloads. Furthermore, we will explain how to provision throughput units to ensure your AI services can handle the required load. Finally, we will examine strategies for scaling Azure OpenAI services to meet growing demands.
In this chapter we’re going to cover the following main topics:
...