Deploying OpenAI model in resource
This user guide will help you to deploy the OpenAI model you want in your OpenAI resource.
Deploying model
- Open the Azure portal.
- Enter the term OpenAI in the search bar at the top.
- Select the Azure OpenAI service under Services in the search results.
You will find your OpenAI resource in the overview that opens. Click the name of your resource.
Click Go to Azure OpenAI Studio.
You will now be redirected to OpenAI Studio. You may be asked to enter your Azure username and password again.
There is a navigation menu on the left-hand side of the OpenAI Studio.
Under Models you will find all models that are currently available for your resource.
To actually use a model, select the Deployments menu item and then click + Create new deployment.
The following configuration menu then opens. Select the desired model from the drop-down menu and assign a deployment name of your choice.
After selecting the model, the Model version drop-down menu appears. The ZID recommends the Auto-update to default option. This means you do not have to perform manual updates for newer versions.
You can make further settings under Advanced options, including the maximum number of tokens per minute. This determines the maximum processing rate of the model. The higher the number of tokens, the more requests per minute the model can process. The preset number of tokens should be sufficient for common requirements.
You can find more information about tokens and the available quotas on the Microsoft website.
Once you have made all the settings, click Create. The overview opens with the deployments and the newly created model.
In the next step, you can use the OpenAI model provided.