Question 120
An Azure Foundry model endpoint begins returning throttling responses after a large concurrency spike. What should the team inspect first?
Explanation
Correct Answer
Deployment quotas and measured RPM/TPM usage distinguish saturation or capacity bottlenecks from unrelated errors. Retry-After guidance and bounded backoff then prevent amplified load.
Incorrect Answers
Increasing client concurrency sends more simultaneous demand to the same quota or capacity limit. Without usage data this can worsen the throttling instead of explaining it.
Latency describes completed or timed requests; a service may reject requests promptly when its quota is reached. The analysis must include admission and limit metrics.
Token tuning can help in some workloads, but is premature without knowing whether request rate, token rate or backend capacity caused the 429 responses.



Microsoft Azure AI Fundamentals (AI-901) Practice Tests