Question 470
A support bot seems accurate on easy requests but fails on escalations. Which response most directly meets this requirement?
Explanation
Correct Answer
Aggregate averages can mask failure on important edge cases. High-impact escalations deserve separate thresholds rather than average-only reporting.
Incorrect Answers
For post-rollout drift monitoring, monitoring must catch drift as the workflow's surrounding data evolves. Source changes can silently degrade previously correct answers. This does not resolve risk-stratified workflow evaluation.
For outcome-based success metrics, usage volume is not equivalent to demonstrated business benefit. Only completed, acceptable tasks represent useful operational progress. This does not resolve risk-stratified workflow evaluation.
For controlled workflow comparison, comparable measurements require stable inputs and explicit acceptance criteria. Changing input difficulty between trials would invalidate the comparison. This does not resolve risk-stratified workflow evaluation.



Claude Certified Associate - Foundations (CCAO-F) Practice Tests