Question 560
A first-stage assessment at a financial institution investigates: A fraud-prevention classifier performs well in testing but customer behavior shifts over a busy season. Which initial check is MOST useful for isolating the issue?
Explanation
Correct Answer
Compare current feature distributions and sampled labeled outcomes to baseline. This first check focuses on the stated situation, a fraud-prevention classifier performs well in testing but customer behavior shifts over a busy season. It informs the recommended action: monitor input distributions and business outcomes for drift after deployment.
Incorrect Answers
This diagnostic applies when a support summary model confuses several short internal acronyms with customer-facing words. For the current situation first compare current feature distributions and sampled labeled outcomes to baseline.
This diagnostic applies when a prompt template inserts retrieved customer emails directly into high-priority instructions. For the current situation first compare current feature distributions and sampled labeled outcomes to baseline.
This diagnostic applies when a logistics support chatbot is grounded to a trusted knowledge base but sometimes retrieves outdated duplicates. For the current situation first compare current feature distributions and sampled labeled outcomes to baseline.






Generative AI Leader Practice Tests