Question 620
A first-stage assessment at a financial institution investigates: A service team continuously revises its prompts but tests every revision only against the authoring examples. Which initial check is MOST useful for isolating the issue?
Explanation
Correct Answer
Compare prompt versions and holdout evaluation scores before promotion. This first check focuses on the stated situation, a service team continuously revises its prompts but tests every revision only against the authoring examples. It informs the recommended action: maintain versioned prompts and score each change on an independent holdout set.
Incorrect Answers
This diagnostic applies when a marketing assistant must respond as a compliance reviewer rather than a casual brand copywriter. For the current situation first compare prompt versions and holdout evaluation scores before promotion.
This diagnostic applies when an enterprise architect needs custom chunking and retrieval controls for research notes with unusual structure. For the current situation first compare prompt versions and holdout evaluation scores before promotion.
This diagnostic applies when a customer refund assistant occasionally proposes account credits above its authorization ceiling. For the current situation first compare prompt versions and holdout evaluation scores before promotion.






Generative AI Leader Practice Tests