Question 120
A nightly automation should only process new records since its last successful watermark. What orchestration state must be stored?
Explanation
Correct Answer
The automation needs a durable checkpoint representing the last record whose processing outcome actually committed. After a successful batch, atomically advance the watermark with the resulting outputs or transaction receipt, so a crash before commit leaves the affected records eligible for safe replay. Use stable record identifiers and deduplicated effects where delivery can repeat. The checkpoint must be persisted across runs and not merely inferred from the current clock. This ensures that a failed batch does not mark unprocessed data complete and that a successful run can resume from an auditable state.
Incorrect Answers
A sliding window is sometimes used to tolerate late arrivals, but timestamps alone cannot certify that individual records were committed exactly once. It can repeat downstream side effects or skip records when arrival times and event times diverge. The scenario requires a durable watermark advanced after successful committed processing, often paired with idempotent record handling. A moving window without commit-aware state does not satisfy the precise new-record contract.
Setting the watermark to the current time before work begins may skip records that arrive later within the run or tasks that fail before their outputs commit. On restart, those records could appear older than the stored cutoff and never be processed. A safe incremental pipeline advances state only after the corresponding records have completed under the required transaction or idempotency rule. A clock reading is useful for observations, but it is not proof that all data before that timestamp were successfully handled.
The largest fetched identifier is not necessarily the last successfully processed record. If the workflow crashes after advancing that cursor but before committing its writes, the next run will skip records that were read but never applied. A durable watermark must be advanced only together with, or reliably after, committed processing and must support safe restart. Recording progress optimistically may appear efficient, but it violates the requirement to process each new record without loss.



Claude Certified Architect - Foundations (CCA-F) Practice Tests