Intermediate
Open
Pro
Answer a Regulatory Lineage Request Under Time Pressure
A fraud model declined a legitimate customer's transaction. The customer escalates, and a regulator requests, within 5 business days: (a) the exact model version that made the decision, (b) the exact feature values it saw, (c) the offline evaluation evidence that justified promoting that version to production, and (d) confirmation of who approved the promotion and when.
- Walk through, step by step, how each of the four requested items would be retrieved in a system with proper experiment tracking, a registry, and lineage in place.
- For each of the four items, name specifically what would be missing or unanswerable if the team only had experiment tracking (runs logged) but no model registry with gated stage transitions.
- Why is "we can find the model file that was probably in use around that date" not an adequate answer to item (a), even if the file is found correctly?
Share this question