Practice — Case Study: Migrate a Production Prompt Suite Across a Model Deprecation (5 questions)
Intermediate
Open
Free
Triaging 40 Prompts Before Touching Any of Them Permalink →
Your provider announces the model behind your production application will stop working in 60 days. The application has 40 distinct prompts built up over two years by several teams, with wildly different traffic and criticality, and almost none of them have a golden set. A colleague wants to start by opening the highest-traffic prompt file and rewriting it for the new model today.
- Explain what's wrong with starting there, and what "safe migration" should mean before any prompt is edited.
- Design the inventory/triage step: what axes you'd score all 40 prompts on, and how that scoring determines migration order.
- Give a plausible breakdown of the 40 prompts into a few triage buckets and say which bucket you'd migrate first, with reasoning.
Share this question