Practice — LLM Application System Design (6 questions)
Advanced
Open
Free
Prompt, RAG or Fine-Tune? Permalink →
A B2B SaaS company wants an assistant that answers questions about its product. Three complaints have come in from a prototype built with a plain system prompt:
- (a) It confidently describes settings that no longer exist since last quarter's release.
- (b) Answers are in the wrong tone and ignore the required "Summary / Steps / Related links" layout about 30% of the time even with examples in the prompt.
- (c) It gives generic advice about "your admin panel" instead of the customer's actual configuration.
- For each complaint, decide whether prompt engineering, RAG, or fine-tuning is the right lever, and justify it.
- Explain why fine-tuning is the wrong fix for complaint (a).
- Sketch the order in which you would apply the fixes and how you would know each one worked.
Share this question