Match a job Paths Subjects Questions Quizzes Pricing
Advanced Open Pro

Coverage, Faithfulness, and Citation Precision Are Independent

A finished 5-section research report scores: coverage 4/5 (one sub-question's section is missing entirely), faithfulness 0.92 (92% of claims are entailed by their cited sources), citation precision 0.85 (85% of citations support the specific claim they're attached to, not just the general topic).

  1. Explain why a report can score well on faithfulness and citation precision while still failing coverage, using this example.
  2. Describe a plausible pipeline root cause for the missing section that coverage evaluation catches but faithfulness evaluation would never surface on its own.
  3. Which of the three metrics would a reader most likely notice first, and does that change which one you'd prioritize fixing? Justify your answer.

Share this question

← Back to Case Study: Design a Deep Research Agent practice

We use cookies for product analytics to improve OmniAtlas. See our Privacy Policy.