Advanced
Open
Pro
CLIP and CLIPScore: One Model, Two Jobs in the Same Pipeline
Part of the AI Engineer Interview path →
Part of the ML System Design Interview path →
Part of the Generative Vision & Image AI System Design path →
A new engineer on your team asks: "Why does our data pipeline need CLIP if we're building a diffusion model, not a classifier? And is the CLIPScore we report in our eval dashboard the same CLIP, or a different model?"
- Explain what CLIP is and how it's trained, at the level you'd use in an interview.
- Answer both of the engineer's questions directly.
- Propose a concrete scenario where CLIP-based caption filtering in data prep and CLIPScore-based evaluation could disagree with each other, and explain what that disagreement would tell you.
Share this question