Match a job Paths Subjects Questions Quizzes Pricing
Overview Read Practice

Practice — ML Data Pipelines & Feature Stores (5 questions)

Pro content

Sign up free, then start a 14-day Pro trial — no card needed.

Intermediate Open Free

Diagnosing a Point-in-Time Leak Permalink →

A team trains a churn model on rows of the form (user_id, snapshot_date, label = churned within 30 days), joining a user_features table that is fully recomputed every Friday night with columns such as sessions_last_30d, support_tickets_last_30d and days_since_last_login. Offline PR-AUC is 0.91; in production the first month's PR-AUC is 0.52.

  1. Explain the most likely cause of the gap, with a concrete example of how a training row is contaminated.
  2. Rewrite the join so that it is point-in-time correct (SQL or pseudocode is fine).
  3. One of the three features has a second leakage problem unrelated to the join. Which one, and what would you do about it?

Share this question

Intermediate Open Pro

Choosing an Attribution Window for Delayed Conversions

Unlock this question →
Intermediate Open Pro

Negative Sampling and Probability Recalibration

Unlock this question →
Advanced Open Pro

Investigating Training–Serving Skew

Unlock this question →
Intermediate Open Pro

Data Validation Gates and a Feature Backfill

Unlock this question →

We use cookies for product analytics to improve OmniAtlas. See our Privacy Policy.