Match a job Paths Subjects Questions Quizzes Pricing
Advanced Open Pro

Evaluate an anomaly detector when you have no labels

You have built an Isolation Forest on 5 features of card transactions (20,000 a day) and are about to switch it on. There are no labels, the true anomaly rate is believed to be about 0.1 percent, and the reviewing team can handle 10 alerts a day. A colleague proposes "we will inject fake anomalies, measure recall, and report ROC-AUC".

Write the evaluation plan. Say what each method can and cannot tell you, how many reviews you need, and which metric you will report.

Share this question

← Back to Anomaly Detection for Tabular Data & Time Series practice

We use cookies for product analytics to improve OmniAtlas. See our Privacy Policy.