Intermediate
Open
Pro
NMS in a Crowded Scene: Why a Person Disappears
A pedestrian detector works well on sparse street scenes but misses people in dense crowds at a station entrance. Debugging one frame, the detector emits four boxes before NMS (boxes are x_1, y_1, x_2, y_2):
| Box | Coordinates | Score |
|---|---|---|
| P1 | (100, 50, 160, 200) | 0.92 |
| P2 | (115, 50, 175, 200) | 0.88 |
| P3 | (300, 60, 350, 190) | 0.81 |
| P1b | (102, 52, 162, 202) | 0.75 |
Ground truth: P1 and P2 are two different people standing close together, P3 is a third person, and P1b is a duplicate detection of P1. NMS uses an IoU threshold of 0.5.
- Compute the pairwise IoUs that matter and run greedy NMS. What survives, and what is the effect on recall?
- Run NMS again at threshold 0.65. What changes, and what is the price of raising the threshold further?
- Apply Gaussian Soft-NMS with \sigma = 0.5 (score multiplied by \exp(-\mathrm{IoU}^2/\sigma)). What are the new scores?
- List two other ways to fix this, and explain how this failure shows up in the mAP metric.
Share this question