The Drop Test for Robustness, or Drop, and Give Me Significance***
At the Conference on Frontiers in Machine Learning and Economics (2025), Professor Tamara Broderick from MIT gave a brilliant keynote, based on the paper An Automatic Finite-Sample Robustness Metric. It’s a metric that measures how sensitive are conclusions to the removal of just a small fraction of data? Motivation Even dropping a vanishingly small proportion of observations can matter. We should worry if removing a fraction $\alpha \in (0,1)$ of the data:...