Predictions can change the actual outcome, a phenomenon called performative prediction. This distribution shift can severely hurt model performance, so I'll share approaches to mitigate the problem.
"See deployment as an intervention. Analyze with causal inference" - best of all in my view,
Plus "Keep model workings secret. That’s what many companies do so that their algorithms cannot be “gamed”. Examples are credit scoring and search rankings." - what will happen when XAI kicks in and counterfactuals can expose the model don't they ?
Thank you Chris for a great and informative article!
"See deployment as an intervention. Analyze with causal inference" - best of all in my view,
Plus "Keep model workings secret. That’s what many companies do so that their algorithms cannot be “gamed”. Examples are credit scoring and search rankings." - what will happen when XAI kicks in and counterfactuals can expose the model don't they ?
Thank you Chris for a great and informative article!