Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Regime change detection with GBDT and Shapley values

Abstract : Regime changes detection in financial markets is well known to be hard to explain and interpret. Can an asset manager explain clearly the intuition of his regime changes prediction on equity market ? To answer this question, we consider a gradient boosting decision trees (GBDT) approach to plan regime changes on S&P 500 from a set of 150 technical, fundamental and macroeconomic features. We report an improved accuracy of GBDT over other machine learning (ML) methods on the S&P 500 futures prices. We show that retaining fewer and carefully selected features provides improvements across all ML approaches. Shapley values have recently been introduced from game theory to the field of ML. This approach allows a robust identification of the most important variables planning stock market crises, and of a local explanation of the crisis probability at each date, through a consistent features attribution. We apply this methodology to analyse in detail the March 2020 financial meltdown, for which the model offered a timely out of sample prediction. This analysis unveils in particular the contrarian predictive role of the tech equity sector before and after the crash.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03320304
Contributor : Eric Benhamou Connect in order to contact the contributor
Submitted on : Sunday, August 15, 2021 - 11:44:35 AM
Last modification on : Tuesday, January 25, 2022 - 8:30:04 AM
Long-term archiving on: : Tuesday, November 16, 2021 - 6:04:13 PM

File

FINPLAN_XAIP.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03320304, version 1

Citation

Eric Benhamou, Jean Jacques Ohana, David Saltiel, Beatrice Guez. Regime change detection with GBDT and Shapley values. 2021. ⟨hal-03320304⟩

Share

Metrics

Record views

131

Files downloads

234