Market Regime Classification vs. Optimization Overfitting

[Gio Rendel Masagca Rivadillo]

I've been thinking about market regimes lately and I'm starting to question how we normally build EAs.

Most strategies are basically built around the assumption that the market behaviour we see in the backtest will continue to exist in the future. But we all know that isn't always the case.

A trend following system can perform really well during a strong directional market and then completely fall apart when volatility contracts and the market becomes more mean reverting.

So I was wondering if instead of constantly optimizing the parameters of an EA, it would make more sense to first identify what type of statistical regime the market is currently in.

There are several ways this could potentially be approached: volatility clustering, regime classification, hidden Markov models, Bayesian inference, unsupervised clustering, or even a relatively simple feature-based classifier using variables such as volatility, autocorrelation, momentum persistence, volume characteristics, and market structure.

The EA wouldn't necessarily need to predict the next price. It could just try to determine whether the current environment looks more like a trending regime, mean reverting regime, high volatility regime or something else.

Then the trading logic could change depending on the classification.

For example, during a trend regime the EA could use a trend following model, while during a mean reverting regime it could switch to a mean reversion model. During extreme volatility it could reduce exposure, and during an uncertain regime it could simply stay out of the market.

But there is something that bothers me about this approach.

If we optimize the regime detection using historical data, aren't we just introducing another layer of overfitting?

Instead of curve fitting the entry and exit rules, we might end up curve fitting our definition of the market regime itself.

So I'm not really sure whether adaptive EAs are actually more robust or whether we're just making curve fitting more sophisticated.

Has anyone here experimented with this seriously?

I'm interested in whether anyone has found a practical way to validate this kind of approach without relying too heavily on historical optimization. For example, how much weight do you put on walk forward testing, Monte Carlo analysis, and genuinely unseen out of sample data when deciding whether a regime based system is actually robust?

I'm also curious whether people think there is a point where an adaptive EA becomes too complex to trust. If the system is constantly classifying regimes, changing models and adjusting its behaviour, how do we know it is adapting to something meaningful rather than simply reacting to noise?

[fxsaber]

Gio Rendel Masagca Rivadillo:

If we optimize the regime detection using historical data, aren't we just introducing another layer of overfitting?

Here I proposed performing several optimizations within the optimization criterion itself, and then intersecting their results.

Unfortunately, the post is extremely difficult to understand.

[Gio Rendel Masagca Rivadillo]

fxsaber #:
Here I proposed performing several optimizations within the optimization criterion itself, and then intersecting their results.

Unfortunately, the post is extremely difficult to understand.

Thanks, I'll take a look into it.