Discussing the article: "Is Your Expert Advisor Still the One You Backtested? An Edge Drift Detector in MQL5"

Check out the new article: Is Your Expert Advisor Still the One You Backtested? An Edge Drift Detector in MQL5.

An equity curve cannot tell whether a live Expert Advisor still matches its backtest. This MQL5 tool compares live closing deals to a backtest baseline using a bootstrap-calibrated CUSUM shortfall detector, a change-point estimate, short and long window checks, and an expectancy decomposition. It summarizes the evidence as a configurable A+–F score and a rule-based verdict: CONTINUE, WATCH, REDUCE, or SUSPEND.

Every Expert Advisor I have put on a live account started with the same promise: a Strategy Tester report that looked good enough to fund. The hard part came later. After a few months of live trading, the account was still in profit, but something felt different. The question I could not answer with the standard reports was simple: is this still the strategy I tested, or has its edge quietly disappeared?

The question comes up regularly on the forum. A recent thread titled "How do you detect when your EA stops matching its backtest?" describes the usual situation well. By the time the degradation is visible on the equity curve, the trader is already 10–15 trades into the drawdown. The author proposes comparing live trades with the backtest distribution using a CUSUM statistic and leaves three questions open. The fixed 4σ threshold feels arbitrary. Trade results are not normally distributed. It is also unclear how to tell a temporary regime change from a real decay of the strategy.

This article builds a tool for the first two questions and is explicit about the limits of the third. The reader brings two samples of closing deals: the backtest that justified going live (the baseline) and the live account history since then. The tool then tests one specific hypothesis in measurable terms: has the average live result per deal fallen below a chosen share of the baseline edge? Every probability it reports is conditional on a stated model. The live deals are treated as draws from the same distribution as the baseline deals until the evidence says otherwise.

Author: Cristian David Castillo Arrieta