Backtesting Review
Backtesting review is the structured process of evaluating a trading model on historical data and auditing the results for realism and bias before risking capital. In ICT-style discretionary or rules-based models, this includes replay testing, journaling, and verifying that entries/exits follow the model sequence (context → trigger → execution → management). A good review focuses on validity (no bias/leakage), realism (costs/slippage), robustness (multiple regimes), and process compliance (did you follow the model).
Definition
Backtesting review is the audit phase after testing a strategy on historical data. It checks that results are produced without future information (no look-ahead), include real-world frictions (spread/fees/slippage), and remain stable across market regimes. The output is a clear decision: keep, refine, or reject the model, plus a documented playbook of what conditions the model works best in.
Why It Matters
A strategy can look profitable in hindsight while failing live due to bias (look-ahead/data-snooping), unrealistic fills, or overfitting to a single regime. A disciplined review prevents false confidence, forces you to measure what actually matters (risk, drawdown, expectancy), and creates a repeatable improvement loop for ICT models (setup quality, timing windows, and execution rules).
How to Identify
- Confirm your backtest is rule-based enough to be repeatable (clear entry trigger, stop logic, and exit/partial rules).
- Verify data integrity: timestamps are correct, session times are consistent, and the candle you use for signals is the candle you could have known at decision time (no future leak).
- Ensure execution realism: include spread/commission and a slippage assumption (especially during volatility/news).
- Check sample adequacy: enough trades across multiple weeks/months and more than one market regime (trend, range, high-volatility).
- Review metrics that matter: expectancy, win rate, average win/average loss, max drawdown, profit factor, and largest losing streak.
- Perform a compliance audit: did you take only A+ setups, inside your intended session windows, aligned with your HTF bias rules?
How to Trade
- Convert your setup into a checklist with hard rules: context filter(s), trigger (raid/displacement/MSS), entry model (PD array), stop placement, management, and exit criteria.
- Use bar replay and record every trade with screenshots/notes at entry and at exit. Log the reason for entry and whether all rules were satisfied.
- Recompute results after applying spread/commissions and a conservative slippage model; compare gross vs net performance.
- Break performance by session (Asia/London/NY), day-of-week, and regime (trend vs range). Identify where the model truly works best.
- Change only one rule at a time (e.g., displacement threshold, session filter, stop logic). Re-test to avoid data-snooping.
- After a clean historical review, paper-trade/forward-test the same rules in real time before sizing up.
Common Confusions
IF trades are simulated on historical candles with no live execution THEN it is backtesting. IF rules are executed in real time on current data (even without real money) THEN it is forward testing.
IF win_rate is high BUT average_win <= average_loss OR max_drawdown is large THEN the strategy can still be poor. IF expectancy_R > 0 with controlled drawdown THEN it is more likely viable.
IF many parameters were tuned repeatedly on the same dataset AND out_of_sample_test_performed = false THEN assume data_snooping_risk = true. IF results remain stable on unseen data THEN the edge is more credible.
IF costs_included = false OR slippage_model is null THEN expect live performance to be worse. IF conservative costs/slippage and latency assumptions are included THEN results are more realistic.
Explore this concept in Aurora X
Interactive visual examples, AI-powered explanations, and a full library of 90+ ICT concepts.
Try Aurora X FreeRelated Concepts
More Educational Concepts
Accumulation & Distribution
AM / PM Sessions (NY Killzones in ET)
AMD — Accumulation, Manipulation, Distribution (Power of Three)
Glossary and Cheat Sheets (ICT/SMC Trading Reference)
ICT Overview & Trading Philosophy
Income-Based Trading (ICT Style)
IPDA — Interbank Price Delivery Algorithm
Risk Management
Educational resource only. Not financial advice. Trading involves substantial risk of loss.