2 min read
Backtesting vs Alerts: A Practical Comparison Guide
A realistic workflow for comparing backtests with live alerts, plus the most common sources of drift.
Backtesting vs Alerts: A Practical Comparison Guide
Backtests are a controlled simulation. Alerts are the signals your strategy actually emits in live conditions. Comparing the two can explain performance gaps, but it will not produce a single "true" answer. This guide focuses on a realistic workflow that works even when data is noisy.
What this comparison is good for
- Finding missing or extra alerts
- Measuring timing drift between backtest bars and alert timestamps
- Estimating slippage between alert price and fill price
- Building a baseline you can compare month over month
What it will not do
- Reconstruct exact execution without broker fills
- Normalize outcomes for thinly traded symbols
- Guarantee future performance
A practical workflow
1) Pin the exact test window
Use the same symbol, timeframe, and session settings. If your strategy uses extended hours, make sure alerts do too.
2) Export the backtest trades
From TradingView, export the trade list and keep the strategy version in the filename so you can reproduce it later.
3) Collect alert data
In Algo Trade Analytics, filter by the same symbol and date range. If you have multiple alert versions, label them by ID.
4) Align timestamps
Expect small drift. Align on bar close time and allow a tolerance window that matches the timeframe (for example, 1 to 2 minutes on higher timeframes).
5) Compare outcomes
Look at:
- Missing alerts
- Extra alerts
- Timing differences
- Price differences between alert and fill
Common causes of mismatches
- Session settings do not match (regular vs extended hours)
- Strategy code changed after the backtest
- Alerts created with a different resolution
- Broker rejections (insufficient buying power, order size limits)
- Data feed differences between backtest and live
When to re-run the analysis
- After strategy changes
- After a broker or account change
- When live performance deviates from your baseline
Bottom line
This comparison narrows uncertainty. With a consistent workflow and good notes, you can track improvements over time and spot issues early.