Key numbers
| Measure | Value |
|---|---|
| Tests | 126 |
| Idea variants | 20 |
| Beat benchmark | 15.9% |
| Median Sharpe vs benchmark | −0.93 |
| Looked good before 2015 | 1 |
| … and held after | 100.0% |
| Verdict | Dead end |
By asset class
| Asset class | Tests | Beat benchmark | Median Sharpe vs bm | Verdict |
|---|---|---|---|---|
| US equities | 53 | 17% | −0.90 | Dead end |
| single stocks | 34 | 0% | −1.47 | Dead end |
Caveats
The 2015–2026 test window has been looked at many times during research, so we label it and do not call it a clean holdout. "Beat benchmark" compares each test with a fixed asset mix or buy-and-hold in the same window; a weak benchmark flatters the result. Many tests use US-listed ETFs.
Terms used: base rate, out-of-sample test, placebo test, dead end.
Let your AI check how ideas like yours did before it runs a single test. In our pilot, agents that checked first spent 1% of their backtests on known dead ends instead of 15%, and every backtest not wasted is time and tokens you keep. Cite this entry as ER-CAL-ALL, as of 2026-11-01.
Related evidence
Questions
Do calendar effects work?
Calendar effects were tested 126 times across 20 idea variants. 16% beat their benchmark in 2015–2026 after costs, with a median Sharpe difference of −0.93. Verdict as of 2026-11-01: dead end.
Is this investment advice?
No. These are research statistics, not recommendations.