Base rate

Attention and news signals: base rate from 24 out-of-sample tests

By Justin JaegerPublished Updated

Attention and news signals were tested 24 times across 6 idea variants. 21% beat their benchmark in 2015–2026 after costs, with a median Sharpe difference of −0.07. Verdict as of 2026-11-01: no consistent edge.

Key numbers

MeasureValue
Tests24
Idea variants6
Beat benchmark20.8%
Median Sharpe vs benchmark−0.07
Looked good before 20153
… and held after33.3%
VerdictNo consistent edge

Caveats

The 2015–2026 test window has been looked at many times during research, so we label it and do not call it a clean holdout. "Beat benchmark" compares each test with a fixed asset mix or buy-and-hold in the same window; a weak benchmark flatters the result. Many tests use US-listed ETFs.

Terms used: base rate, out-of-sample test, placebo test, dead end.

Before your next backtest

Let your AI check how ideas like yours did before it runs a single test. In our pilot, agents that checked first spent 1% of their backtests on known dead ends instead of 15%, and every backtest not wasted is time and tokens you keep. Cite this entry as ER-ATT-ALL, as of 2026-11-01.

Related evidence

Questions

Do attention and news signals work?

Attention and news signals were tested 24 times across 6 idea variants. 21% beat their benchmark in 2015–2026 after costs, with a median Sharpe difference of −0.07. Verdict as of 2026-11-01: no consistent edge.

Is this investment advice?

No. These are research statistics, not recommendations.