Evidence

Do public macro and flow signals beat random placebo signals?

By Justin JaegerPublished Updated

Across 100+ public signals and 135 markets, signals that looked significant before 2015 kept their direction about as often as random placebo signals (53%).

Check a signal against random ones before you build on it. Every signal family ran on the same 135 markets as a set of random placebo signals. Placebo baseline: 4.0% significant before 2015, 53% kept direction after.

Signal familySignalsSignificant before 2015Kept direction after
International data164.4%55%
Cross-border capital flows65.3%11%
Regulatory and corporate filings66.5%31%
Expectations and surveys112.8%54%
Economic expectations23.6%49%
ETF flows174.2%58%
Calendar338.6%39%
Liquidity11.9%48%
Foreign central banks34.7%23%
Positioning23.6%44%
Retail positioning38.0%92%
Real economy36.0%52%
Freight22.4%14%
Semiconductors11.9%0%
International real economy14.4%21%
Government finance31.9%48%
Government and real economy13.4%38%
Uncertainty and news355.2%54%

Caveats

The 2015–2026 test window has been looked at many times during research, so we label it and do not call it a clean holdout. "Beat benchmark" compares each test with a fixed asset mix or buy-and-hold in the same window; a weak benchmark flatters the result. Many tests use US-listed ETFs. Markets in the matrix are strongly correlated.

Terms used: base rate, out-of-sample test, placebo test, dead end.

Before your next backtest

Let your AI check how ideas like yours did before it runs a single test. In our pilot, agents that checked first spent 1% of their backtests on known dead ends instead of 15%, and every backtest not wasted is time and tokens you keep. Cite this entry as ER-SIG, as of 2026-11-01.

Questions

Do macro signals predict market returns?

On our evidence, mostly no: they hold about as often as random placebo signals after 2015.