Glossary

Dead end: definition and a real example

By Justin JaegerPublished Updated

An idea class that failed repeatedly after costs: fewer than 20% of tests beat the benchmark and the median result was clearly negative.

Definition

An idea class that failed repeatedly after costs: fewer than 20% of tests beat the benchmark and the median result was clearly negative.

Example from the register

Intraday timing rules are one example: 7% of 71 out-of-sample tests beat their benchmark, with a median Sharpe difference of −1.16. See the dead-end register.

Why it matters

Most strategy research reports the best result and leaves out how it was found and what failed. Base rates, placebo tests, trial counts and out-of-sample checks are the four tools that separate an idea with evidence behind it from a lucky backtest.

See it applied in the base rates, the dead ends and the methodology.

Questions

What is a dead end?

An idea class that failed repeatedly after costs: fewer than 20% of tests beat the benchmark and the median result was clearly negative.