Better System Trader

185: How to avoid creating trading strategies that degrade quickly - Timothy Masters

Apr 12, 2021
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ADVICE

Validate Your Development Process

  • Test the quality of your development process with permutation tests before using live data.
  • If the process fails, stop and redesign it rather than building systems on a weak process.
ADVICE

Run Hundreds To Thousands Of Permutations

  • Run at least 100 permutations, preferably 1,000, to build confidence in permutation test results.
  • Expect original data performance to outperform permuted results if your model captures real patterns.
ADVICE

Perform Parameter Sensitivity Tests

  • Always do parameter sensitivity checks after optimization and inspect neighbourhood performance.
  • Prefer flat performance tops; narrow peaks indicate fragile, overfit parameters to avoid.
Get the Snipd Podcast app to discover more snips from this episode
Get the app