
Better System Trader 185: How to avoid creating trading strategies that degrade quickly - Timothy Masters
Apr 12, 2021
AI Snips
Chapters
Transcript
Episode notes
Validate Your Development Process
- Test the quality of your development process with permutation tests before using live data.
- If the process fails, stop and redesign it rather than building systems on a weak process.
Run Hundreds To Thousands Of Permutations
- Run at least 100 permutations, preferably 1,000, to build confidence in permutation test results.
- Expect original data performance to outperform permuted results if your model captures real patterns.
Perform Parameter Sensitivity Tests
- Always do parameter sensitivity checks after optimization and inspect neighbourhood performance.
- Prefer flat performance tops; narrow peaks indicate fragile, overfit parameters to avoid.
