When to Stop a Trading System

Discussion in 'Automated Trading' started by SimpleMeLike, Nov 13, 2022.

  1. Hello All,

    Here are some example 16 year back test systems performance metrics for :

    upload_2022-11-13_12-34-3.png

    Questions:

    1. When do you recommend to stop the system due to system losing too much money? I am thinking somewhere between 2-2.5 times drawdown

    Thank you
     
    Last edited: Nov 13, 2022
    AlexYang likes this.
  2. I read one of the Hedge Fund Market Wizards books. It's been a while but if I recall some of their swings could be wild. If I remember it was not uncommon to see a -50% drawdown on a system that averaged 20% a year. That's why there was a rule that only wealthy individuals with a certain net worth could put their money into hedge funds. It was reasoned such people would understand things like severe drawdowns but the average joe who had little money would flip out and demand a withdrawal.
     
    Last edited: Nov 13, 2022
  3. TrAndy2022

    TrAndy2022

    Another rule you can watch out, is the underlying market reward-risk-ratio how much it goes up to its drawdown in relation the combined portfolio. When the portfolio is worse than it does not make sense to trade this, because B&H would be better in this case. Here you can also divide any time period into sub periods to measure this.
     
    SimpleMeLike likes this.
  4. tiddlywinks

    tiddlywinks

    Just throwing this out there...

    Target Hit Rate might offer a warning of a waning or inappropriate environment for the system.
    If there is no target, the system is incomplete. NB: taking that target or not is a different topic.

    Another area to consider, the type of system and the expected hold duration. Looking at the data table, System B is with lower W/L and lower Profit factor is returning greater than 50% more nominal profit, with a maximum drawdown increase of only approx 30% in context of the other 2 systems.
     
  5. hilmy83

    hilmy83

    I say when you start to underperform the standard buy and hold index fund for any given year. The name of the game is how profitable you are and whether your risk profile can survive the worst drawdowns
     
    zghorner and SimpleMeLike like this.
  6. this system is superb. How long do you hold your position? But the number of trades is too small for a period of 16 years. Anyway, nice system
     
    Last edited: Nov 13, 2022
    SimpleMeLike likes this.
  7. SunTrader

    SunTrader

    Seriously?

    Plenty of hedge funds every year have experienced wealthy individuals demanding their money back when severe drawdown-istis strikes.

    Geez did you get that from some SEC gubmint protect us all document "while Rome burns" and Madoff makes off with billions.
     
  8. Hello hilmy83,

    Thank you for responding.

    Good point
     
  9. Businessman

    Businessman

    There should be some really bad drawdown(s) in your back test already. Otherwise it is probably curve fit or not long enough.

    This maybe the case with your back test (hard for me tell given your limited metrics).

    If so anything more than the biggest drawdown that you saw in the last 16 years would be a red flag.
     
    SimpleMeLike and smallfil like this.
  10. Everyone knows that.
     
    #10     Nov 13, 2022
    zghorner likes this.