Activate/Deactivate System?

Discussion in 'Journals' started by EricP, Jul 29, 2004.

  1. EricP

    EricP

    Some systems continue to be profitable, while others fade away. My main system in the late 1990's stopped working in early 2000. This was an arbitrage strategy that relied on speed, and some trading opponent became faster while his arbitrage machine that I could possibly make mine.

    When applicable, I try to make my systems auto-adjusting to market conditions, however, to allow them to last as long as possibly. For example, any system that is affected by market volatility could be fitted with variable parameters than automatically adjust to the volatility of the market. As a result, smaller profit targets and stop losses could be taken when the market is less volatile, and these targets and stop points would automatically widen when the market begins to swing more violently.

    -Eric
     
    #71     Mar 10, 2005
  2. EricP

    EricP

    Man, I am with you on that one. Seems the best way to turn around a system in a slump is to manually deactivate it. I have had this problem repeatedly over time, and have therefore found that it's best (for me) to make the activation/deactivation decision 100% mechanical. Certainly, every trader MUST have some process (even if it's discretionary) for turning OFF a system that is being traded. This is necessary to protect the trader against the continued trading of a system that is no longer viable and begins to consistently lose money. As with anything else in trading, you must develop an activation/deactivation style that you can be comfortable with. There is no right answer for everyone.

    -Eric
     
    #72     Mar 10, 2005
  3. nitro

    nitro

    Are you saying you are trying to solve it, or that you have solved it ? :eek:

    Either way, welcome back.

    nitro
     
    #73     Mar 10, 2005
  4. In 2004, I changed systems 4 times. My results were good enough, but subsequent testing revealed that if I had used any one of those systems all year, I would have done considerably better!

    To further look into this, I added a feature to my testing software that takes a list of systems and a time interval as inputs, and produces a "switch list" as the output. The switch list can be either "switch to what worked best in the prior period" or "switch to what worked worst". The switch list then becomes the input for a new test.

    I then did lots of testing of this sort, using different periods and different systems. The results showed that, on average, it is best to change systems as infrequently as possible, and if you are going to change, it is better to switch to a system that was not one of the best in the most recent period.
     
    #74     Mar 10, 2005
  5. nitro

    nitro

    I have done similar studies, but the problem is that I did not have voluminous data to do a "real" test.

    How long was your testing period? Was it just 2004?

    nitro
     
    #75     Mar 10, 2005
  6. What I'm using is daily bars for a large universe of stocks. My systems tend to generate about 1000 trades/year. I do most of my testing using the most recent 3 or 4 years, but sometimes go back 8 or even 12 years.

    If I run a really long term system comparison test (say 10 years, 10000 trades), all the systems do about the same, even though in a given year, one might do twice as well as another.

    All this points to just picking a system and stiking with it, but I still find this difficult when testing shows dramatically better recent results for a different system. So, I continue to search for a system switch algorithm that beats the long-term average.
     
    #76     Mar 10, 2005
  7. nitro

    nitro

    Ah,

    You are using daily data - you are in a totally different place than I am then.

    nitro
     
    #77     Mar 10, 2005
  8. mc107

    mc107

    You misunderstanded my question. I mean that you deactivate your system if its confidence level of profitability is ABOVE 99%.

    Thanks,
    Jim
     
    #78     Mar 10, 2005
  9. EricP

    EricP

    I'm not sure I understand what you are trying to say. Assuming that their is a statistical confidence level of 99%+ that as system is profitable... => Why in the world would I want to deactivate it from real trading? I wish every single system that I trade had that high of a confidence level. Obviously, I'm using the assumption that my testing was valid and that the results are not "too good to be true" due to an error on my part.

    Assuming that there are no significant errors in my testing (which better be the case, or else reviewing the statistics is worthless in the first place), then I would certainly NOT deactivate such a system.

    I guess I'm not sure of your point. Under what circumstances would you consider deactivating the systems that appear to be the best ones you have?

    -Eric
     
    #79     Mar 10, 2005
  10. almost ...
     
    #80     Mar 10, 2005