backtesting is stupid

Discussion in 'Strategy Development' started by jonp, Jul 15, 2010.

  1. jonp

    jonp

    that's all i have to say.
     
  2. I have nothing better to do with my time than wait for my inevitable death, passing the time until then with interminable backtests, so I'll debate you. Your move.
     
  3. Anyone and everyone who trades uses nothing but historical data as the basis for their trading decisions. Even tick charts are history by the time they reach one's screen. So anyone who trades and says that backtesting isn't a valid concept is contradicting themselves.
     
  4. jonp

    jonp

    First of all lol.
    second, i'd love to master debate with you, just not now, I'll be back in a few hours.
     
  5. This sounds an awful lot like...eeewww

    :D

     
  6. Nothing at all wrong with studying historical data.

    'course most people have no f'ing idea how to do that.

    (hint: a TradeStation equity curve isn't it)
     
  7. I'll be here, if I don't die first. Will it take you that long for you to devise your opening move? I kind of feel sorry for you already, you being at an intellectual disadvantage and all. I have to warn you that I am no dummy. I spent three years mastering the ninth grade. Got it down solid. I'm going to go take my old man nap now so I'll be sharp for your killer next post.
     
  8. Here's an example of how backtesting can be useful.

    Why spend years trying to decipher Jack Hershey's "teachings" when you can easily test those aspects of his "methods" that are quantifiable and see that they're unprofitable?

    For example, Jack unsuccessfully tried to impose static parameters on stocks in "Tomorrow's Newspaper Today" (attached). I tested buying the "0 to 7 turn" of Jack's "P,V relation" per page 8 of his paper on 1000 stocks from 2000 to 2005 -- a total of 5000 stock-years -- using spydertrader's code for the scoring and exiting 5 days later and got the equity curve below.

    [​IMG]
     
  9. Whimsy

    Whimsy Guest

    Well let's say I have an idea about an edge. It seems to work when I look at a chart during the day. But, am I really seeing what is happening or what I expect to happen?

    The ability to code up the idea and run it on past market action will, if I properly coded my idea, show whether the edge existed in the past. This assumes proper allowance for slippage, etc., etc.

    If the backtest fails, my edge was illusory as my brain was mis-interpreting the chart. If it shows a good win percentage or whatever metric I'm looking for, it confirms my idea. However, backtesting does not guarantee that the edge still exists. I think any discussion should address how the market constantly changes and how to handle the change.
     
  10. Brilliantly put. Memory fools fools' memories.
     
    #10     Jul 15, 2010