Check your back-test data

Discussion in 'Strategy Building' started by mrez114, Mar 8, 2015.

  1. moonmist

    moonmist



    I had similar experience:

    About two years ago, I developed a very simple automated trading system using TWS /Sierra Chart. At that time, I thought Interactive Brokers' data were good enough for Globex futures back-testing, and real-time trading.

    Once the automated system executed a LIVE trade, and was stopped out at breakeven plus one tick. (Sierra Chart would move the stop loss order upon 10-tick profit.) After the market closed, I ran a back-test to make sure that the system could reproduce the LIVE signal. No problem. Ran it for the second time. Same result. Finally, I did a "delete and re-download all data", and ran the back-test for the third time. The signal was gone. Ran the back-test for the fourth time. Nothing.

    Like the OP, I switched to IQFeed, which is the same as Kinetick, to keep my sanity.
     
    #11     Mar 10, 2015
  2. jharmon

    jharmon

    Re Moonist:

    Next time you need to be like "CSI" and do the forenzics and figure out "why" and ask them why this happened.

    It could simply be a cancelled trade causing this and that is the way they deliver their data. You might not receive the cancelled trade until hours later.

    The only way to be really sure is to look at an unadulterated version of the sales data for that day with all of the trade condition codes so you can pinpoint what is going on.

    It might be a case of "they are both right" in terms of their published methodologies but without knowing you might just be substituting one flawed system for another.
     
    #12     Mar 10, 2015
  3. moonmist

    moonmist

    This seems to be the answer:

    http://www.elitetrader.com/et/index...correct-market-data-feed.283277/#post-3962726
     
    #13     Mar 10, 2015
  4. mrez114

    mrez114

    Hi abattia, so something really weird happened. I haven't been able to convert 20 years of data i purchased, but did follow your suggestion with 6 months worth of data in 2010 to see the Flash Crash. When I imported the data using Easter Time Zone, Flash crash occurred at 11:45am, so I blew it away and re-imported data using Pacific Time Zone. This gave me the result I was looking for, but now I am totally confused. Which Time Zone did backtestdata.com initially save this data in? Why did Pacific Time Zone worked?
     
    #14     Mar 10, 2015
  5. Paghy

    Paghy

    mrez114,

    I tried contacting you via your blog, but never heard back. Maybe you have given up on backtestdata.com (AKA ninjatraderdata.com). Anyhow, I found this thread and thought I would reply to you here.

    I hate to break bad news to you, but all the reviews you are referring to are fake. Both Backtest Data (backtestdata.com) and Ninjatrader Data (ninjatraderdata.com) are operated by the same company out of China. A quick lookup and you will discover both sites are sharing the same server host.

    Want more proof the reviews at Ninjatrader Data (ninjatraderdata.com) are fake? Try submitting a review. Surprise, you can't. The submission page doesn't even work. From the same bad english, grammer & spelling, I would say all the reviews are from one person. Most likely of Chinese descent.

    As you already guessed, yes, you were scammed.

    Paghy
     
    Last edited by a moderator: Nov 3, 2015
    #15     Nov 3, 2015
  6. pcijoin

    pcijoin

    They saved in New York Eastern Time. I bought the all future historical data and market replay data pack from them an year ago and had no such problem as you described. Their customer service was pretty smooth. Did you mix the data with other data you already have in your computer? Also from whois I check, Backtestdata.com is hosted in New York and its DNS is in Cloudflare CDN I think.
     
    #16     Nov 16, 2015