Interactive Brokers data quality

Discussion in 'Data Sets and Feeds' started by MarketMasher, Dec 22, 2011.

  1. jem

    jem

    I think it is very important for a broker to be able to keep up with the market on heavy days.

    for me... having every quote is far less important than the correct quote.
     
    #41     Aug 6, 2013
  2. It would be impossible to pass through every single transaction in real time over the public internet without risking falling behind occasionally (which is what happens at other brokers who attempt it).

    It also has no value over 200 msec. snapshots for the typical trader.

    If you want to do HF trading, do it elsewhere.

    The data is of higher quality without attempting the impossible, and inevitably failing, at the cost of massively overloading the servers and the clients for no useful purpose.
     
    #42     Aug 6, 2013

  3. You are correct. The billions they made trading really came from the coffee concession.

    Why do folks use the internet to certify for all eternity that they are anus?
     
    #43     Aug 8, 2013
  4. I think a lot of people do not understand this and why it is so.

    When I started futures trading I opted for a broker with the Rithmic feed because of all the wonderful things I read about it when doing my research.

    Being in Thailand with great domestic Internet speeds that fall off dramatically for international connections is not a great foundation for the better feeds.

    First sign all was not right was putting in limit orders 2 ticks away from the market in ES during RTH and getting an instant fill.

    Charting appeared perfectly normal, and it did not happen all the time so no big deal. The perfect storm of fast markets and slow Internet connection did not happen every week even, so one did not notice.

    Until one fine day the market appeared to be exceptionally slow moving, I hovered the cursor over the bar and checked against the clock and horrors, the bar was about 15 minutes behind the clock.

    Days of testing and checking everything with the help of my brokers TS manager found nothing wrong save the Internet connection, and with 10 to 15 international hops AFTER it left Thailand, nothing the ISP could fix on their own either.

    Bottom line, this was the explanation given by the TS manager. Data feeds use the packet system, and because of the sensitivity of the data and its use, later packets are not sent until the server gets confirmation that earlier packets have been received correctly and in full. BTW, line quality matters hugely, when I faced up to 20% packet loss was when things were worst. So if there is constant re-sending because of Internet issues, you fall behind.

    Someone on the Sierra Charts support board was kind enough to provide me a spreadsheet that constantly monitored the data time stamps against the computer clock. One could choose the threshold for the alarm to trigger and it was a real eye opener how much the feed lagged. Less on CL, more on ES because of the volumes.

    I don't have the problem with IB, so I'll happily live with the snapshot data. At least I'm not looking at what happened 15 minutes ago and thinking it is real time.
     
    #44     Aug 9, 2013
  5. def

    def Sponsor

    That's a good explanation. Also, keep in mind human reaction time is typically longer than each snapshot delivered by IB. For those charting and claim they need to see every tick real time, that's an argument for another day. However, for those trading manually, snapshot data in our opinion is the way to go for precisely the reasons given above.

    Have fun, here's a site to measure reaction time and a click of the mouse. I bet most of you are above 250ms and are pushing the 300ms level.

    http://www.humanbenchmark.com/tests/reactiontime/
     
    #45     Aug 9, 2013
  6. RedDuke

    RedDuke

    Yep, average 275.
     
    #46     Aug 9, 2013
  7. Here's an issue I've been running into with the data, which took me a few days to debug (thought it was an issue with my code), for anyone who's working on an ATS.

    Basically when you have fast moving markets and you're submitting orders on fills, you'll end up submitting orders on stale prices, and what compounds the issue is that IB doesn't properly ack all orders.
     
    #47     Oct 15, 2013
  8. xRav

    xRav

    This thread is old, but I'm backing some possible inaccuracies in the data. I'm testing currently NT and optimisation engine and with IB real-time data I found tick level inaccuracies on the same bar.

    I've found it by comparing results from two different machines (comparing optimisation performances).

    I will double check that, because for me it seems like either it is rounding error or inaccurate data.
     
    #48     Dec 28, 2018
  9. RedDuke

    RedDuke

    You do not really need to check. It is a known fact their tick data is a bit off. But their execution and technology is spot on.
     
    #49     Dec 28, 2018
  10. NT8 8.0.16.3 is now supporting tick by tick data from IB
    Updated required version of Traders Workstation for Interactive Brokers to 973 and added the ability to enable additional functionality that is in beta
    Interactive Brokers
    Feature #13053
    The following functionality has been implemented for beta.
    • Unfiltered real-time data
     
    #50     Dec 29, 2018
    RedDuke likes this.