IB data feed

Discussion in 'Data Sets and Feeds' started by simki, Nov 1, 2005.

  1. EVERYONE's software will be "wrong" if you use IB's datafeed for tick charts simply because IB's datafeed is NOT tick-by-tick, and IB explicitly tells you so. Its not a matter of our algorithm, yours, or someone else's. It is simply impossible to extract EXACT ticks from IB datafeed. You can only do best approximation.
     
    #31     Nov 17, 2005
  2. Could anyone recommend a data vendor that does provide real time Tick BY Tick Data? I was thinking of using Ensign with the IB feed. Traders here have recommended using this combo. Would this be a complete waste of time for a trader who uses Time & Sales data for both entry and exits? Any insight and first hand knowledge would be helpful.

    Thank you
     
    #32     Nov 17, 2005
  3. Personally, I use IQFEED with everything else. It is exceedingly good and I am very sensitive to every tick depending on how I trade on a given day. What IB lacks in tick accuracy, they gain in load efficiency. What I mean, as was explained elsewhere, is that IB is snapshot oriented. The weakness is as described here. The advantage is when the market is hyper (ie. really moving along or cascading through stops). A design that takes a 300ms snapshot will not lag whereas a feed that is designed to pump out updates for each tick will lag given the number of updates being pushed out from the server to it's connected clients. With snapshot, IB sees the same load being pushed out regardless of whether the market is stagnate or racing... It is a tradeoff. Because of this, I have both as partners. If things are racing, I switch to monitoring IB data since it always able to keep up without lagging. When things are slow, I am on IQFEED. FOMC announcements tend to be the best time for noticing this disparity...
     
    #33     Nov 17, 2005
  4. alanm

    alanm

    Quote from Andrew Kirillov:
    3. I believe your example and general understanding is not valid, because Total volume will be always changed for each new tick and you always know tick size of a trade = Current Total volume – Previous Total Volume.


    Specifically, the above quote appears to the be source of the misunderstanding. If you see:

    13:00:00 TotVolume=13350
    13:00:01 TotVolume=13360

    you have no way to know if this represents 1 trade of 10 contracts, 10 trades of 1 contract each, or something in between. This IS by design. It's not supposed to be a tick feed. myTrack (www.myTrack.com) provides tick-by-tick, AFAIK.
     
    #34     Nov 17, 2005
  5. Smalltrader,

    Everything depends on exactly how you trade. This (not infrequently repeated) discussion just raises the issue of how IB generates "IB Ticks." To optimize internet traffic they don't send a data packet for every true tick but bundle them and send a maximum of 5 packets per second (it could be 2, I dont recall, but within reasonable numbers of displayed items it certainly doesnt vary).

    This has a disadvantage: the tick count is not "true"
    This has an advantage: on fast movers like HSI IB doesnt get lag in its datafeed like esignal so you get "now data"

    I use tick charts but my decisions are based on IB ticks. If I used non-IB ticks my rules would need to allow for the difference. So, IB ticks which give me an activity based chart with a minimum granularity of 200ms work well for me on HSI.

    Volume is a different discussion and actually varies from exchange to exchange (in my understanding) depending on whether they report true volume.

    But THE REAL TRADERS QUESTION is "can I develop a set of rules around this known data stream that achieves my trading objectives?" IMHO :)
     
    #35     Nov 17, 2005
  6. Thanks for your responce. I use the Tape (Times & Sales) for both my entry and exit. I am in and out in seconds to minutes. I need a new data feed so my real question is how would using the IB Data along with Ensign charting work for my style of trading? I dont want any lag on the tape especially when the market is moving fast and I want to be able to see trade by trade on the tape. If I use IB & Ensign will I have what I need? If not what data package would you recommend? I have used e-Signal and I an currently using Instaquote. I will not return to e-Signal and Instaquote dosen't provide data for the Dax & ER2.

    Thank you
     
    #36     Nov 18, 2005
  7.  
    #37     Nov 18, 2005
  8. Has anybody as of late done a timing accuracy check of IB tick data against CME or CBOT nightly published T&S? Don't bother about missing ticks. How accurate are those you got? (This requires recording ticks together with a precision timing source).

    Any other information on data feed accuracy?
    Thx
     
    #38     Nov 18, 2005
  9. drexl

    drexl

    IB's TWS does not necessarily report each tick

    FYI, and this comes from the IB Help Desk, TWS does not necessarily report each tick.

    It only reports each data CHANGE in bid,ask, and last price/size.

    SO, if lastPrice = 1.1177 and lastSize = 1, unless the NEXT price and size <> 1.1177 and 1, THEY WILL NOT BE REPORTED.

    In simple terms, if the current price/size = LAST price/size, this is not reported as the data 'never changed'.

    This being the case, any cumulative volume calculations based on the TWS API's will not coincide with the volume data.

    And from my own experience, this discrepancy can be/is HUGE.

    I have a suspicion that this is why one might think that the various charting apps mentioned might not be handling the real time volume so well.

    It is isn't the APP.

    Its the DATA FEED . . .
     
    #39     Nov 19, 2005
  10. You must calculate volume bars from TWS VOLUME events (not LAST_SIZE event). These report cumulative volume. If you do this then volume bars are fairly accurate and fairly closely correspond to backfill data. Jerry Medved has pointed this out several times and he is quite right about it.

    Charting vendors that havn't worked this out by now should lift their game.
     
    #40     Nov 20, 2005