It was nice talking to ##### over the phone. I think we have zeroed in on a project that fulfills course requirements(AI/Machine Learning) and time constraints. Description: Look at past historical daily (EOD/End of Day) data on SPY, the historical data is available in CSV format from yahoo I believe. The two components looking at in the historical data, are Daily Range (High - Low), and change for the day of SPY. Daily Range Variable = DRV Change Variable = CV Twitter Universe State Twitter Universe State A = Bullish or Upward implications for price of SPY Twitter Universe State B = Bearish or Downward implications for price of SPY Twitter Universe State C = Neutral or no meaningful implication The supposition is that the twitter universe changes as the stock market changes, the proxy we are using for the stock market is the SPY or SP 500. A high range or DRV with a large negative CV implies a downward bias. A high range or DRV with a large positive CV implies a upward bias. A high range or DRV with a small positive CV implies a upward bias. A high range or DRV with a small negative CV implies a upward bias. A low range or DRV with a small positive CV implies a upward bias. A low range or DRV with a small negative CV implies a upward bias. I'm told free TWTR universe data is only available for the past 7 days. We will need to look at the past 7 days of data. And correlate it to DRV and CV. The classification of 'high' range. A running average for the past 7 days need to be made. Anything that exceeds past 7 days will be considered 'high'. The same with CV. What we are looking for in the end is to watch for real time changes in the twitter universe that may correlate with impending price movements in SPY, we can front run and place orders to take advantage of twitter universe implications.
How can you effectively backtest this strategy if you can only access the previous 7 days of TWTR data?
Need to collect forward data, wont be able to backtest it. Trying to find if anything in the TWTR universe is present before large dislocations present themselves.
This is similar to jeffalvinson's approach. He has been using his approach since 1998. Of course his system is much more refined and complex. He is a great guy, a gentleman, perhaps you should PM him. I tried to follow his approach but am unable to achieve result any better than the SPY natural up bias and the leverage nature of its options.