Basic app idea is to monitor RSS feeds of stock market news feeds, feeds usually direct to webpages. Form webpage collect info and miss images etc high data content. Then save pages to disk in compressed format with timestamps. Later open viewer and select article text area of webpages by offering few example text areas of same site to autocollect rest of the same page text from other article files of similar html code and save to disk only article content without rest of html code. Keeping 2 formats(filtered articles and html pages) on disk would allow for later repairs if things go wrong. If some change has occured to site code or problem detected in article filtering ask again to set text part up by few examples and autofind further text. Maybe I am reinventing the wheel here and similar software is available? Does anyone have good idea for method on how to easiy filter out news articles in webpages for automatic saving? Ideal config would be if fully automatic but that may not be possible without machine learnig and enough manually configured sample data. One idea is to seek html code to filter out the text. But better idea would be if it is the html code filtering+ visual space ratios of rendered page. What would be easiest way to connect web page text positions to html code positions? I am sure someone here has done something like this or similar software is already avalible.
Check out NewsEdge v8 - http://www.acquiremedia.com/products/newsedgev8/ Lime Brokerage LLC is not affiliated with this service providers. Data, information, and material (“content”) is provided for informational purposes only. This content neither is, nor should be construed as an offer, solicitation, or recommendation to buy or sell any securities. Any investment decisions made by the user through the use of such content is solely based on the users independent analysis taking into consideration your financial circumstances, investment objectives, and risk tolerance. Lime Brokerage LLC does not endorse, offer nor recommend any of the services provided and any service used to execute any trading strategies are solely based on the independent analysis of the user.
Getting the news is the least difficult piece. Getting the news in time to react and curating the news for actionable intelligence within reasonable time is not cost effective. Tagged news sources can be easily acted. Example IB's news will have positive / negative tags. Look at Twitter Developer APIs. Bloomberg does seem to have curated machine readable feed for those who can afford. I have never seen that nor know anything in depth about it. How do you curate "Police used tear gas on protesters in Hong Kong" to market drop is imminent? There is so much language processing which makes it difficult to do on a typical home grade server. Everytime the headline will be different but meaning may remain the same. Precise logic will fail.
there are some services that focus on "bIg dAtA" aka looking what social Media is chatting about. I'd like to read some studies about the reliability though, since the troll accounts should be able to mess with it's predictability. Probably Jartek already somewhere working on smth like that right now
There are pretty complex sentiment analysis and NLP algorithms and plugins available for free on github for the technically inclined. Not saying they are the holy grail but they are important building blocks that companies like Bloomberg and Dow Jones also use.
We offer Social Market Analytics (SMA) on Lightspeed Trader-https://www.lightspeed.com/news/social-market-analytics-sma-partners-with-lightspeed-a-division-of-lime-brokerage/. We are doing a Webinar on June 24- https://www.lightspeed.com/education/live-webinars/ This is their Website -https://www.socialmarketanalytics.com/ Lime Brokerage LLC is not affiliated with this service providers. Data, information, and material (“content”) is provided for informational purposes only. This content neither is, nor should be construed as an offer, solicitation, or recommendation to buy or sell any securities. Any investment decisions made by the user through the use of such content is solely based on the users independent analysis taking into consideration your financial circumstances, investment objectives, and risk tolerance. Lime Brokerage LLC does not endorse, offer nor recommend any of the services provided and any service used to execute any trading strategies are solely based on the independent analysis of the user.