Unfortunately you must be the only one who likes to immerse himself in trading porn. Would you also like to put a device on your schlonk that gets you off upon profitable trades?
Sorry to ask such a simple and basic question guys but...are the earnings and company data these large corporations release that cause stock prices to move scheduled for release. As in does the company say "We'll be releasing these at 9am 23rd October" or are they just published and whoever reads them first is first off the mark sort of thing?
You may find some headlines like "... Announces Third Quarter 2015 Earnings Release Date and Conference Call" which is some time in advance. There is always "someone/something" who reads the news first
that actually would be cool. And if someone wrote a system like that I am certain they could get a job in trading. It shows ability to be creative and think uniquely unlike all the how to store tick data, backtest, big data bs
Only shows you have no clue what champions in the trading arena invest in and build on. The whole premise and success of rentec was essentially built on big data. Most every hedge fund with sizable aum is heavily investing in this space because they cannot afford to miss out. Just because your home PC cannot handle large data sets or because you lack the skill set to make sense of unstructured data does not negate this extremely important and promising field.
Most use existing software like spark or hadoop. Nosql databases. Job schedulers. Rarely do you see a firm ,let alone a hedge fund ,write these from scratch which is the interesting development piece. Using these tools is mundane ETL that can be outsourced to someone like yourself for peanuts
Using these tools is one thing, but doing this efficiently is something else. From my own experience, I do know a lot of businesses handling their trading data on basis self developed pieces of code with high effort.
The products you are talking about are for data storage and data management. The topic here is about data analytics and data intelligence. Do you want to at least attempt to maintain am intelligent discussion or prefer to further water it down via misinformation and unrelated issues?
In my city i dont know of any trading firm reinventing a database or datastore. They use an existing solution.