Visualizing Large Data Sets

Discussion in 'Trading' started by kmiklas, Jul 29, 2021.

  1. Snarkhund

    Snarkhund

    I used to work with large data (terrabytes) and wrote the flight data readers (reading hdf5 raw flight data into ML and Python for analysis) for the F-35 Lightning and F-22 Raptor at the USAF Flight Test Center.

    You will want MATLAB or Python (both is best) for truly large data. Honestly though you can get pretty far in Excel with just 100,000 lines of data. That isn't large data.

    For financial data its best to populate an SQL database and hit it from a MATLAB connection object with queries formed in MATLAB or Python.
     
    #11     Aug 8, 2021