Prometheus for Trading Data Insights?

Discussion in 'Automated Trading' started by kmiklas, Jan 16, 2024.

  1. kmiklas

    kmiklas

    Anyone using Prometheus as a financial data platfom?

    Free and open-source...

    https://prometheus.io/

    EDIT: Title update.
     
    Last edited: Jan 16, 2024
  2. 2rosy

    2rosy

    prometheus is for alerts, monitoring, telemetry. like datadog, grafana, influxdb telegraf, ...
    Not for data collection/storage
     
  3. kmiklas

    kmiklas

    Good point... changed title.

    That being said, Prometheus does have a time-series DB.

    Perhaps usable as a cost-effective algo trading data platform? Visualizations with Grafana?
     
    Last edited: Jan 16, 2024
  4. BMK

    BMK

    I thought Prometheus was the name of a film directed by Ridley Scott
     
  5. kmiklas

    kmiklas

    https://prometheus.io/

    It's a bit of a force.. square peg into round hole.. but the price is nice (FREE) and it's quite powerful.
     
  6. 2rosy

    2rosy

    everything is free. Prometheus is used to see if your order gateways are up, market data is up, latencies, tracing, charts, systems are up. Every firm uses something like it: from airlines, to power plants, to retail, manure manufacturers, ...
     
  7. WiktorK

    WiktorK

    This answer is wrong... Prometheus is just a time series database shipped with data HTTP scrapers. Mostly used for metrics indeed.

    There is no alerting in prometheus itself, but it is often shipped with alertmanager which does that (prometheus is jus able to compare the metrics value with given threshold and mark it as in or out of range -> this is not alerting)

    There is no telemetry in prometheus, but it works with telemetry data from various sources

    "like datadog, grafana, influxdb telegraf"

    datadog - all in one cloud platform. It is diffrent in ficntionalities, the way it it working and being OpenSource...
    Grafana - this is just a data visualisation tool (yes often used with prometheus, but it works with 700 or something databases types
    influxdb - only a timeseries database...
    telegraf - it is a proxy for sending and converting various datatypes

    So actually only Influx is kind of like prometheus!
     
  8. WiktorK

    WiktorK

    I have tried it once, but given this up as PromQL (the query language for prometheus) was not very suitable for my purposes

    But financial data (prices across time) is a timeseries data so prometheus is a perfect database to store it (for me it is just easier to use a standard SQL database and have its queries)