AQR’s Problem With Machine Learning: Cats Morph Into Dogs

Discussion in 'Wall St. News' started by dealmaker, Jun 11, 2019.

  1. dealmaker


    AQR’s Problem With Machine
    Learning: Cats Morph Into Dogs

    The noise and adaptability of financial markets make them tricky for the technology.

    June 10, 2019

    Photo by Krisztian Bocsi/Bloomberg
    Machine learning has done magic, such as beating human chess champions. But in finance, expectations for the technology may need to come down a notch or two, according to quantitative firm AQR.

    In a report published Monday, AQR argues that the benefits of machine learning will likely apply to problems involving optimizing portfolio construction, such as risk management, transaction cost analysis, and factor construction — at least at first. That’s because markets are different from other areas where machine learning has come to offer up breakthrough research, according to “Can Machines Learn Finance?”

    [II Deep Dive: Younger, Cheaper, Smaller, Smarter: Meet the New Breed of Quants]

    Machine learning changes the way problems are solved. Traditional computer programmers define all of the rules or parameters of a game. Machine-learning applications, in contrast, are fed data so they can then determine the rules and relationships. Sorting pictures of dogs from cats is a well-known example of machine learning in action. A traditional programmer couldn’t program in the infinite number of variations that exist between dogs and cats.

    But cats and dogs are not markets.

    In financial markets, the so-called signal-to-noise ratio is low, meaning outcomes aren’t particularly predictable. If they were active, managers would consistently outperform their benchmarks.

    “The low signal-to-noise is not some unfortunate coincidence of markets,” AQR said in the report. “On the contrary it is a feature ensured, and constantly reinforced, by simple economic forces of profit maximization and competition.” In other words, hedge fund managers and other active traders start making decisions based on information they have and push up stock prices. And they don’t stop until they’ve made as much money as possible. Stock prices reflect that information and the only force that moves markets is unforeseen events or unexpected data.

    Machine learning doesn’t do well in that sort of environment. On top of that, markets are adaptive.

    Electronic Trading Just
    Keeps Getting Better
    “If a researcher identifies a new signal that captures a particular form of asset mispricing useful for predicting prices, then as the signal becomes more widely known, more traders act on it, correcting prices more quickly,” wrote the authors of the report. “The market eventually absorbs the information, and the data generating process changes due to the very actions of agents in the market.”

    In other disciplines, as AQR wrote, “cats don’t begin morphing into dogs once the algorithm becomes good at cat recognition.”

    Financial markets are also different from other sectors in that asset managers need to explain their models to investors — not always easy in the machine learning world.

    Although big data can be useful, AQR also argued that finance is a time-series discipline. New data on returns, for example, are only generated with the passage of time. Big data from social media or other platforms have a short history, which is of limited use in investments.

    “The limited time series presents a challenge for meaningful backtesting. With a short history, it’s even more difficult to form a precise estimate of strategy performance which ultimately means that even very strong signals might prudently receive only small weights in a portfolio,” according to AQR.

    Still, AQR argues that other areas of investing, such as risk, have a “high signal-to-noise” ratio — they can be predicted pretty well, as can the price-impact of transactions. Investors’ behavior doesn’t overrun these signals like their behavior squashes signals on returns.

    Alpha is scarce and has remained so in the face of advancements over the past few decades.

    AQR acknowledges this.

    “Using new data and machine learning to build alpha (i.e., to find new unique sources of return predictability) heads straight into the most competitive aspect of financial markets,” according to the paper. “As more investors enter the market with similar tools, the mispricing corrects and that alpha compresses to zero.”
  2. Maverick1


    Great to see AQR telling people to get their heads out of the cloud....
  3. Nobert


    If i may, some thoughts :

    ...maximization in competition...

    And that became true, in many ways, where our input/output ( we use fingers, voice ) vs technology, is millions times away from AI (based on speed).

    That battle is lost, for a single individual (in shortest time frames (with exceptions)), until human frontal cortex , gets connected with chips / AI.

    So a thought , will be a form of, digital information output.

    ( basics, already being done )

    Could we ever lose that fight of investing, trading , as single retailers - to machines completely, - nah , i don't think so.

    Price, essentially,

    like writing and time scale , inevitably, moves from left to right, all the time ( on charts ),
    and the only 2 variables are up or down.
    (market makers, dark pools, gaps up and down, short squeezes, staying irrational longer than rational,valuation & etc - that's another topic)

    If, somehow, it would become - globally accepted, to use price action , that moves in 3d digital environment, 360 degrees, then that, would lover our chances, when trading, because it would leave an open space, for AI creativity ;

    then concept of
    trends and support levels, indicators(partially) - would be disrupted ( if not gone at all )

    Lol, if that kind of nonsense (self criticism), would happen, then most likely in the world of cryptos/alike, or during the next era, of shadow banking products.
    Last edited: Jun 11, 2019
  4. ronblack


    I think I read somewhere they fired the head of ML not long ago.
  5. I've been reading a few books on ML and finance and the consensus seems to be that only under limited circumstances can you use it for alpha generation but seems to have found good ground in bet sizing.
  6. KevMo


    I heard Cliff on a Podcast recently. 2yrs ago he had high hope for his new Data/ML team. Though, he was fairly ambivalent about their progress. Who knows, he's crafty. They could be playing possum.
  7. This is in line with what AQR is saying:
    But that makes me wonder: if the signal-to-noise is high for bet sizing and risk, would one really need AI to find a good solution? Wouldn't conventional coding and rules be sufficient?
  8. Don't know, but I guess the entire benefit of it is that you don't need to code the rules.
  9. kj5159


    That's what I always thought, you feed it all the data you can get and it will write its own algos for you once it processes everything. Then again I know nothing about machine learning, cheers.:thumbsup: