Using textual information from a complete history of regular quarterly and annual (10-Q and 10-K) filings by U.S. corporations, we train machine learning algorithms and large language models, LLMs, to predict future earnings surprises.

First, the length of MD&A section on its own is negatively associated with future earnings surprises and firm returns in the cross-section.

Second, neither sentiment-based nor classic NLPs approaches are able to “learn” from the past managerial discussions to forecast future earnings.

Third, only “finance-trained” LLMs have the capacity to “understand” the contexts of previous discussions to predict both positive and negative earnings surprises, and future firm returns.

Our evidence indicates significant, and somewhat hidden in the complexity of presentations, informational content of publicly disclosed corporate filings, and superior (to human) abilities of more recent AI models to identify it.

Nowadays, the availability of alternative data and their adoption in the asset management industry to improve investment decision processes is a widespread alternative approach. It comes with the help of Machine Learning and Artificial Intelligence techniques that allow the processing of these data, reducing their noise, and converging Big Data into Smart Data.

Traditional asset management techniques provide very little guidance to these questions. Academic studies are often rooted in 50 or 70-year-old portfolio theories, as are standard investment textbooks. Yet these theories have very little to do with real-life portfolio practice.

McGill University, Associate Professor of Finance, Russ Goyenko will discuss with Senior Advisor, FDP Institute, Dr. Hossein Kazemi, how long-term investors should form portfolios. They will delve into how they should evaluate securities, portfolios, and managers. Learn more about how they adapt to time-varying expected returns, volatilities, correlations, and many factors, signals, and strategies.

We are proud to have Claude Perron, Founder of FIAM as an Association Partner sponsoring today’s event. FIAM’s mission is to contribute to the development and competitiveness of the Quebec financial community and beyond.

How should long-term investors form portfolios? How should they evaluate securities, portfolios, and managers? How should they adapt to time-varying expected returns, volatilities, correlations; and many factors, signals, and strategies?  

Traditional asset management techniques provide very little guidance to these questions. Academic studies are often rooted in 50 or 70-year-old portfolio theories, as are standard investment textbooks. Yet these theories have very little to do with real-life portfolio practice.  

Nowadays, the availability of alternative data and their adoption in the asset management industry to improve investment decision processes is a widespread alternative approach. It comes with the help of Machine Learning, ML, and Artificial Intelligence, AI, techniques that allow the processing of these data, reducing their noise, and converging Big Data into Smart Data. According to the recent 2021 Refinitiv survey about the rise of data scientists in the finance industry, 72% of respondents state that AI/ML is a core component of their business strategy and 80% state that they are making significant investments in AI/ML technologies & techniques. 32% of respondents use AI/ML in portfolio management, and 59% in any investment. Another striking result of this survey is that 75% of firms use deep learning, considering that deep learning has been previously seen as a more academic niche.  

The practical motivation for the long investment horizon perspective in portfolio management comes to light due to climate finance and climate risk investing, which also have long-term objectives. Yet long-term investors, like pension funds or educational endowments, underperformed passive investment by approximately 1% or 1.6% a year, respectively, for the ten years ending June 30, 2018, and this underperformance is expected to persist in the years ahead. This is even before incorporating long-term climate risks into portfolio construction and asset allocation decisions, which is an additional constraint.  

In our new article, we suggest that long-term investor underperformance does not need to become the new norm, and that long-term investors such as pension funds, who often diversify among a handful of asset classes, can outperform their passive benchmarks and more active, short-term-oriented peers. This is possible because of large data sets and the application of modern technologies and deep learning to the long-term portfolio construction problem (these practices are now common in contemporary asset management ) Most importantly, we first teach machines to learn finance, and only then do we rely on them to guide us in the portfolio construction process.  

Our Approach  

Investable Asset Classes 

To stay close to the factor-investing practices of many pension funds, our approach is quite conservative in terms of investable assets, yet also quite generic, as it is aimed to achieve a “proof of concept” rather than building specific use cases. We use nine factor portfolios as investable asset classes, and these factors are the most commonly used in finance literature over the last thirty years. They are: gross returns on the market (MKT); small-minus-big (SMB); high-minus-low (HML); robust-minus-weak (RMW); conservative- minus-aggressive (CMA) factors; the momentum (MOM) factor; the profitability (ROE) and investment (IA) factors; and the betting-against-beta (BAB) factor. These portfolios capture the most common investment styles like market indexing, growth, value, momentum, or risk characteristics of leverage-constrained institutional portfolios like pension and mutual funds.  

Big Data: Macro and Portfolio Characteristics 

Using multiple asset or firm-specific characteristics while optimizing asset allocation choices has been proven to outperform traditional approaches, which solely rely on the historical series of asset returns. For each portfolio, we construct 153 characteristics from publicly available data sets. Asset class performance often depends on macro-economic regimes, business cycles, and overall market volatility. To these asset-specific characteristics, we add a set of sixteen macro-indicators, which, among others, include: market-wide dividend-price ratio; dividend yield; earnings-price ratio; stock variance; book-to-market ratio; net equity expansion; Treasury-bill rate; long-term rate of returns; term spread; default spread; and Consumer Price Index (CPI).  

Deep Reinforcement Learning (RL) Approach to Long Investment Horizon Portfolio Construction: 

While we build our model architecture, we pursue three objectives. First, asset allocation decisions among nine assets should be conditioned on all 153 asset-specific characteristics and sixteen macro-economic indicators, as well as accounting for the diversification effect among these assets on the overall portfolio level.  

Second, the model should explicitly be trained on the forward-looking long horizon holding period perspective, for which we set ten years as the maximum. Therefore, our longest investment holding period is ten years, and we allow annual, once a year, portfolio rebalancing.  

Portfolio rebalancing, especially for large institutional investors, can be very costly. For example, “Stanford pays $800 million a year in fees on a $30 billion endowment.” Our third objective is thus to minimize these fees, and we want to impose explicit penalties on minimizing asset rebalancing needs and their trading costs while maximizing portfolio expected returns and minimizing its risk, i.e., the volatility.  

These three crucial objectives, which are the key to any successful multi-asset long horizon portfolio strategy, can only be accomplished via reinforcement learning (RL). RL is specifically well-suited for solving problems characterized by long-term versus short-term reward trade-offs. It has been applied successfully in robot control, AlphaGo, or self-driving cars.  

To reduce Big Data to Smart Data and to extract predictive asset-specific signals for future portfolio performance , our model architecture uses Transformer, a recent AI tool commonly used in natural language processing and computer vision. We also use Long short-term memory (LSTM) to identify hidden macro-economic states in real time and condition our asset allocation decisions on the current and expected macro-economic environment.  

RL Training 

Our agent, a robot, aims to maximize a nine asset classes’ portfolio return over the next ten years while keeping its volatility to the minimum and, importantly, keeping changes in asset weights between rebalancing sequences to the minimum given these assets’ trading costs. We allow an agent to do asset re-allocation and rebalancing once a year while aiming to achieve the best overall ten-year performance.  

As such, our approach is best described by a Wayne Gretzky quote: “A great hockey player skates to where the puck is going to be, not where it is.” 

While we train the model, our agent does exactly that, as it allocates the assets on the net benefits for the whole ten-year period and evaluates the outcome at the end of year ten. The model explicitly considers the consecutive ten-year annual portfolio rebalancing from one year to another before deciding on the asset allocation for the first year. Once the model is trained, we allow it to invest outside of the training data in the first out-of-sample year, which in our data is the beginning of 2005. We then “track” this portfolio performance through the end of the year to measure ex-post performance. After that, we roll our training sample by one year to incorporate the most recent realized data for 2005, retrain the model with the updated data, and allow it to invest at the beginning of 2006 to track the portfolio performance through the end of 2006 till the end of 2020. Therefore, we have sixteen years of portfolio performance to analyze. Note that these sixteen years are not “shown” to the model before making an investment decision for each of them ex-ante.  

Out-of-Sample RL Portfolio Performance 

What drives the portfolio performance in our model? By design, using a plethora of factors, signals, and strategies, we allow for a factor timing based not only on its past and current realizations but also its future expectations and diversification effect across other factors on the portfolio level. Timing strategies normally involve a lot of portfolio turnover. We take explicit care of it by training the model to minimize trading costs over all ten rebalancing frequencies.  

During our “test” period, 2005 to 2020, the RL portfolio achieved an annualized Sharpe ratio between 2.7 and 3. For comparison, the Sharpe ratio of S&P500 for the same period is 0.55, which suggests that, with the help of extra leverage we currently do not use, our agent can outperform the stock market by a factor of 5 to 6.  

The average annual return of the RL portfolio is 7.4%, and its standard deviation is 2.73%. For comparison, the average annual return of S&P500 for the same period is 8.7%, and its standard deviation is 16.3%. Therefore, our RL model achieves a similar average annual portfolio return performance as the S&P500 with substantially lower risk, as measured by the standard deviation of portfolio returns. Institutional investors, especially pension funds and educational endowments, are often bounded by the amount of risk they can take on their portfolio level. Our RL approach provides the methodology to achieve a common benchmark, S&P500, performance with very low-risk exposures.  

Another common measure of portfolio performance is alpha, i.e., an excess portfolio return over the theoretically possible or certain empirical benchmark return. Here, our benchmark return is any static, passive combination of all nine assets we use to construct the RL portfolio, and we estimate the alpha as an intercept from the regression of RL portfolio returns on all nine factors. We obtain an alpha of 6.5% per year, which means that we outperform all individual or passive combinations of these nine assets by economically meaningful magnitudes.  

How do we achieve this outperformance? Our long-term RL portfolio has an annual turnover of 20%, which means that we re-adjust 1/5th of all holdings to maximize a ten-year objective. Thus, there is an element of active management that is also a standard industry practice. The average turnover costs are 86 basis points, bps, per year which still provides significant net, after-trading costs, returns, and alphas. Had we not trained the model to keep rebalancing to the minimum, our portfolio turnover would have increased by 34% per annum.  

Finally, our portfolio outperforms benchmarks during high and low market volatility regimes and achieves the highest performance during low volatility regimes when investors are the least financially constrained to seek the leverage to augment their winning asset positions. 

COVID Market Crush Case Study 

As a special case, we analyze how the model allocates the weights around COVID-19 in March 2020, when markets plunged. 2020 is the last year of our test period, and the model was retrained last time at the end of 2019. Moreover, the model has never been trained on anything like this pandemic episode as it never happened before in our overall sample period, 01/1980 to 12/2020. Therefore, this event provides a unique laboratory experiment to examine how, after training on previous crisis episodes, the model makes decisions for something it has never experienced. Our agent decreases the weight of the market portfolio before March 2020, when the market volatility started increasing, and then increases it at the end of March, i.e., it advises buying the market at its bottom. The model also advises taking a negative exposure, short-selling small-cap stocks at the end of January 2020 and covering most of the short position in March 2020, when this short position was the most in-the-money. These ex-ante model decisions can be found quite rational and ex-post effective by institutional fund portfolio managers who cannot short sell the market but can time the market volatility and reduce their positions in small-cap stocks when volatility is expected to be high.  

Discussion 

Traditional portfolio theory has limited practical applications. Portfolio managers often rely on their professional experiences and subjective assessments to make investment decisions, and they achieve better performance without relying on any model. Modern financial markets empowered by technological innovations, big data, alternative data, and other types of soft information evolve, change, and become more complex every day. While previous experiences and expertise count for a lot, interpreting and adapting to the current market trends, investor preferences, and risk appetites is just as important. As a human, it takes time and long enough historical samples to digest and understand new market tastes and trends. The machines, AI technologies with machine learning capabilities, on the other hand, after being trained by a human, can identify abnormal trends in the data in real time and react to the expected risks faster than a human portfolio manager. The COVID-19 market plunge is only one of many examples where we are often surprised by how well the algorithms anticipate the risk, especially the source of risk. In our other work, we analyze the prediction of the deep learning model around the 2008-2009 financial crisis. A month before the biggest market plunge in September 2008, the model identified real estate holdings as the risk factor, and like the COVID-19 episode, the model had never seen a real estate bubble crash.  

The main message here is that there is a reason that 75% of Refinitiv survey respondents state the wide adoption of deep learning in their practices – it works! Deep learning provides a viable alternative to somewhat “dead-end old portfolio theory,” and, after being properly trained, the machines can “learn” the experiences of successful portfolio managers. With bigger data and more information, machines can also make real-time decisions faster. Faster means re-allocating assets away from expected risks and protecting investors from immediate losses.  

Recently, pension funds in Canada and the US reported negative performances due to the bear market caused by rising interest rates and higher inflation during the first half of 2022. For example, the largest Quebec pension manager, Caisse, loses $33.6-billion in the first half of 2022. Norway’s Wealth Fund lost $174 billion for the same time period. New York City Retirement Systems’ returns plunge 8.65% for the fiscal year ended June 30, 2022.   

This poor performance could have been prevented had the pension fund system adopted modern-day technologies. In sum, there are modern-day solutions to portfolio management practices which can handle all current market complexities and are able to forecast market downturns better than humans. It makes them an indispensable risk management instrument for any type of asset manager. Adopting these technologies should become one of the first order of priorities.  

Russ Goyenko is an Associate Professor of Finance at McGill University, the Founder and Scientific Director of FIRM Labs, and a Co-founder of Finaix Corp.  

Chengyu Zhang is a Ph.D. student in Finance at McGill University Desautels School of Management.  

This paper is adapted from their paper, “Long Horizon Multifactor Investing with Reinforcement Learning,” available on SSRN.  

The 2^nd CUHK Derivatives and Quant Investing conference, Hong Kong, October 17, 2019

A great initiative by The Chinese University of Hong Kong (CUHK) Business School to bring together academics and industry practitioners to share research outcomes in the areas of derivatives markets and quantitative investing. It puts academic research to another test – how implementable our findings are. When we find signals in the data to invest on and generate abnormal profits (alphas), sometimes it can be just abnormal profits on the paper, and when you actually start trading, transaction costs, costs of short-selling will make it really difficult to generate abnormal returns. In my paper with Martijn Cremers, Paul Schultz, and Stephen Szaura, “Do Option-Based Measures of Stock Mispricing Find Investment Opportunities or Market Frictions?” we delve directly into it. We find that most of information measures based on equity options data are able to identify stocks which are over-valued. Profiting from these opportunities requires short-selling these stocks. We however find that these stocks are hard-to-borrow with the highest borrowing fees to short-sell. This limits profit opportunities. A few measures are indeed able to identify under-valued stocks and predict positive alphas. We find no obvious market frictions which can prevent investors from gaining these abnormal returns. The practitioner’s audience at CUHK conference confirmed our intuition.

The topics:

• Options, futures, and volatility risk premia
• Innovative trading strategies in stock market
• Fixed income quantitative strategies
• Climate risk and ESG investing
• The application of machine learning in trading practice
• Opportunities in emerging markets

Speakers and Presentation Topics:

• Kalok Chan, Dean and Wei Lun Professor of Finance, CUHK Business School, “Opening Remarks”
• Joseph Cheng, Chairman and Associate Professor of Finance, Department of Finance, CUHK Business School, “Welcome Address”
• Stephen Figlewski (Keynote Speaker), Professor of Finance, New York University; Founding editor of Journal of Derivatives, “Extracting Market Expectations and Risk Premia from Stock Index Options”
• Robert Webb (Keynote Speaker), Professor of Finance, University of Virginia; Editor of Journal of Futures Markets, “The Internationalization of Futures Markets: Lessons from the Past”
• Chu Zhang, Head and Professor of Finance, Department of Finance, HKUST Business School, “The Derivatives Markets in Hong Kong”
• Giorgio Valente, Head of the Hong Kong Institute for Monetary and Financial Research, “Local Currency Bond Returns in Emerging Economies and the Role of Foreign Investors”
• Tse-Chun Lin, Professor of Finance, University of Hong Kong, “Risk-neutral Skewness, Informed Trading, and the Cross-section of Stock Returns”
• Grigory Vilkov, Professor of Finance, Frankfurt School of Finance & Management, “Carbon Tail Risk”
• Taie Wang, Deputy Head of Research, Global Equity Beta Solutions, State Street Global Advisors Asia, “Thematic Indexing, Meet Smart Beta! – Merging ESG into Factor Portfolios”
• Ruslan Goyenko, Associate Professor of Finance, McGill University, “Predicting Long-Run Stock Returns with Options”
• Weijian Pan, Head of Quant in Asia Equity Execution Services, Bank of America Merrill Lynch, “The Application of Machine Learning in Algorithmic Trading”
• Wenxi (Griffin) Jiang, Assistant Professor of Finance, CUHK Business School, “Machine Learning and the Cross-section of Stock Returns: International Evidence”
• Xintong (Eunice) Zhan, Assistant Professor of Finance and Real Estate, CUHK Business School, “Implied Volatility Changes and Corporate Bond Returns”

On March 29, 2019, ten international team finalists met in Montréal QC at PSP Investments to participate in the final championship round of the PRMIA Risk Management Challenge (PRMC). The ten teams represented undergraduate and graduate students from universities/colleges across Chicago, Edmonton, Egypt, Hungary, London, Montreal, New York, Toronto, and Vancouver.

Congratulations to Desautels Capital Management Team from McGill University – Ludovic Van den Bergen, Emilie Granger, Ian Jiang, and Roy Chen Zhang. The champions took home the $10,000 in prize money for the team and were offered fee waivers for the Professional Risk Manager (PRM) Designation. Congratulations also to the runners-up, Team Riskcoders from the Beedie School of Business, Simon Fraser University – Tunc Utku, Lingyun (Iris) Fan, Jingxaun (Jessie) Wu, and Priyaadarshini Elango. The runners-up were also awarded fee waivers for the PRM Designation. Each team that qualified for the final received PRMIA Sustaining memberships for each team member.

All finalists advanced through their local regional round challenges by solving the MATLAB Modelling Challenge and solving risk management issues from a case study of United Grain Growers, a Toronto-listed grain trading company. At the international challenge finalists convened at PSP Investments, where each team presented their recommendations about the evolving risk profile coming out of the digitalization of ING Bank, using a Harvard Business Review case study.

All teams attended a lunch panel discussion about their career in risk management and practical aspects of their jobs with Stuart Kozola, Francois Pouliot, Jean-Charles Bouvrette, Badye Essid, Oscar McCarthy and Ken Radigan. They shared their evolving experience on how they grew, and what are their personal principles for success and ethics.

Thank you to our esteemed 2019 PRMC Judges!
Stuart Kozola, Head of Product Management and Strategy, Mathworks
Ken Radigan, CEO, PRMIA
Oscar McCarthy, Partner, AvantageReply
Mihaela Capra, AVP Global Model Risk Management
Jean-Charles Bouvrette, Senior Director, Integrated Risk Management
Badye Essid, Senior Manager, Deloitte
François Pouliot, VP Transversal Risk, PSP Investments
Ahmed Hammad, Senior Credit Risk Officer, National Bank of Egypt

The joint McGill- Desautels and Rotman (University of Toronto) Risk management and Financial Innovations conference took place in Fairmont Mont Tremblant, March 8 – 10, 2019. The conference was in memory of Peter Christoffersen and meant to follow up on his research interests and ideas. Peter always kept close link with industry. His research attracted a lot of attention from asset management and banking professionals. FinTech became his most recent agenda.

FinTech is relatively new for academics. It has been however one of the major trends in financial services and capital markets sectors. To learn more about past, current and future trends in FinTech applications, we organized industry round table on “How AI and Data Analytics are changing Financial Services “

The panel moderator:

Stephen Hui, Partner & Portfolio Manager, Pembroke Management Ltd

The Panelists:

Jean-Francois Courville, CEO, WealthSimple for Advisors

Randy Cass, CEO Founder Portfolio Manager, Nest Wealth

David Nault, General Partner, Luge Capital

As far as an average investor is concerned about FinTech, robo-advising cannot remain un-noticed. We were lucky to have Jean-Francois Courville and Randy Cass, CEOs of one of the biggest Canadian robo-advising companies on the panel. David Nault is a VC fund manager who invests exclusively in Fintech companies. Finally, the moderator, Stephen (Steve) Hui, comes from traditional asset management. He was in perfect position to challenge “newcomers”.

Summary of Discussions:

What are AI applications in financial services (robo-advising)?

We define AI as everything which involves machine learning from various data sources, training algorithms to self-correct and make decisions. It is still often confused with extensive data analytics, or big data. While both can overlap, as far as a final decision is made by a human, we refer to it as data analytics.

For robo-advisors AI has very little applications. It is predominantly a technology (or you can call it an app) which allows you to make passive asset allocation of your investments. As a matter of fact, AI would contradict to the whole principal of robo-advising.

The main attractiveness of robo-advising is transparency and ability to be in control. While the asset allocation is done by a model which is built in an app, it is client’s risk preferences which guide the app and ultimate asset allocations. Thus, transparency, accessibility and every day monitoring and control are the main pillars of robo-advising platforms that attract investors.

Overall, as passive portfolios on average outperform active portfolios, robo-advisors are off to a good start. Passive asset allocations is what they provide.

How personalized robo-advisors’ services are? What happens when there are no human interaction?

It takes 5 seconds and $1 to open an account and to authenticate it. It is also hard to argue that getting plain vanilla advice for a small fee is much better then receiving similar services from a mutual funds with 2.5% fees. Thus, the demand, especially from millennials, is high.

Robo-advisors use one human managing 10,000 accounts with the help of technology. The important concern is how good the customer service is.

Interestingly, online digital activity may give robo-advisors more information about their clients needs compared to traditional asset managers. They know you better than traditional advisors do since the moment you open your online accounts. Your digital print: how often you log in, log out, what news you pay more attention to; allows them to learn closely your risk preferences. Given this information, they also intend to anticipate your future needs.

It is similar to booking.com experience. As you for example book a hotel in NYC, instantly bookings.com sends you a bunch of activities happening in New York on your visit dates, and then the follow up email about “what next?”, and suggestions about other tourist destinations.

In case of robo-advisors, they start educating their clients about their financial goals and how to stay anchored on their objectives.

How does the future look like for baking and asset management?

The easily reached conclusions were that in 10 years traditional banking will loose about 30% of personnel as machines are becoming capable to perform some of human jobs. Traditional investment management will have tough times if they do not start adjusting now. The asset management fees will be much lower.

There are great opportunities coming from open banking. It will decrease advantages of incumbents (traditional banks), and will level down the information asymmetry.

How big are AI solutions these days?

“Worldwide spending on cognitive and AI systems was estimated to reach $19.1 billion in 2018, an increase of 54.2% over the amount spent in 2017. With industries investing aggressively in projects that utilize cognitive/AI software capabilities, IDC forecasts cognitive and AI spending to grow to $52.2 billion in 2021 and achieve a CAGR of 46.2% over the 2016–2021 period (source: Medici) “

“According to Nasdaq, in 2018, JPMorgan Chase had a $10.8-billion tech budget, with $5 billion set aside for new investments. JPMorgan’s treasury services division handles an average of $5 trillion daily in everything from payroll and remittances to multi-billion-dollar merger checks, and the bank wants to bring AI into this game. The bank was teaching its machines about its clients so AI can start anticipating their questions and needs. The Bank of America has also made its AI debut with Erica, who leverages predictive analytics and cognitive messaging to provide financial guidance to over 45 million customers. (source: Medici)”

AI is definitely the future. What are the limits and applications of AI in Asset management and Capital Markets overall? This is to be seen – to try to take a first look, we are organizing another conference: “Applications of AI and Machine Learning in Capital Markets and Risk Management” on April 3, 2020 at McGill – Desautels.