Santa Fe Institute

Regularized Portfolio Optimization

Seminar

April 22, 2011
12:15 PM
Collins Conference Room

Susanne Still (Department of Information and Computer Science, University of Hawaii)

Abstract.  One of the textbook investment strategies, known as portfolio optimization, displays an inherent instability to estimation error when applied to large portfolios, such as those of banks or insurance companies. This poses a fundamental problem, because solutions that are not stable under sample fluctuations may look optimal for a given sample, but are, in effect, very far from optimal with respect to the average risk.

I will talk about a novel approach to the portfolio selection problem. From the point of view of statistical learning theory (or machine learning), the occurrence of the instability is intimately related to over-fitting which can be avoided using known regularization methods. I will discuss how regularized portfolio optimization with the expected shortfall as a risk measure is related to support vector regression. The budget constraint, however, dictates a modification resulting in a slightly different algorithm. The L2 norm of the weight vector is used as a regularizer, which corresponds to a diversification "pressure". This means that diversification, besides counteracting downward fluctuations in some assets by upward fluctuations in others, is also crucial because it improves the stability of the solution. The approach I provide here allows for the simultaneous treatment of optimization and diversification in one
framework which enables the investor to trade-off between the two, depending on the size of the available data set. I will discuss how one can characterize the typical behavior, in the limit of large portfolio sizes, and show how regularization removes the instability. The necessity to regularize the portfolio selection problem, besides being a statistical consideration, can also be derived from the following reasoning: If an investor considers the cash flow that could be generated by liquidating a portfolio, and if the investor takes into account that the liquidation of large positions will have an impact on the market, then the need to regularize portfolio optimization emerges naturally from considering the feedback on prices.

This is joint work with F. Caccioli (SFI), M. Marsili (ICTP), and I.
Kondor (IAS Budapest).

Papers — available at: http://www2.hawaii.edu/~sstill/pubs.html

S.Still and I. Kondor. "Regularizing Portfolio Optimization."  New Journal of Physics 12 (2010): 075034 (15pp). Special Issue on Statistical Physics Modeling in Economics and Finance.

F. Caccioli, S. Still, M. Marsili, and I. Kondor. "Optimal Liquidation Strategies Regularize Portfolio Selection." To be published in The European Journal of Finance. Special issue on "New Facets of Economic Complexity in Modern Financial Markets."

Purpose: Research Collaboration

SFI Host: Fabio Caccioli

More Info

  • * SFI community lectures are free, open, & accessible to the public.
  • * Seminars & colloquia are geared for scientists but free & open to the interested public.
  • * All other SFI events are by invitation only.
  • * Note: We are unable to accommodate members of the public for SFI's limited lunch service; you're welcome to bring your own.

Events News

Stanislaw Ulam Memorial Lectures Sept. 9 & 10: Ancient Maya civilization and its relevance to the world today Aug. 19, 2014 -

In a two-part lecture series September 9 & 10 in Santa Fe, archaeologist Jerry Sabloff draws on the ancient Maya to show how lessons from the past could help shape present ...

Video - Watch Steven Strogatz's SFI Community Lecture 'The Joy of x: A Guided Tour of Math' Aug. 12, 2014 -

In an August 6 SFI Community Lecture in Santa Fe, mathematician Steven Strogatz showed how math underpins our lives, from finding the perfect romantic partner to understanding how Google works ...

Zappos CEO Tony Hsieh to Talk Urban Renewal in Santa Fe September 3 Aug. 5, 2014 -

In a September 3 talk in Santa Fe, Zappos CEO Tony Hsieh will discuss his project to revitalize downtown Las Vegas, Nevada. SFI's Geoffrey West will join him on ...

Video: Watch Seth Lloyd's talk 'Is time travel possible? Testing the Grandfather Paradox' July 30, 2014 -

In a July 16 SFI Community Lecture in Santa Fe, MITs Seth Lloyd proffered a mode of time travel that is both theoretically possible and creatively irresistible. Watch his talk.

What is creativity, and how can we understand it? July 10, 2014 -

SFI and the National Endowment for the Arts are holding a working group in Santa Fe this week to examie creativity through the lenses of cognitive science, psychology, education, the ...

More News