Source-linked AI summary

Sparsity Regularized and Robust Mean Variance Portfolio Selection Under Ellipsoidal Uncertainty

Deniz Akkaya, Emre Can Yayla, Buse Şen, Mustafa Ç. Pınar

arXiv:2609.11749v1math.OCcs.LGstat.ML

TL;DR

The paper addresses robust mean-variance portfolio selection when expected returns are uncertain and allocations should remain sparse. It combines ellipsoidal robust modeling, structural analysis, and a tailored branch-and-bound algorithm, which performs competitively with general-purpose mixed-integer conic solvers on real financial data. The study also identifies implementation trade-offs and future extensions beyond its current uncertainty sets and constraints.

  • Problem

    Integrating ellipsoidal mean uncertainty with exact ℓ0-regularization remains relatively unexplored, despite separate literatures on robust and sparse portfolio selection.

  • Method

    The paper develops robust risk-minimization and return-maximization formulations, analyzes their minimizers, and uses the resulting bounds in a tailored branch-and-bound algorithm.

  • Results

    The proposed approach is computationally effective, often outperforming general-purpose mixed-integer second-order cone solvers in running time without sacrificing solution quality.

  • Takeaways & Limitations

    The framework jointly produces portfolios that are robust to estimation errors and sparse enough to be practically implementable.

  • Takeaways & Limitations

    The warm-start elimination level trades solution quality against runtime and must therefore be chosen carefully.

Abstract

from arXiv · show

We investigate mean-variance portfolio selection with an $\ell_0$-penalty to promote sparsity in asset allocations. Uncertainty in the mean return vector is incorporated through an ellipsoidal uncertainty set, yielding a robust sparse optimization framework. We characterize the structure of both local and global minimizers and exploit these properties in the risk minimization and return maximization formulations. Building on this structural insight, we develop a branch-and-bound algorithm tailored to the resulting robust sparse portfolio problems, together with a new pruning rule that can discard exponentially many candidate portfolios in a single step. Extensive computational experiments on real market data, together with comparisons against a mixed-integer second-order cone programming solver, demonstrate the effectiveness and competitiveness of the proposed approach.

1 Introduction

The paper unifies ellipsoidal uncertainty in expected returns with exact ℓ0 sparsity regularization for robust mean-variance portfolio selection. It combines structural analysis with a tailored branch-and-bound method evaluated on real financial data.

  • The integrated problem addresses estimation risk and explicit portfolio cardinality within a challenging robust mixed-integer quadratic optimization framework.
  • Real-data experiments compare the approach with a mixed-integer second-order cone solver and show computational effectiveness, especially on larger instances.
  • Ellipsoidal mean uncertainty and exact ℓ0-regularization are integrated into a unified robust sparse mean-variance portfolio model.
  • Structural analysis characterizes local and global minimizers, including support-wise properties, existence results, component bounds, and sparsity control through thresholding.
  • A tailored branch-and-bound algorithm uses structural bounds and warm starts, with an additional pruning step that can eliminate exponentially many subproblems in one iteration.

2 Problem Definition and Notation

The paper formulates robust sparse portfolio selection under ellipsoidal mean-return uncertainty in risk-minimization and return-maximization forms. Exact deterministic robust counterparts combine worst-case norm penalties with an ℓ0 sparsity penalty.

  • The market contains risky assets with known positive-definite covariance D, unknown mean returns, and a deterministic risk-free asset with return r_c.
  • Ellipsoidal uncertainty converts the semi-infinite robust return constraint into a deterministic inequality with a worst-case deviation term γ∥x∥_D.
  • Problem (P1) minimizes variance plus β∥x∥_0 subject to a robust excess-return target, thereby penalizing the number of nonzero asset weights.
  • The alternative formulation fixes a variance budget and maximizes worst-case return, producing a distinct optimization problem whose solutions generally differ from those of (P1).
  • Theoretical analysis covers local optimality, bounds on nonzero components, global existence, and guidelines for selecting β to achieve prescribed sparsity levels.

3 Analysis of (P1)

The analysis of (P1) characterizes support-restricted, local, and global minimizers under assumptions ensuring feasibility and excluding the zero portfolio. It derives structural bounds and penalty thresholds that support sparse optimization and warm starts.

  • Support-Restricted Minimizers: Assumption 2 ensures feasibility of every nonempty support-restricted subproblem because each support’s Sharpe ratio exceeds the uncertainty radius γ.The minimum support Sharpe ratio is attained on singleton supports, and positive definiteness yields unique subproblem solutions.
  • Local Minimizers: Local minimizers of (P1) are precisely support-generated portfolios Ξ(ω) for nonempty supports, so each local minimizer is determined by its support.Every admissible support produces a local minimizer, although zero-padding can make multiple supports generate the same point.
  • Global Minimizers: A bounding box contains all global minimizers of (P1) and is used for Big-M calibration and feasible-region tightening.The bound also supports upper bounds on maximal portfolio entries and variance-related quantities.
  • Global Minimizers: Theorem 1 establishes a strict lower bound separating nonzero components of global minimizers from zero, which underlies the proposed warm-start heuristic.The bound is derived by considering support cardinalities and combining the corresponding cases.
  • Global Minimizers: For every prescribed sparsity level k, a sufficiently large β ensures every global minimizer of Fβ has at most k nonzero components.The analysis also bounds the number of distinct local minimizers by 2^N − 1, the number of nontrivial supports.

4 Analysis of (P2)

The analysis of (P2) develops analogous support-restricted and local-minimizer characterizations, then derives bounds on global minimizers. It also establishes sparsity control through β and extends the structural results to robust return maximization.

  • Support-Restricted Minimizers: Every nonempty support-restricted subproblem of (P2) has a unique solution with an active Dω-norm constraint under Assumption 2.The optimal multiplier is µ* = Hω − γ, and Hω > γ excludes the zero solution.
  • Local Minimizers: Local minimizers of (P2) are support-generated portfolios Π(ω), and every nonzero local minimizer equals Π applied to its own support.Activating components outside an existing support cannot decrease the objective within a suitable neighborhood.
  • Global Minimizers: Theorem 3 provides a lower bound on every nonzero component of a global minimizer of (P2).The proof covers three cases and shows the bound is suitable across all of them.
  • Global Minimizers: For (P2), the lower bound is linear in β and depends on the data through r[i], d_i[i], H, and T, making nonzero components more clearly separated from zero in experiments.This separation is the property exploited by the warm-start heuristic.
  • Global Minimizers: For any prescribed sparsity level k, a regularization parameter β_k can ensure that globally optimal robust return-maximization portfolios attain the desired sparsity level.Globally optimal portfolios can be identified among 2^N − 1 locally optimal candidates.

5 Enumeration Based BnB Algorithm

The algorithm adapts enumeration-based branch-and-bound to robust sparse portfolio problems using structural bounds, warm starts, and an additional right-subtree pruning rule.

  • 5 Enumeration Based BnB Algorithm: The algorithm enumerates support subsets as tree nodes and solves a lower-dimensional subproblem at each node.Each node tracks a solution, bounds, undecided candidate assets, and assets fixed in the support.
  • 5.1 Warm-Start Heuristic: The warm-start heuristic solves the full-support problem, uses componentwise lower bounds, and removes assets with the largest deficits.For a 10-sparse solution among 60 variables, it may eliminate about 30% of variables rather than all but 10.
  • 5.1 Warm-Start Heuristic: Warm starts reduce memory usage and problem size, but their elimination level creates a trade-off between solution quality and runtime.The heuristic is most beneficial when the true solution is sparse; without support elimination, the method becomes full branch-and-bound.
  • 5 Enumeration Based BnB Algorithm: Branching selects assets using the Lagrangian gradient when the current support is nonempty and a variance-to-return ratio otherwise.The selected asset creates one child that includes it and another that excludes it.
  • 5.3 Bounding: For left nodes, the method computes bounds from the fixed-support solution and parent lower bound, while right-node bounds are inherited or obtained from a relaxed subproblem.The right-child pruning condition is justified by a proposition guaranteeing that all relevant descendant portfolios meet the incumbent threshold.
  • 5.3 Bounding: The additional pruning rule can remove an exponentially large portion of the right subtree in a single iteration.It is applied before enqueuing the right child when the incumbent-based bound condition is satisfied.

6 Computational Results

Computational experiments compare the tailored branch-and-bound method with Gurobi on multiple financial datasets, including out-of-sample robust-versus-sparse tests. BnB is generally faster, while solution quality depends on the formulation, dataset size, and warm-start drop rate.

  • 6. Computational Results: The experiments use DowJones, EuroStoxx50, FTSE100, NASDAQ100, S&P500, ETF, Eurobonds, and Italian Bonds datasets with identical retained investment universes for BnB and Gurobi.The data comprise daily prices or returns adjusted for dividends and splits, and the retained asset counts are reported in Table 1.
  • 6. Computational Results: Tables 2–3 report CPU time, solution sparsity, warm-start drop rate, relative objective error, and node reduction, with Gurobi limited to 12 hours.A dash denotes that Gurobi did not certify optimality within the time limit, while node reduction measures pruning relative to standard enumeration.
  • 6. Computational Results: BnB returns optimal P1 solutions with zero error across drop rates and outperforms Gurobi increasingly on larger FTSE100 and NASDAQ100 instances.On FTSE100, BnB solves in seconds to minutes at higher drop rates while Gurobi may require long runtimes or fail to finish within 12 hours; similar behavior holds for NASDAQ100.
  • 6. Computational Results: For P2, higher drop rates produce larger speedups but can reduce accuracy, while lower drop rates reduce error at the cost of additional computation.On S&P500, BnB is substantially faster but has an accuracy gap of roughly 11%–24%; on FTSE100, error ranges from 1.84% to −1.39% for β = 10^-3 as drop rate falls from 0.8 to 0.6.
  • 6.1 Out-of-Sample Performance: In rolling-window backtests over 215 rebalances, the robust model achieves higher out-of-sample Sharpe ratios and mean excess returns than the sparse model in most tested settings.The comparison uses identical screening and rebalancing dates for robust and sparse models, with both solved by BnB using a 0.3 drop rate.

7 Conclusion

The paper unifies ellipsoidal robustness and exact sparsity in a nonconvex, discontinuous mean–variance portfolio problem. Structural analysis supports a tailored branch-and-bound algorithm that performs competitively with general-purpose solvers while producing robust and sparse portfolios.

  • 7. Conclusion: The combined ellipsoidal uncertainty and ℓ0 penalty create a nonconvex, discontinuous optimization problem that addresses estimation uncertainty and portfolio sparsity together.The framework studies both robust risk minimization and robust return maximization.
  • 7. Conclusion: Structural analysis characterizes local and global minimizers through support-restricted subproblems, existence results, and explicit component bounds.These results clarify how quadratic risk, worst-case mean adjustment, and the discontinuous penalty shape optimal portfolios.
  • 7. Conclusion: The structural bounds guide branch-and-bound pruning and warm-start construction, helping manage the combinatorial search induced by the ℓ0 term.The algorithm uses problem-specific lower and upper bounds to reduce computational effort.
  • 7. Conclusion: On real financial data, the proposed approach is competitive with mixed-integer second-order cone solvers and often achieves better running time without sacrificing solution quality.The resulting portfolios are described as both robust to estimation errors and sparse enough for practical implementation.
  • 7. Conclusion: Future work includes alternative uncertainty sets, transaction costs, turnover limits, and alternative risk measures.These extensions would preserve the paper’s combined robustness-and-sparsity perspective while broadening the modeling scope.
Loading 2609.11749v1…