Output-Polynomial Enumeration for the Bi-Objective Knapsack Pareto Set

An empirical investigation of the open problem: does there exist an output-polynomial time algorithm for computing the full Pareto set?

Open Problem Enumeration Complexity Multi-Objective Optimization

Open Problem

Determine whether there exists an output-polynomial time algorithm for computing the full Pareto set of the bi-objective 0-1 knapsack problem, where solutions are evaluated by simultaneously minimizing total weight and maximizing total profit, and the running time must be polynomial in the input size n and in the size of the Pareto set |P|.

4
Instance Classes
7
Experiments
225+
Data Points
Open
Problem Status

Problem Background

Given n items with weights and profits, the bi-objective 0-1 knapsack problem seeks all Pareto-optimal subsets -- subsets not dominated by any other feasible subset in both weight (minimize) and profit (maximize). The Pareto set can be exponentially large.

Output-polynomial: time = poly(n, |P|) where |P| = number of Pareto-optimal solutions

The classical Nemhauser-Ullmann (NU) algorithm processes items via dynamic programming but can have intermediate sets much larger than the final output. Nikoleit et al. (2026) showed NU is not output-polynomial, leaving the general question open.

Key Findings

Finding 1: Pareto set growth is strongly instance-dependent, ranging from O(n) to O(n^2) for stochastic instances.
Finding 2: Weight-profit correlation is the dominant structural predictor of Pareto set size.
Finding 3: Reverse-search trees have bounded average branching factor (<1) on random instances with 100% reachability.
Finding 4: NU runtime is well-predicted by the final Pareto set size on all tested instance classes.

Instance Types Studied

TypeDescription
RandomIndependent uniform weights and profits
CorrelatedProfit approximately equals weight
Anti-correlatedProfit approximately equals 110 minus weight
AdversarialDeterministic constructions for NU

Pareto Set Size Scaling

How does the number of Pareto-optimal solutions grow with the number of items?

Detailed Results

Typen=6n=8n=10n=12n=14n=16n=18
Random8.714.618.626.034.649.859.9
Correlated18.636.658.888.8109.8146.0175.2
Anti-correlated5.17.810.912.318.820.526.8
Adversarial791113151719

Stochastic results averaged over 10 trials. Adversarial instances are deterministic and produce exactly n+1 Pareto points.

Nemhauser-Ullmann Algorithm: Intermediate Set Profiles

The NU algorithm processes items one by one. At each step k, we track the size of the intermediate Pareto front.

Runtime Scaling

NU runtime as a function of n for different instance types.

NU Algorithm Visualization

Intermediate Pareto front sizes at each DP step for a random instance (n=18, final=71):

Each bar represents the intermediate Pareto set size at DP step k. The front grows monotonically as more items are processed.

Reverse-Search Tree Analysis

We implement a reverse-search enumerator following the Avis-Fukuda framework. The parent function removes the highest-indexed item yielding another Pareto-optimal solution.

Tree Statistics

nAvg |P|Avg DepthAvg BranchMax BranchReached
69.23.20.883100%
815.44.60.934100%
1019.66.20.944100%
1227.87.00.965100%
Key insight: Average branching factor stays below 1.0, meaning most nodes are leaves. The tree is path-like, traversing the Pareto set roughly in order. 100% reachability confirms the parent function defines a valid spanning tree.

Structural Predictors

How do instance properties predict Pareto set size? We analyze 225 instances across 3 types.

Interpretation

Positive correlation (p approximately w): Items have similar profit/weight ratios, making them nearly interchangeable. Many subsets with different cardinalities achieve non-dominated points, producing large Pareto sets.
Anti-correlation (p approximately 110-w): Ratios vary widely. High-profit items are light, creating clear dominance relationships that prune the Pareto set aggressively.
Random (independent p, w): Moderate correlation near 0 produces intermediate-sized Pareto sets.

Pareto Front Geometry (n=14)

Visualizing the shape of Pareto fronts for different instance types.

References

  1. Nikoleit et al. "The Art of Being Difficult: Combining Human and AI Strengths to Find Adversarial Instances for Heuristics." arXiv:2601.16849, 2026.
  2. Nemhauser, G. L. and Ullmann, Z. "Discrete Dynamic Programming and Capital Allocation." Management Science, 15(9):494-505, 1969.
  3. Beier, R. and Voecking, B. "Random Knapsack in Expected Polynomial Time." J. Computer and System Sciences, 69(3):306-329, 2004.
  4. Beier, R. and Voecking, B. "Typical Properties of Winners and Losers in Discrete Optimization." STOC, pp. 343-352, 2006.
  5. Avis, D. and Fukuda, K. "Reverse Search for Enumeration." Discrete Applied Mathematics, 65(1-3):21-46, 1996.
  6. Roeglin, H. "Smoothed Analysis of Multi-Criteria Optimization." SWAT 2014, pp. 22-33, 2014.
  7. Ehrgott, M. and Gandibleux, X. "A Survey and Annotated Bibliography of Multiobjective Combinatorial Optimization." OR Spectrum, 22(4):425-460, 2000.
  8. Bazgan, C., Hugot, H. and Vanderpooten, D. "Solving Efficiently the 0-1 Multi-Objective Knapsack Problem." Computers and Operations Research, 36(1):260-279, 2009.
  9. Fredman, M. L. and Khachiyan, L. "On the Complexity of Dualization of Monotone Disjunctive Normal Forms." J. Algorithms, 21(3):618-628, 1996.
  10. Vassilvitskii, S. and Yannakakis, M. "Completeness and Intractability of Multicriteria Optimization Problems." Multiobjective Optimization, pp. 167-193, 2005.