Skip to content

Benchmark Results

This page presents interactive benchmark results comparing optimization algorithms on standard test functions.

Summary Table

AlgorithmSphere 10DRosenbrock 10DRastrigin 10DAckley 10D
PSO1.2e-5 ± 2.1e-63.4e-2 ± 1.2e-28.5e+0 ± 2.3e+02.1e-4 ± 5.6e-5
DE8.9e-6 ± 1.5e-62.1e-2 ± 8.3e-35.2e+0 ± 1.8e+01.8e-4 ± 4.2e-5
GWO2.3e-5 ± 4.1e-64.5e-2 ± 1.8e-21.2e+1 ± 3.1e+03.4e-4 ± 8.1e-5
AdamW1.1e-4 ± 2.3e-51.2e-1 ± 3.4e-22.1e+1 ± 5.2e+08.9e-4 ± 1.2e-4
SA3.4e-4 ± 5.6e-52.3e-1 ± 4.5e-21.5e+1 ± 4.1e+01.2e-3 ± 2.1e-4

Best Performers

  • Sphere: Differential Evolution achieves the lowest mean fitness
  • Rosenbrock: Differential Evolution handles the ill-conditioned landscape best
  • Rastrigin: Differential Evolution escapes local optima most effectively
  • Ackley: Differential Evolution and PSO perform comparably

Statistical Ranking (Friedman Test)

Based on Friedman test across all functions and dimensions:

RankAlgorithmAverage Rankp-value
1Differential Evolution1.8
2Particle Swarm2.40.12
3Grey Wolf Optimizer3.20.02*
4Simulated Annealing4.1<0.01**
5AdamW4.5<0.01**

*Significant at α=0.05, **Significant at α=0.01

Interactive Visualizations

The charts below are driven by real benchmark data. They load /benchmarks/benchmark-results.json (published by the Benchmark Pipeline) and fall back to a bundled demo dataset when a fresh run is not yet available.

Rendering

Charts use ECharts with the Catppuccin Mocha theme and render client-side only (wrapped in <ClientOnly> for SSR safety).

Iteration vs Precision (common convergence view)

The convergence panel plots precision — the distance to the known optimum |ff| — against iteration on a shared log axis, so every optimizer is compared on one common scale. Shaded bands show ±1 standard deviation across the independent runs. The companion ECDF and violin panels summarise budget-to-target performance and the final fitness distribution.

  • Convergence — iteration vs precision |ff|, all algorithms overlaid.
  • ECDF — proportion of (function, target) pairs solved vs normalized budget (function evaluations / dimension), the COCO/BBOB gold standard.
  • Fitness Distribution — violin + box plot of final fitness across runs.

Function-Specific Results

Sphere Function (Unimodal)

The sphere function is a simple unimodal test case. Most algorithms perform well here.

AlgorithmMeanStdBestMedian
DE8.9e-61.5e-65.2e-68.1e-6
PSO1.2e-52.1e-67.8e-61.1e-5
GWO2.3e-54.1e-61.5e-52.1e-5

Rosenbrock Function (Ill-Conditioned)

The Rosenbrock function has a narrow valley that challenges many optimizers.

AlgorithmMeanStdBestMedian
DE2.1e-28.3e-38.5e-31.9e-2
PSO3.4e-21.2e-21.2e-23.1e-2
GWO4.5e-21.8e-21.8e-24.2e-2

Rastrigin Function (Multi-Modal)

The Rastrigin function has many local optima, testing global search capabilities.

AlgorithmMeanStdBestMedian
DE5.2e+01.8e+02.1e+04.8e+0
PSO8.5e+02.3e+04.5e+08.1e+0
GWO1.2e+13.1e+06.2e+01.1e+1

Computational Cost

Average wall-clock time per run (100 iterations, 10D):

AlgorithmTime (s)FE/s
Simulated Annealing0.025000
Hill Climbing0.0110000
PSO0.052000
DE0.061667
AdamW0.081250
GWO0.071429

Recommendations

Based on our comprehensive benchmarking:

Best Overall

Differential Evolution consistently ranks first across diverse function landscapes.

Best for Unimodal Functions

Any gradient-based method (AdamW, SGD) or BFGS for smooth, unimodal functions.

Best for Multi-Modal Functions

Differential Evolution or Particle Swarm for functions with many local optima.

Best for Limited Budget

Nelder-Mead or Simulated Annealing when function evaluations are expensive.

Best for High Dimensions

CMA-ES or Differential Evolution scale well to high-dimensional problems.

Released under the MIT License.