article · Swarm and Evolutionary Computation · 2023
A benchmark test suite for evolutionary multi-objective multi-concept optimization
Rounak Saha Niloy, Hemant Kumar Singh, Tapabrata Ray
Cited by 9Open access
Abstract
For real-world design optimization, there may often exist multiple candidate concepts that may solve the problem at hand. The process of concurrently identifying the best concept and the corresponding variable values that optimize the design objective(s) is termed as a multi-concept optimization (MCO). While such problems are commonly encountered in practical domains such as engineering, transport, product design, there has been little focus on developing computationally efficient algorithms for MCO. One of the reasons contributing to this gap is the scarcity of benchmark problems with diverse challenges that could be used as a testbed for the development and systematic evaluation of advanced MCO algorithms. In this paper, we particularly focus on MCO problems with multiple conflicting objectives. We review the existing multi-objective MCO test problems and identify their shortcomings through preliminary numerical experiments. Then, we propose a methodology and provide a test problem generator for systematically constructing new multi-objective MCO instances with desired properties. We also propose 28 specific test problem instances using this generator to build a benchmark suite that poses a wide range of challenges to the prospective search strategies. Further, we conduct numerical experiments on the proposed test suite using multiple existing algorithmic strategies from the literature to demonstrate their performance. The results clearly highlight the challenges faced by the strategies for different types of problems. These observations emphasize the need for research efforts towards the development of more efficient and versatile MCO algorithms to tackle a wider range of MCO problems.
Cite this paper
Niloy, R. S., Singh, H. K., & Ray, T. (2023). A benchmark test suite for evolutionary multi-objective multi-concept optimization. Swarm and Evolutionary Computation, 84, 101429. https://doi.org/10.1016/j.swevo.2023.101429
Niloy, Rounak Saha, et al. “A benchmark test suite for evolutionary multi-objective multi-concept optimization.” Swarm and Evolutionary Computation, vol. 84, 2023, p. 101429, https://doi.org/10.1016/j.swevo.2023.101429.
Niloy, Rounak Saha, Hemant Kumar Singh, and Tapabrata Ray. 2023. “A benchmark test suite for evolutionary multi-objective multi-concept optimization.” Swarm and Evolutionary Computation 84: 101429. https://doi.org/10.1016/j.swevo.2023.101429.
Niloy, R.S., Singh, H.K. and Ray, T. (2023) ‘A benchmark test suite for evolutionary multi-objective multi-concept optimization’, Swarm and Evolutionary Computation, 84, p. 101429. Available at: https://doi.org/10.1016/j.swevo.2023.101429.
@article{niloy2023benchmark,
title = {{A benchmark test suite for evolutionary multi-objective multi-concept optimization}},
author = {Niloy, Rounak Saha and Singh, Hemant Kumar and Ray, Tapabrata},
journal = {Swarm and Evolutionary Computation},
volume = {84},
pages = {101429},
year = {2023},
doi = {10.1016/j.swevo.2023.101429}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.
Related papers
Grindstone: A Test Suite for Parallel Performance Tools
Jeffrey K. Hollingsworth, Michael Steele · University Libraries (University of Maryland) · 1998
Cited by 13Open access
ScalableTestGrids - An Open-Source and Flexible Benchmark Suite to Assess Modelica Tool Performance on Large-Scale Power System Test Cases
Francesco Casella, Adrien Guironnet · Linköping electronic conference proceedings · 2021
Cited by 3Open access
On constructing alternative benchmark suite for evolutionary algorithms
Yang Lou, Shiu Yin Yuen · Swarm and Evolutionary Computation · 2018
Cited by 14
Novel approach to reuse unused test cases in a GUI based application
J. Albert Mayan, K. Lakshmi Priya · International Conference on Circuit, Power and Computing Technologies · 2015
Cited by 7
Handling Model Changes: Regression Testing and Test-Suite Update with Model-Checkers
Gordon Fraser, Bernhard K. Aichernig, Franz Wotawa · Electronic Notes in Theoretical Computer Science · 2007
Cited by 19Open access
Efficient test suite reduction by merging pairs of suitable test cases
Harald Cichos, Thomas S. Heinze · Model Driven Engineering Languages and Systems · 2010
Cited by 3
Improving test suites via operational abstraction
Michael Harder, Jeff Mellen, Michael D. Ernst · 2003
Cited by 160
Efficient Reduction of Model-Based Generated Test Suites through Test Case Pair Prioritization
Harald Cichos, Thomas S. Heinze · Workshop on Model-Driven Engineering, Verification and Validation (MoDeVVa) · 2010
Cited by 10