Enhancing a machine learning binarization framework by perturbation operators: analysis on the multidimensional knapsack problem

Jose Garcia*, Eduardo Lalla-Ruiz, Stefan Voss, Enrique Lopez Droguett

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

4 Citations (Scopus)

Abstract

Solving combinatorial optimization problems is of great interest in the areas of computer science and operations research. Optimization algorithms and particularly metaheuristics are constantly improved in order to reduce execution times, increase the quality of solutions and address larger instances. In this work, an improvement of the binarization framework which uses the K-means technique is developed. To achieve this, a perturbation operator based on the K-nearest neighbor technique is incorporated into the framework with the aim of generating more robust binarized algorithms. The technique of K-nearest neighbors is used for improving the properties of diversification and intensification of metaheuristics in its binary version. The contribution of the K-nearest neighbors perturbation operator to the final results is systematically analyzed. Particle Swarm Optimization and Cuckoo Search are used as metaheuristic techniques. To verify the results, the well-known multidimensional knapsack problem is tackled. A computational comparison is made with the state-of-the-art of metaheuristic techniques that use general mechanisms of binarization. The results show that our improved framework produces consistently better results. In this sense, the contribution of the operator which uses the K-nearest neighbors technique is investigated finding that this operator contributes significantly to the quality of the results.
Original languageEnglish
JournalInternational Journal of Machine Learning and Cybernetics
Early online date21 Feb 2020
DOIs
Publication statusE-pub ahead of print/First online - 21 Feb 2020

Keywords

  • UT-Hybrid-D
  • Machine Learning
  • Metaheuristics
  • KNN
  • K-means
  • Knapsack
  • Multidimensional knapsack problem
  • Heuristics
  • Combinatorial Optimisation

Cite this