Journal of Decision Support Systems and Multi-Criteria Decision Making (JODESMA)
Vol. 1 No. 2 (2027): March 2027

Benchmarking Aggregation-Based MCDM Methods: A Comparative Analysis of Ranking Consistency, Stability, and Robustness

Sumanto Sumanto (Universitas Bina Sarana Informatika)
Mochamad Wahyudi (Universitas Bina Sarana Informatika)
Lise Pujiastuti (STMIK Antar Bangsa)



Article Info

Publish Date
20 Mar 2027

Abstract

Multi-Criteria Decision Making (MCDM) methods are widely applied in Decision Support Systems (DSS) to address selection problems involving multiple criteria. However, differences in aggregation mechanisms may affect ranking consistency, stability, and robustness under changing decision conditions. This study presents a benchmarking analysis of five aggregation-based MCDM methods, namely Simple Additive Weighting (SAW), Weighted Aggregated Sum Product Assessment (WASPAS), Additive Ratio Assessment (ARAS), Complex Proportional Assessment (COPRAS), and Multi-Attributive Ideal-Real Comparative Analysis (MAIRCA), for employee selection. Ranking consistency is evaluated using Spearman rank correlation, while stability and robustness are assessed using the Ranking Stability Index and Ranking Retention Rate. SAW, WASPAS, ARAS, and COPRAS achieve perfect consistency with the reference ranking, with a Spearman coefficient of 1.0000, while MAIRCA obtains 0.9879. ARAS and COPRAS achieve the highest stability, with an RSI of 97.22%, and robustness, with an RRR of 86.11%. SAW, WASPAS, and MAIRCA achieve an RSI of 95.56% and an RRR of 77.78%. Ranking changes are mainly limited to an exchange between Candidates 1 and 9, while Candidate 3 remains first across all scenarios. These findings suggest that ARAS and COPRAS exhibit comparatively higher ranking stability under the experimental conditions considered in this study.

Copyrights © 2027






Journal Info

Abbrev

jodesma

Publisher

Subject

Description

The Journal of Decision Support Systems and Multi-Criteria Decision Making is a scientific journal dedicated to the development, application, and advancement of decision support systems and multi-criteria decision-making approaches. It provides a scholarly platform for researchers, academics, ...