Comparative Evaluation of Multi-Criteria Decision-Making Methods in the Online-CADCOM Platform

Abstract

The Online-CADCOM platform operates as a cloud-based decision support system which lets users pick Computer-Aided Design (CAD) tools for telecommunications and electronics applications. The production platform uses two Multi-Criteria Decision Analysis (MCDA) methods MAUT and PROMETHEE II to evaluate tools through binary feature criteria stored in a PostgreSQL knowledge base [3], [4]. The MCDA engine receives three additional decision analysis methods which include TOPSIS (Technique for Order Preference by Similarity to Ideal Solution) and VIKOR (VlseKriterijumska Optimizacija I Kompromisno Resenje) and COPRAS (Complex Proportional Assessment). The research module contains all five evaluation methods which process equal decision matrices to generate agreement metrics through Spearman rank correlation and top-k overlap analysis. The evaluation of three actual selection cases including PCB design tool selection and PCB calculator selection and SMPS design tool selection produced similar decision patterns. The three methods MAUT and PROMETHEE II and VIKOR create a consensus group which produces identical rankings throughout most evaluation scenarios while COPRAS follows MAUT patterns and TOPSIS produces different results when criteria coverage is limited or when criteria have negative correlations with value-based methods. The five methods produce identical rankings because their tools display different characteristics. The research adds three main contributions to the field: (1) The Online-CADCOM engine now supports TOPSIS and VIKOR and COPRAS as additional decision analysis methods. (2) The research evaluates five MCDA methods through actual tool passport data from three engineering fields. The research establishes essential guidelines which engineers need to select proper MCDA methods for their tool selection work.