A review of performance criteria to validate simulation models

Abstract

This study reviews performance criteria adequate to validate simulation models through the comparison of two quantitative data sets, concerning historical and simulated data. The criteria reviewed were organized according to its characteristics into the groups: error-based measures, information theory measures, information criteria, parametric tests, non-parametric tests, distance-based measures and combined measures. Each criterion is reviewed through its mathematic definition, its applications in literature and the identification of its advantages and drawbacks. The features assessed by each criterion are identified and discussed. This study provides a concise outline over the criteria reviewed, which can be used as a guide to help developers of simulation models into the decision on the most appropriate criteria to validate their models.