BenchmarX
BenchmarX
Date
2014
Authors
Anjorin,Anthony
Cunha,Alcino
Alcino Cunha
Hermann,Frank
Rensink,Arend
Schürr,Andy
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Bidirectional transformation (BX) is a very active area of research interest. There is not only a growing body of theory, but also a rich set of tools supporting BX. The problem now arises that there is no commonly agreed-upon suite of tests or benchmarks that shows either the conformance of tools to theory, or the performance of tools in particular BX scenarios. This paper sets out to improve the state of affairs in this respect, by proposing a template and a set of required criteria for benchmark descriptions, as well as guidelines for the artifacts that should be provided for each included test. As a proof of concept, the paper additionally provides a detailed description of one concrete benchmark.