79360 20200922122724.0 doi 10.1109/TSMC.2018.2837643 sideral 109823 ART-2018-109823 eng (orcid)0000-0001-7982-0359 Rodriguez, R.J. An Evaluation Framework for Comparative Analysis of Generalized Stochastic Petri Net Simulation Techniques 2018 Access copy available to the general public Unrestricted Availability of a common, shared benchmark to provide repeatable, quantifiable, and comparable results is an added value for any scientific community. International consortia provide benchmarks in a wide range of domains, being normally used by industry, vendors, and researchers for evaluating their software products. In this regard, a benchmark of untimed Petri net models was developed to be used in a yearly software competition driven by the Petri net community. However, to the best of our knowledge there is not a similar benchmark to evaluate solution techniques for Petri nets with timing extensions. In this paper, we propose an evaluation framework for the comparative analysis of generalized stochastic Petri nets (GSPNs) simulation techniques. Although we focus on simulation techniques, our framework provides a baseline for a comparative analysis of different GSPN solvers (e.g., simulators, numerical solvers, or other techniques). The evaluation framework encompasses a set of 50 GSPN models including test cases and case studies from the literature, and a set of evaluation guidelines for the comparative analysis. In order to show the applicability of the proposed framework, we carry out a comparative analysis of steady-state simulators implemented in three academic software tools, namely, GreatSPN, PeabraiN, and TimeNET. The results allow us to validate the trustfulness of these academic software tools, as well as to point out potential problems and algorithmic optimization opportunities. info:eu-repo/grantAgreement/ES/DGA/T27 info:eu-repo/grantAgreement/EC/H2020/644869/EU/Developing Data-Intensive Cloud Applications with Iterative Quality Enhancements/DICE This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 644869-DICE info:eu-repo/grantAgreement/ES/MINECO/TIN2014-58457-R info:eu-repo/semantics/openAccess All rights reserved http://www.europeana.eu/rights/rr-f/ 2.147 2018 Computer Science Applications 2018 Q1 Control and Systems Engineering 2018 Q1 Software 2018 Q1 Human-Computer Interaction 2018 Q1 Information Systems 2018 Q1 Electrical and Electronic Engineering 2018 Q1 info:eu-repo/semantics/article info:eu-repo/semantics/acceptedVersion (orcid)0000-0002-2605-6243 Bernardi, S. Universidad de Zaragoza Zimmermann, A. 5007 570 Universidad de Zaragoza Dpto. Informát.Ingenie.Sistms. Área Lenguajes y Sistemas Inf. 50, 873612 (2018), 2834 - 2844 IEEE trans. syst. man cybern., Syst. IEEE transactions on systems, man, and cybernetics. Systems 2168-2216 1572566 http://zaguan.unizar.es/record/79360/files/texto_completo.pdf Postprint 140079 http://zaguan.unizar.es/record/79360/files/texto_completo.jpg?subformat=icon icon Postprint oai:zaguan.unizar.es:79360 articulos driver 2020-09-22-12:19:54 ARTICLE