Conference article

Sound evaluation of simulation results

Matthias Becker
VIA Consulting & Development GmbH, Aachen, Germany

Thorsten Büker
VIA Consulting & Development GmbH, Aachen, Germany

Eike Hennig
VIA Consulting & Development GmbH, Aachen, Germany

Felix Kogel
VIA Consulting & Development GmbH, Aachen, Germany

Download article

Published in: RailNorrköping 2019. 8th International Conference on Railway Operations Modelling and Analysis (ICROMA), Norrköping, Sweden, June 17th – 20th, 2019

Linköping Electronic Conference Proceedings 69:7, p. 99-115

Show more +

Published: 2019-09-13

ISBN: 978-91-7929-992-7

ISSN: 1650-3686 (print), 1650-3740 (online)

Abstract

Simulation is one of the powerful means within the toolset of railway operations research. In contrast to timetabling and to queuing theory, it supports a precise representation of interdependencies and has thus a large field of application. Since in today’s railway operation many timetable concepts and even big investment-decisions are based on studies conducted with simulation tools, a focus should be set to the sound evaluation of simulation results, too. Nevertheless, the aggregation, validation and interpretation of simulation (raw) data can barely be found in literature. This fundamental task is subject of this paper. A simulation consists of the following steps: model design, parametrisation and calibration, simulation, processing of raw data, interpretation and visualisation of results. First, various input parameters are manipulated and simulation results are manually evaluated in a simple closed-loop principle. As each simulation is subject to outliers, runs affected by dubious conflict solutions have to be identified and excluded automatically. In most cases, a special focus is on the comparison of different scenarios and the necessity of establishing comparability by forming intersections between the simulation runs. The remaining subset of simulation runs per scenario can be considered (statistically) representative, as soon as the key figure of each scenario series converges. Finally, the raw data can be processed for the evaluation of simulation results. Results of simulations are mostly complex but by producing results for different target groups the complexity has to be reduced without losing important details or provoking misinterpretation. For this reason, it is necessary to choose key figures which comprehensively represent the simulation results.

Keywords

simulation, evaluation, calibration, intersectioning, interpretation

References

No references available

Citations in Crossref