Scenario Simulation
Scenario simulation encompasses the parameterization and execution of a single instance or a whole series of simulation runs that involve a virtual environment, traffic simulation, sensor simulation, the system-under-test (SuT) etc.
Looking at the figure above, one may argue whether Scenario Simulation is to be regarded as a product category within Integrated Solutions or as something that comprises and controls an integrated solution. It may be both, but no matter where you put it, it still is a product category that deserves a distinct rating.
The goal of scenario simulation is to expose the SuT to as many relevant situations as possible in order to derive a measure of its maturity and degree of safe operation (see also SOTIF – safety of the intended functionality). The term “scenario-based-testing” has been used for other industries in the past but is now also being applied for systems that involve environment simulation.
We start this category with a high-level abstraction of functional details and we reserve the right to split this category at some point in order to provide a more differentiated rating of various solutions.
Criteria
The rating criteria for Scenario Simulation can be found on our Rating Policies page.
Overview of Rated Packages
We tested the following packages (click on name to get to the detailed rating information):
There are limits of what we can achieve and what liability we may have. Please take notice of our Disclaimer.
The Ratings
Esmini
- homepage: https://github.com/esmini
- Version: 2.8.0
- Reviewed: April 30, 2021
- Reviewer: Marius
- Review List Version: A
- Resources:
- GitHub repository
- Installation and live experience
- free and open source software
- one of the few packages on the market with great support of OpenSCENARIO
- supports also OpenDRIVE and OSI
- provides OpenDRIVE preview tool
- very lean and efficient implementation
- runs out-of-the-box without any further dependencies
- good and very personalized support via GitHub
- comes with a set of basic examples
- run by competent people with credible history in scenario simulation
- interfacing and integration seems pretty straightforward
- no GUI operation
- documentation is good for programmers but hard to read for end users
- no scenario modeling tool included
- no formal set of scenarios (e.g. NCAP) included
- no parameter variation (i.e. execution of logical scenarios)
- not all aspects of OpenSCENARIO are supported
It's a tool for programmers who rely on scripting and programming interfaces. End users who wish for an intuitive GUI operation may not be too happy at the beginning but it is really worth going into the details, launching a shell and running a few example. The good user experience comes from seeing things work.
As stated by the developers, esmini is a tool that is developed along the standards and it was not intended for productive use. But, deficiencies aside, it really fulfills its purpose and its release history indicates that more is to come.
Be the first to leave a review.
Missing a Product?
Please let us know if you are interested in having us review a specific product. Provided it fits our scope and in case it’s a free and open source product, things will be easy and we will be happy to execute your request asap. For products outside our scope we might need to discuss the relevance with you first. For fully commercial products we might need to contact the vendor and clarify access to further information, an evaluation copy etc. But we’ll happy to do this – it’s our task and “mission”.