Monitoring Enriched Test Execution

The concretized test cases, monitor definitions and the system under test (configured digital twin) are inputs for this activity, where the system is executed in a monitoring-enriched environment. This environment makes use of formally defined monitors to ensure that properties of the continuous outputs (e.g., motor speed, current, voltage) of the system under test hold. This is an application of the Test Oracle Observation at Runtime method (as part of Monitoring Enriched Test Execution). A test result report is written as output of this activity.

Monitoring Enriched Test Execution enables the analysis of signals based on formal requirement definitions. The system is tested by the simulation with a digital twin and chosen system traces, such as discrete/continuous domain signals, are exported to the Real-Time Analog Monitoring Tool (RTAMT [1]) which analyses signals and checks them against the formally specified requirements. As results, the digital twin simulation outputs a test report, while the RTAMT tool generates an analysis test result potentially showing requirement violations and indicators for bug fixes and optimizations.

Activities:

* Digital Twin Simulation. The digital twin is started based on the provided test case sequences enabling combined analysis of safety, security and performance. During simulation or after successful simulation, a test report is output and simulation traces are exported to the RTAMT monitor for further signal analysis.

* RTAMT monitor execution. RTAMT is a Python (2- and 3-compatible) library for monitoring of Signal Temporal Logic (STL). The library implements algorithms offline and online monitoring of discrete-time and dense-time STL. The online monitors support the bounded future fragment of STL. The online discrete-time part of the library has an optimized C++ back-end.

[1] D. Nickovic, “RTAMT Web-site,” [Online]. Available: https://github.com/nickovic/rtamt.

Extensible Markup Language (XML) UC13_monitoring_enriched_test_execution.xml — Extensible Markup Language (XML), 621 KB
Contents

There are currently no items in this folder.