UC7 Mapping2-89 Eval_VV_8_Result

The human intervention has been reduced in the the test execution and evaluation in simulations.

Description of the evaluation

Use Case Id

Test case Test case where the V&V method has been used to improve a evaluation criteria. The test case where the V&V process improvement has been achieved

Requirement The validated requirement where a VALU3S V&V method has been used.

Evaluation Scenario The evaluation scenario where the V&V evaluation result has been obtained

V&V method

V&V Tool

Evaluation Criteria for V&V Processes

VALU3S V&V process Evaluation Criteria

Quantitative results Quantitative results , it can include the formula used to measure the value based on D5.2 evaluation criterias

Measured artefacts: Total person-hours cost: The total person-hours per task is obtained by multiplying the number of people assigned to a task (normalised to FTE – full-time employee) by the total time it takes to complete it.

5 human motions implemented and tested.
18 tests 1 minute each. Previous to the tool the engineer had to supervise the whole simulation whereas now the oracle provides the results and none human-in-the-loop is required. Time reduces TBD (~18 mins).

Long description

(Test generation) YOLOv7 pose estimation has been employed to track the human movements. These movements have been performed according to the motions that the workers with disabilities carry out in the actual disassembly plant.

(Test execution and verdict) UC7 demonstration employs HuroCTest to coordinate simulation-based testing activity in human-robot collaborative environments. The HuroCTest tool provides a real-time, automated verdict of test execution of simulation environments through constrained-based oracles using Simulation-Based Testing for Human-Robot Collaboration. To coordinate the testing with the Constrained-Based Oracle, HuroCTest leverages a ROS package to seamlessly align the execution of the test, the simulation environment, and the oracle.

Before using HuRoCTest it was mandatory for the engineer to run the simulation and the different tests on a regular basis. Now using HuRocTest, the validation is performed without the presence of the engineer, all tests are run automatically and the simulation environment is coordinated with the ULISES validator via a communication library.

Contents

There are currently no items in this folder.