UC9_R_5

Accuracy metrics must be calculated for each test execution, comparing the test execution results and the expected results, defined by the ground truth for the journey.

Requirement ID

Requirement Textual Description

Requirement Type

Requirement Test Cases

Requirement Test Cases List

VALU3S Framework

Evaluation Environment Type Type of environment where the method is applied. It can be more than one type of environment.(Dimension 1)

Evaluation Type Type of evaluation performed with that method. If a method is hybrid, more than one type can be selected.(Dimension 2)

Type of Component Under Evaluation Type of components that can be evaluated with that method. It can be more than one type.(Dimension 3)

Evaluation Stage The evaluation stage where the method is used.(Dimension 5)

Purpose of the Component Under Evaluation The type of purpose that can be evaluated by a method. It can be more than one type.(Dimension 6)

Type of Requirement Under Evaluation The type of requirements that a method is able to evaluate. It can be more than one type.(Dimension 7)

Evaluation Performance Indicator The type of evaluation criteria or KPI that a method is able to improve. It can be more than one type.(Dimension 8)

Contents

Analyse results of a test execution

Analyse results of a test execution Precondition: - Ground truth for validation dataset exists - File containing detected elements information exists Steps and input condition: - Execute accuracy metric calculation Expected results - Accuracy metrics are calculated and file containing these metrics is generated