|
|
|
| R2012a Documentation → Simulink Design Verifier | |
Learn more about Simulink Design Verifier |
|
| Contents | Index |
| On this page… |
|---|
The following sections describe a demo model, Cruise Control Test Generation. This demo illustrates how to use the Simulink Design Verifier software to generate test cases that achieve complete model coverage. Through this demo, you learn how to analyze models with the Simulink Design Verifier software and interpret the results.
To open the Cruise Control Test Generation model, at the MATLAB prompt, enter:
sldvdemo_cruise_control
To generate test cases for the Cruise Control Test Generation model, open the model window and double-click the block labeled Run.
The Simulink Design Verifier software begins analyzing the model to generate test cases. During its analysis, the software displays a log window.
The log window shows you the progress of the Simulink Design Verifier analysis.
If you need to terminate an analysis while it is running, click Stop. The software asks if you want to produce results. If you click Yes, the software creates a data file based on the results achieved so far. The path name of the data file appears in the log window.
The data file is a MAT-file that contains a structure named sldvData. This structure stores all the data that the software gathers and produces during the analysis.
For more information, see Simulink Design Verifier Data Files.
When the Simulink Design Verifier software completes its analysis of the sldvdemo_cruise_control model, the log window displays several options:
Highlight analysis results on model
Generate detailed analysis report
Create harness model
Simulate tests and produce a model coverage report
Note When you analyze other models, depending on the results of the analysis, you may see a subset of these four options. |
The sections that follow describe these options in detail.
In the Simulink Design Verifier log window, if you click Highlight analysis results on model, the software highlights objects in the model in three different colors, depending on the analysis results:
When you highlight the analysis results on a model, the Simulink Design Verifier Results window opens. When you click an object in the model that has analysis results, that window displays the results summary for that object.
Green: Objectives Satisfied. Green outline indicates that the analysis generated test cases for all the objectives for that block. If the block is a subsystem or Stateflow atomic subchart, the green outline indicates that the analysis generated test cases for all objectives associated with the child objects.
For example, in the sldvdemo_cruise_control model, the green outline shows that the PI controller subsystem satisfied all test objectives. The Informer lists the two satisfied test objectives for the PI controller subsystem.
Orange: Objectives Undecided. Orange outline indicates that the analysis was not able to determine if an objective was satisfiable or not. This situation might occur when:
The analysis times out
The software satisfies test objectives without generating test cases due to:
Automatic stubbing errors
Limitations of the analysis engine
In the following example, the analysis timed out before it could determine if one of the objectives for the Discrete-Time Integrator block was satisfiable.
Red: Objectives Unsatisfiable. Red outline indicates that the analysis found some objectives for which it could not generate test cases, most likely due to unreachable design elements in your model.
In the following example, the input 2 always satisfies the criterion for the Switch block, so the Switch block never passes through the value of input 3.
In the Simulink Design Verifier log window, if you click Generate detailed analysis report, the software saves and then opens a detailed report of the analysis. The path to the report is:
<current_folder>/sldv_output/...
sldvdemo_cruise_control/sldvdemo_cruise_control_report.htmlThe HTML report includes the following chapters.
For a description of each report chapter, see:
Summary. In the Table of Contents, click Summary to display the Summary chapter, which includes the following information:
Name of the model
Mode of the analysis (test generation, property proving, design error detection)
Status of the analysis
Length of the analysis in seconds
Number of objectives satisfied
Analysis Information. In the Table of Contents, click Analysis Information to display information about the analyzed model and the analysis options.
Test Objectives Status. In the Table of Contents, click Test Objectives Status to display a table of satisfied objectives. The following figure shows a partial list of the objectives satisfied in the Cruise Control Test Generation model.
The Objectives Satisfied table lists the following information for the model:
# — Objective number
Type — Objective type
Model Item — Element in the model for which the objective was tested. Click this link to display the model with this element highlighted.
Description — Description of the objective
Test case — Test case that achieves the objective. Click this link for more information about that test case.
In the row for objective 30, click the test case number (8) to display more information about test case 8 in the report's Test Cases chapter.
In this example, Test Case 8 satisfies one objective, that the integration result be greater than or equal to the upper limit T in the Discrete-Time Integrator block. The table lists the values of the six signals from time 0 through time 0.06.
Model Items. In the Table of Contents, click Model Items to see detailed information about each item in the model that defines coverage objectives. This table includes the status of the objective at the end of the analysis. Click the links in the table for detailed information about the satisfied objectives.
Test Cases. In the Table of Contents, click Test Cases to display detailed information about each generated test case, including:
Length of time to execute the test case
Number of objectives satisfied
Detailed information about the satisfied objectives
Input data
For an example, see the section for Test Case 8 in Test Objectives Status.
In the Simulink Design Verifier log window, if you click Create harness model, the software creates and opens a harness model named sldvdemo_cruise_control_harness.
The harness model contains the following blocks:
The Test Case Explanation block is a DocBlock block that documents the generated test cases. Double-click the Test Case Explanation block to view a description of each test case for the objectives that the test case satisfies.
The Test Unit block is a Subsystem block that contains a copy of the original model that the software analyzed. Double-click the Test Unit block to view its contents and confirm that it is a copy of the Cruise Control Test Generation model.
Note You can configure the harness model to reference the model that you are analyzing using a Model block instead of using a subsystem. In the Configuration Parameters dialog box, on the Design Verifier > Results pane, select Save test harness as model and Reference input model in generated harness. |
The Inputs block is a Signal Builder block that contains the generated test case signals. Double-click the Inputs block to open the Signal Builder dialog box and view the 10 test case signals.
The Size-Type block is a subsystem that transmits signals from the Inputs block to the Test Unit block. This block verifies that the size and data type of the signals are consistent with the Test Unit block.
The Signal Builder dialog box contains nine test cases. To look at Test Case 8:
Click the right-facing arrow next to the test case
tabs
to find the Test Case 8 tab.
Click the Test Case 8 tab to display the signal values for Test Case 8.
In Test Case 8 at 0.01 seconds:
The enable and inc signals remain 1.
The brake and dec signals remain 0.
The set signal transitions from 1 to 0.
The speed signal transitions from 100 to 0.
In the Signal Builder block, the signal group satisfies the test objectives described in the Test Case Explanation block.
To confirm that the Simulink Design Verifier software
achieved complete model coverage, simulate the harness model using
all the test cases. In the Signal Builder dialog box, click the Run
all and produce coverage button
.
The Simulink software simulates all the test cases. The Simulink Verification and Validation software collects coverage data for the harness model and displays a coverage report. The report summary shows that the sldvdemo_cruise_control_harness model achieves 100% coverage.
In the Simulink Design Verifier log window, if you click Simulate tests and produce a model coverage report, the software simulates the model and produces a coverage report for the sldvdemo_cruise_control model. The software stores the report with the following name:
<current_MATLAB_folder/sldv_output/sldvdemo_cruise_control/sldvdemo_cruise_control_report.html
When you click Run all and produce coverage to simulate tests in the harness model, you may see the following differences between this coverage report and the report you generated for the model itself:
The harness model coverage report might contain additional time steps. When you collect coverage for the harness model, the model stop time equals the stop time for the longest test case. As a result, you might achieve additional coverage when you simulate the shorter test cases.
The cyclomatic complexity coverage for the Test Unit subsystem in the harness model might be different than the coverage for the model itself due to the structure of the harness model.
If you prefer to review results that are combined into a smaller number of test cases, set the Test suite optimization parameter to LongTestcases. When you use the LongTestcases optimization, the analysis generates fewer, but longer, test cases that each satisfy multiple test objectives. This optimization creates a more efficient analysis and easier-to-review results.
Open the sldvdemo_cruise_control model and rerun the analysis with the Long test cases optimization:
Select Tools > Design Verifier > Options.
In the Configuration Parameters dialog box, in the Select tree on the left side, under the Design Verifier category, select Test Generation.
Set the Test suite optimization parameter to LongTestcases.
Click Apply and OK to close the Configuration Parameters dialog box.
In the sldvdemo_cruise_control model, double-click the block labeled Run.
In the log window, click Create harness model.
In the harness model, the Signal Builder dialog box now contains two longer test cases instead of the nine shorter test cases created in Analyzing a Model.
Click Run all and produce coverage to collect coverage.
The analysis still satisfies all 34 objectives.
 | Starting the Simulink Design Verifier Software | Analyzing a Subsystem |  |
Learn more about Simulink through this collection of videos, articles, technical literature and the Getting Started with Simulink Guide.
| © 1984-2012- The MathWorks, Inc. - Site Help - Patents - Trademarks - Privacy Policy - Preventing Piracy - RSS |
