The Jenkins plugin for MATLAB® enables you to easily run your MATLAB and Simulink® tests and generate artifacts such as JUnit and TAP test results, and Cobertura code or model coverage reports. You can also export your Simulink Test™ Manager results. This guide shows you examples of how to configure the plugin for different objectives, considering a Microsoft® Windows® platform.
To configure the plugin for a freestyle project, select Run MATLAB Tests from the Add build step list. Then, enter the value returned by the matlabroot function in the MATLAB root field.
With the Jenkins plugin for MATLAB, you have the option to run your tests in either automatic or custom mode. The automatic test mode employs a default setting to run tests written using the MATLAB Unit Testing Framework and/or Simulink Test. If your source code is organized as files and folders within a project, the plugin will consider any test files in the project that have been tagged as Test. If your code does not leverage a project or uses a MATLAB version prior to R2019a, the plugin will consider all tests in the current Jenkins workspace including the subfolders.
If you use a source code management (SCM) system such as Git, then your job must include the appropriate SCM configuration to check out the code before it can invoke the MATLAB plugin. If you do not use any SCM systems to manage your code, then an additional build step is required to ensure that the code is available in the Jenkins workspace before the build starts.
The automatic test execution feature of the plugin enables you to generate different types of test artifacts. To publish the test results, you can use these artifacts with other Jenkins plugins. To configure the Jenkins build where MATLAB tests run automatically, follow these steps.
- From the Test mode drop-down list, select the Automatic option (Automatic is the default testing mode).
- Select your desired test artifacts.
The selected artifacts will be saved in the matlabTestArtifacts folder of the Jenkins workspace.
If you do not select any of the test artifact check boxes, the matlabTestArtifacts folder will not be created in the workspace. However, tests will still run and potential test failures will fail the build.
The Automatic test mode results in a MATLAB script file named runMatlabTests.m in the Jenkins workspace. The plugin uses this file to run the tests and generate the test artifacts. You can review the contents of the script to understand the testing workflow.
This option enables you to develop your custom MATLAB commands for running tests. To configure the Jenkins build where you can customize the MATLAB test execution, follow these steps.
- From the Test mode drop-down list, select the Custom option.
- Enter your commands in the MATLAB command field. If you specify more than one MATLAB command, use a comma or semicolon to separate the commands. The build will fail if the execution of any command results in an error.
Note: If you need several MATLAB commands to run your tests, consider writing a MATLAB script or function as part of your repository and executing this script or function instead. Test artifacts are not autogenerated if you choose to run tests using custom MATLAB commands. You can generate your desired test artifacts by configuring the test runner in the script or function that you invoke from the MATLAB command field.
In addition to freestyle projects, the Jenkins plugin for MATLAB supports multi-configuration (matrix) projects. Multi-configuration projects are useful when builds include similar steps, for example when the same test suite should run on different platforms (e.g., Windows, Linux, and Mac) or using several MATLAB versions.
As in a freestyle project, you can run your tests in automatic or custom mode within a multi-configuration project. The configuration requires you to specify the location where MATLAB is installed as well as the test execution mode. You should also add user-defined axes in the Configuration Matrix to specify the duplicating build steps.
To configure the plugin for a matrix build where tests run automatically in multiple MATLAB versions, create a multi-configuration project and follow these steps.
- Add a user-defined axis in the Configuration Matrix to represent the MATLAB versions in the build. Specify the name of the axis in the Name field and its values in the Values field. Separate the elements in the Values field with a space. In this example, four MATLAB versions are specified, which will be used to run the same set of tests.
- In the Run MATLAB Tests section of the project, include the user-defined axis name in the MATLAB root field to specify the locations where MATLAB is installed. In this example, $VERSION will be replaced by one axis value per build step.
You can select the test artifact check boxes when tests run automatically. Once you have made your selections, save your settings and run the build.
To configure the matrix build where you can customize the MATLAB test execution, create a multi-configuration project and follow these steps.
- Add a user-defined axis in the Configuration Matrix to represent the MATLAB versions in the build.
- Add another user-defined axis using the Add axis button. In this example, the TEST_TAG axis specifies the possible test tags for a group of test elements.
- In the Run MATLAB Tests section of the project, use the VERSION axis to specify the locations where MATLAB is installed.
- From the Test mode drop-down list, select the Custom option. Use the second user-defined axis to create your commands and enter them in the MATLAB command field. Then, save your settings and run the build.
Notes:
-
For a user-defined axis named VAR, $VAR and ${VAR} are both valid formats for accessing the values.
-
A multi-configuration project creates a separate workspace for each user-defined axis value. If you specify the full paths to where MATLAB is installed as axis values, Jenkins fails to create separate workspaces and fails the build.
If you have any questions or suggestions, please contact MathWorks.
MIT © 2019 The MathWorks, Inc.
| Overall | Linux | Windows | Mac |
|---|---|---|---|