Testing Overview

OVIS has many parts, virtually all in on-going development, that interact with each other and with a very diverse set of platforms (hardware and software environments) and a diverse set of customers/users. We need and use several methods of testing to support maintaining many kinds of software features.

The goal of this page is to be a jumping off point for cataloging the methods and the features as currently used or as needed for ovis products. It also captures some presentations about testing work prior to 2021, for historical perspective and an understanding of critical needs that drive test development.

• Testing methods and infrastructure The OVIS project provides software intended to work in a variety of evolving High Performance Computing environments for which there is no single reference platform and for which no single institution owns an example of all the supported platforms. This leads to a diverse testing infrastructure, as cataloged in the link above.

• The software, its construction, packaging, installation, configuration, and operation all have numerous features to be tested. Documenting and testing these evolving features and their many combinations can be found in the Functional Verification Test Plan.

• Other parts of the software to be tested are the performance, resiliency and system which can be found in the link(s) below, respectively.

  • Performance Test Plan
  • Resiliency Test Plan
  • System Verification Test Plan

• Where to find the latest testing results Creating a unified public dashboard is difficult given the diversity of test methods and proprietary platforms. The link above captures the locations.

• Some bits of LDMS testing history:

  • SNL automated as-built testing describes work enabling build-time and automated testing of LDMSD in its build and production deployment environments, including single node and cluster test modes.

  • Test status page from SRN confluence page This provides the test results of the sampler and storage plugins through the ldms-static-test script.