Charts[Test]: Implement smoke tests and integrate with CI/CD

[leninmehedy]

Requested Feature

We need a set of smoke tests to be run after the infrastructure is deployed to ensure port mappings are correct.

There are few manual smoke test scripts available that we run manually to ensure the infrastructure is operational. So it would be useful to have those automated as a separate Makefile target.

Some of the existing "manual smoke tests" are in the following directories:

• /dev/gateway-api
• /dev/telemetry

We could have a makefile target such as "make run-smoke-tests" that runs those smoke tests. This should also be run in the CI pipeline.

Business Need

Currently helm-chart tests only verifies if infrastructure components have been deployed or not. Smoke tests for port mapping can add extra confidence that the infrastructure is operational by running some basic e2e that tests for telemetry and gateway-api.

In addition, these sets of basic smoke tests should be run in CI-pipeline.

Additional Context

We could have these tests as part of the fsnetman CLI

Tasks

Beta Give feedback

1. Charts[Test] Implement smoke tests for otel-collector ports and telemetry data #316
   Feature Enhancement Pending Triage +2
2. Charts[Test] Implement smoke tests for gateway-api routes #426
   Pending Triage +1
3. Charts[Test] Implement smoke tests for mirror-node GRPC API #427
   Pending Triage +1
4. Charts[Test] Implement smoke tests for explorer API #428
   Pending Triage +1
5. Charts[Test] Implement smoke tests for JSON-RPC relay API #429
   Pending Triage +1
6. Charts[Test] Integrate smoke tests with CI/CD pipeline #430
   Pending Triage +1
7. Charts[Test] Implement smoke test for platform node

[leninmehedy]

We shall implement this as part of the CLI

[jeromy-cannon]

would be good to use this feature to create unit, integration, and e2e tests for the helm charts. Some useful links to explore further:

• https://medium.com/@zelldon91/advanced-test-practices-for-helm-charts-587caeeb4cb
• https://kuttl.dev/docs/what-is-kuttl.html#overview

Currently, we are still using the make files, and even the helm test <chart name> is not being used in the build process and has minimum functionality. Currently the build process is still using the makefile scripts.