CR-1169187 Disable all PS tests

[dbenusov]

Problem solved by the commit

https://jira.xilinx.com/browse/CR-1169187?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel

The PS validate command fails on the ps-iops test as I forgot to update the test case. Additionally there is an issue loading multiple xclbins so I have disabled all ps tests until that is resolved.

Bug / issue (if any) fixed, which PR introduced the bug, how it was discovered

xbutil validate is failing for v70 base3 & base2 platforms. Introduced in #7624

How problem was solved, alternative solutions (if any) and why they were rejected

Update all PS testcases to return Not Supported error code.

Risks (if any) associated the changes in the commit

The tests will not work so no risks!

What has been tested and how, request additional testing if necessary

Ubuntu 22.04 vck5000

dbenusov@xsjdbenusov50:/proj/rdi/staff/dbenusov$ xbutil validate -d 17:00 --verbose
WARNING: Unexpected xocl version (2.14.0) was found. Expected 2.16.0, to match XRT tools.
Verbose: Enabling Verbosity
***********************************************************
*        WARNING          WARNING          WARNING        *
*       SC version data missing. Upgrade your shell       *
***********************************************************
Validate Device           : [0000:17:00.1]
    Platform              : xilinx_vck5000_gen4x8_qdma_base_2
    SC Version            : 4.4.35
    Platform ID           : 05DCA096-76CB-730B-8D19-EC1192FBAE3F
-------------------------------------------------------------------------------
Test 1 [0000:17:00.1]     : aux-connection

    Description           : Check if auxiliary power is connected
    Details               : Aux power connector is not available on this board
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 2 [0000:17:00.1]     : pcie-link
    Description           : Check if PCIE link is active
    Warning(s)            : Link is active
                            Please make sure that the device is plugged into Gen 4x8,
                            instead of Gen 3x8. Lower performance maybe experienced.
    Test Status           : [PASSED WITH WARNINGS]
-------------------------------------------------------------------------------
Test 3 [0000:17:00.1]     : sc-version
    Description           : Check if SC firmware is up-to-date
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 4 [0000:17:00.1]     : verify
    Description           : Run 'Hello World' kernel test
    Xclbin                : /opt/xilinx/firmware/vck5000/gen4x8-qdma/base/test
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/validate.exe
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 5 [0000:17:00.1]     : dma
    Description           : Run dma test
    Details               : Buffer size - '16 MB'
                            Host -> PCIe -> FPGA write bandwidth = 6586.8 MB/s
                            Host <- PCIe <- FPGA read bandwidth = 6626.3 MB/s
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 6 [0000:17:00.1]     : iops
    Description           : Run scheduler performance measure test
    Xclbin                : /opt/xilinx/firmware/vck5000/gen4x8-qdma/base/test
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/xcl_iops_test.exe
    Details               : IOPS: 400458 (verify)
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 7 [0000:17:00.1]     : mem-bw
    Description           : Run 'bandwidth kernel' and check the throughput
    Xclbin                : /opt/xilinx/firmware/vck5000/gen4x8-qdma/base/test
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/kernel_bw.exe
    Details               : Throughput (Type: DDR) (Bank count: 1) : 20980.2MB/s
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 8 [0000:17:00.1]     : p2p
    Description           : Run P2P test
    Details               : P2P config failed. P2P is not supported. Can't find P2P
                            BAR.
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 9 [0000:17:00.1]     : m2m

    Description           : Run M2M test
    Details               : M2M is not available
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 10 [0000:17:00.1]    : hostmem-bw

    Description           : Run 'bandwidth kernel' when host memory is enabled
    Details               : Host memory is not enabled
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 11 [0000:17:00.1]    : vcu
    Description           : Run decoder test
    Details               : /opt/xilinx/firmware/vck5000/gen4x8-qdma/base/test/transcode.xclbin
                            not available. Skipping validation.
                            Verify xclbin not available or shell partition is not
                            programmed. Skipping validation.
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 12 [0000:17:00.1]    : aie
    Description           : Run AIE PL test
    Xclbin                : /opt/xilinx/firmware/vck5000/gen4x8-qdma/base/test
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/aie_pl.exe
    Test Status           : [PASSED]
-------------------------------------------------------------------------------
Test 13 [0000:17:00.1]    : ps-aie

    Description           : Run PS controlled AIE test
    Xclbin                : /lib/firmware/xilinx/ps_kernels
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/ps_aie.exe
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 14 [0000:17:00.1]    : ps-pl-verify

    Description           : Run PS controlled 'Hello World' PL kernel test
    Xclbin                : /lib/firmware/xilinx/ps_kernels
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/ps_bandwidth.exe
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 15 [0000:17:00.1]    : ps-verify

    Description           : Run 'Hello World' PS kernel test
    Xclbin                : /lib/firmware/xilinx/ps_kernels
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/ps_validate.exe
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Test 16 [0000:17:00.1]    : ps-iops
    Description           : Run IOPS PS test
    Xclbin                : /lib/firmware/xilinx/ps_kernels
    Testcase              : /proj/rdi/staff/dbenusov/XRT/build/Debug/opt/xilinx/xrt/test/ps_iops_test.exe
    Test Status           : [SKIPPED]
-------------------------------------------------------------------------------
Validation completed, but with warnings

Documentation impact (if any)

[gbuildx]

Build Passed!