Update base image to 2410

[KumoLiu]

Fixes # .

Description

A few sentences describing the changes proposed in this pull request.

Types of changes

• Non-breaking change (fix or new feature that would not break existing functionality).
• Breaking change (fix or new feature that would cause existing functionality to change).
• New tests added to cover the changes.
• Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
• Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
• In-line docstrings updated.
• Documentation updated, tested make html command in the docs/ folder.

[KumoLiu]

Hi @borisfom, could you please take a look at this KeyError that occurred when I upgraded the base image to version 24.09?

[2024-10-22T07:05:01.446Z] ======================================================================

[2024-10-22T07:05:01.446Z] ERROR: test_handler (tests.test_trt_compile.TestTRTCompile)

[2024-10-22T07:05:01.446Z] ----------------------------------------------------------------------

[2024-10-22T07:05:01.446Z] Traceback (most recent call last):

[2024-10-22T07:05:01.446Z]   File "/tmp/tmp.xs4H7I9CC3/tests/test_trt_compile.py", line 66, in test_handler

[2024-10-22T07:05:01.446Z]     net1.forward(torch.tensor([[0.0, 1.0], [1.0, 2.0]], device="cuda"))

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/monai/networks/trt_compiler.py", line 496, in trt_forward

[2024-10-22T07:05:01.446Z]     return self._trt_compiler.forward(self, argv, kwargs)

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/monai/networks/trt_compiler.py", line 351, in forward

[2024-10-22T07:05:01.446Z]     raise e

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/monai/networks/trt_compiler.py", line 342, in forward

[2024-10-22T07:05:01.446Z]     self._build_and_save(model, build_args)

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/monai/networks/trt_compiler.py", line 447, in _build_and_save

[2024-10-22T07:05:01.446Z]     engine_bytes = torch_tensorrt.convert_method_to_trt_engine(

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/_compile.py", line 355, in convert_method_to_trt_engine

[2024-10-22T07:05:01.446Z]     serialized_engine: bytes = ts_convert_method_to_trt_engine(

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/ts/_compiler.py", line 270, in convert_method_to_trt_engine

[2024-10-22T07:05:01.446Z]     module._c, method_name, _parse_compile_spec(compile_spec)

[2024-10-22T07:05:01.446Z]   File "/usr/local/lib/python3.10/dist-packages/torch_tensorrt/ts/_compile_spec.py", line 225, in _parse_compile_spec

[2024-10-22T07:05:01.446Z]     elif compile_spec["input_signature"] is not None:

[2024-10-22T07:05:01.446Z] KeyError: 'input_signature'

[borisfom]

@KumoLiu : Unfortunately, this looks like internal Torch-TensorRT error I don't see an easy workaround for. Please just disable the failing test (test_handler) for now.

[KumoLiu]

@KumoLiu : Unfortunately, this looks like internal Torch-TensorRT error I don't see an easy workaround for. Please just disable the failing test (test_handler) for now.

Yes, the error originates from the internal code in Torch. However, I'm wondering if we need to update the base image. As you mentioned here, if not, we can simply wait for the 24.10 release. Thanks.

[KumoLiu]

[2024-10-22T07:05:01.446Z] KeyError: 'input_signature'

report a bug here: pytorch/pytorch#138674

[borisfom]

@KumoLiu : yes we should just wait until 24.10 release

[borisfom]

LGTM. The title should say '2410' though.

[KumoLiu]

/build

[KumoLiu]

/build