Key Updates:
-
Removed Dependencies: The dependency on onnx-simplifier and onnx-graphsurgeon for ONNX-level optimization has been removed.
-
Expanded Compatibility: Added support for PyTorch versions 2.1, 2.2, 2.3 and 2.4 and Python versions 3.10, 3.11 and 3.12.
-
TensorRT Update: Starting with this version, we strongly recommend using the latest TensorRT version (currently 10.2) for the runner to ensure compatibility and optimal performance.
Minor Changes:
-
Calibration in no_grad Mode: Calibration now runs in no_grad mode by default. If benchmarking without no_grad is required, adjust the setting by modifying OWLITE_CALIBRATION_ENABLE_GRAD.
-
Minor bug fixes and UX improvements.
Impact on Users:
- Please use pre-built wheel for installation to avoid potential issues with dependencies and setup.