Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ort openvino npu 1.17 master #1

Open
wants to merge 44 commits into
base: master
Choose a base branch
from
Open

Ort openvino npu 1.17 master #1

wants to merge 44 commits into from

Commits on Mar 13, 2024

  1. Add OpenVINO 2023.2 support

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    9e9c1fb View commit details
    Browse the repository at this point in the history

  2. num_of_threads mapped to inference_num_threads property of CPU

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    f71ca3a View commit details
    Browse the repository at this point in the history

  3. Use ONNX FrontEnd convert_model to facilitate external weights path

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b656d06 View commit details
    Browse the repository at this point in the history

  4. Fix Lint issues

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    cce97c0 View commit details
    Browse the repository at this point in the history

  5. inference_num_threadas is applicable only for the CPU device

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    babc244 View commit details
    Browse the repository at this point in the history

  6. Fix Lint issues

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b6e4af0 View commit details
    Browse the repository at this point in the history

  7. Add an user option to disable default dynamic model execution for imp… 

    …roved performance
    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    6b8c867 View commit details
    Browse the repository at this point in the history

  8. Fix for runtime errors with dynamic shapes flag

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    4f7fe28 View commit details
    Browse the repository at this point in the history

  9. Fix conflict in gitignore

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    6704415 View commit details
    Browse the repository at this point in the history

  10. Revert removal of USE_OPENVINO macro in provider registration; Add ch… 

    …ecks for proxy plugins for NUM_STREAMS
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    359b71b View commit details
    Browse the repository at this point in the history

  11. Enable OV CPU fallback for NPU compilation failures

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    fb6d981 View commit details
    Browse the repository at this point in the history

  12. Add NPU device in supported list of openvino devices

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    d2879b9 View commit details
    Browse the repository at this point in the history

  13. Handle dynamic shapes fallback for NPU to OV CPU

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b7db23f View commit details
    Browse the repository at this point in the history

  14. Remove NPU operator from static mapping

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    08f5b8c View commit details
    Browse the repository at this point in the history

  15. Add NPU device; Revert num_of_threads to 1 to be default

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    d9fe4c1 View commit details
    Browse the repository at this point in the history

  16. Add support for LayerNormalization Op; NPU to go through ReadModel ->… 

    … CompileModel stages
    @sspintel
    Ubuntu authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    ff7070b View commit details
    Browse the repository at this point in the history

  17. Fix an issue with provider options getting overwritten 

    Since there's a common GlobalContext, when we create two Sessions in the same user code,
the provider options of the first model gets overwritten with the second model's.

To overcome this, this PR creates an instance of GlobalContext for each instance of
OpenVINOExecutionProvider and uses it throughout wherever access to the GlobalContext's parameters are required.
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b4b2c59 View commit details
    Browse the repository at this point in the history

  18. Add device_precision access for UnsupportedOpModes

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    4121684 View commit details
    Browse the repository at this point in the history

  19. Fix an issue that shared global_context across subgraphs

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    e8fd60a View commit details
    Browse the repository at this point in the history

  20. Remove static mapping of LayerNorm op for the NPU; Remove unused MLAS… 

    … fallback code
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    439afd3 View commit details
    Browse the repository at this point in the history

  21. Add support for UINT16 DTYPE in initializers, NPU, and CPU devices

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    593d870 View commit details
    Browse the repository at this point in the history

  22. Temporarily disable model domain check as it is yet to be supported b… 

    …y the onnx frontend
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    de8194c View commit details
    Browse the repository at this point in the history

  23. Allow overriding NPU compiler type through an environmental variable

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    8fe5760 View commit details
    Browse the repository at this point in the history

  24. Remove deprecated model domain check

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    281ddf6 View commit details
    Browse the repository at this point in the history

  25. Remove unused parameter op_map

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    49d7f4a View commit details
    Browse the repository at this point in the history

  26. Enable dynamic backend execution for NPU

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0466f29 View commit details
    Browse the repository at this point in the history

  27. OV NPU fallback for OV CPU

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    e4cc1c9 View commit details
    Browse the repository at this point in the history

  28. The default should be false

    @hmamidix @sspintel
    hmamidix authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    da26118 View commit details
    Browse the repository at this point in the history

  29. Resetting num of threads to 0

    @hmamidix @sspintel
    hmamidix authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    6adbc90 View commit details
    Browse the repository at this point in the history

  30. Nuget does not need openvino windows dll

    @vthaniel @sspintel
    vthaniel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    16c9a3e View commit details
    Browse the repository at this point in the history

  31. Bug fix with dynamic backend key

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    4b78e50 View commit details
    Browse the repository at this point in the history

  32. Update Cmake to latest OV libs (intel#343) 

    * Update cmake to OV 2.0 libs

* Bug fix in ovep

* Set disable_dynamic_shapes to true for NPU

* Fix lint issues
    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    cbbcf43 View commit details
    Browse the repository at this point in the history

  33. add gelu op for ps* models

    @saurabhkale17 @sspintel
    saurabhkale17 authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0ff4b4f View commit details
    Browse the repository at this point in the history

  34. OV deprecated api

    @saurabhkale17 @sspintel
    saurabhkale17 authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    8d0b825 View commit details
    Browse the repository at this point in the history

  35. Remove deprecated code comments

    @vthaniel @sspintel
    vthaniel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    c7112f4 View commit details
    Browse the repository at this point in the history

  36. Update get_capability of OVEP

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    953398f View commit details
    Browse the repository at this point in the history

  37. Add a cmake option to install openvino providers library in a desired… 

    … location
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    543247c View commit details
    Browse the repository at this point in the history

  38. Throw useful Exceptions from OVEP

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    e211110 View commit details
    Browse the repository at this point in the history

  39. Use std::runtime_error instead of ov::Exception in basic_backend

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    7e75c9f View commit details
    Browse the repository at this point in the history

  40. Fix Unknown Exceptions arising from ov_interface.cc

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    698333e View commit details
    Browse the repository at this point in the history

  41. Apply lintrunner patches

    @sspintel
    Ubuntu authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b4e8838 View commit details
    Browse the repository at this point in the history

  42. Rename OVEP device for NPU without precision

    @preetha-intel @sspintel
    preetha-intel authored and sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    9d7892f View commit details
    Browse the repository at this point in the history

  43. Add Capability for OV 2024.0

    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    b9506a9 View commit details
    Browse the repository at this point in the history

  44. Remove unsupported Op LpPool; GridSample com.microsoft supported only… 

    … in model; Celu is a function Op
    @sspintel
    sspintel committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    ea4001b View commit details
    Browse the repository at this point in the history