Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Relax the torch version dependency #84

Closed
wants to merge 21 commits into from
Closed

Relax the torch version dependency #84

wants to merge 21 commits into from

Commits on Jun 21, 2024

  1. chore: add fork OWNERS

    @z103cb @dtrifiro
    z103cb authored and dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    8b8fed5 View commit details
    Browse the repository at this point in the history

  2. add ubi Dockerfile

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5048126 View commit details
    Browse the repository at this point in the history

  3. Dockerfile.ubi: remove references to grpc/protos

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    0264b36 View commit details
    Browse the repository at this point in the history

  4. Dockerfile.ubi: use vllm-tgis-adapter

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    a5047d8 View commit details
    Browse the repository at this point in the history

  5. gha: add sync workflow

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    955598d View commit details
    Browse the repository at this point in the history

  6. Dockerfile.ubi: use distributed-executor-backend=mp as default

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    119767e View commit details
    Browse the repository at this point in the history

  7. Dockerfile.ubi: remove vllm-nccl workaround 

    Fixed upstream in vllm-project#5091
    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    a82fb14 View commit details
    Browse the repository at this point in the history

  8. Dockerfile.ubi: add missing requirements-*.txt bind mounts

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    cc5d64a View commit details
    Browse the repository at this point in the history

  9. add triton CustomCacheManger 

    fixes RHOAIENG-8043

Co-authored-by: Chih-Chieh-Yang <[email protected]>
Signed-off-by: Thomas Parnell <[email protected]>
    @tdoublep @cyang49 @dtrifiro
    2 people authored and dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    f9f3bc7 View commit details
    Browse the repository at this point in the history

  10. gha: sync-with-upstream workflow create PRs as draft

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    40ae5b9 View commit details
    Browse the repository at this point in the history

  11. add smoke/unit tests scripts

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5c44d84 View commit details
    Browse the repository at this point in the history

  12. extras: exit unit tests on err

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    f722b3e View commit details
    Browse the repository at this point in the history

  13. Dockerfile.ubi: misc improvements 

    - get rid cuda-devel stage, use cuda 12.4
- add build flags
- remove useless installs
    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5b66f1e View commit details
    Browse the repository at this point in the history

  14. update OWNERS

    @dtrifiro
    dtrifiro committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    8720c92 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Dockerfile.ubi: use tensorizer (opendatahub-io#64) 

    add libsodium for tensorizer encryption

---------

Signed-off-by: Prashant Gupta <[email protected]>
Co-authored-by: Daniele <[email protected]>
    @prashantgupta24 @dtrifiro
    prashantgupta24 and dtrifiro authored Jun 25, 2024
    Configuration menu
    Copy the full SHA
    1a26fcf View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Dockerfile.ubi: pin vllm-tgis-adapter to 0.1.2

    @dtrifiro
    dtrifiro committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    1f39759 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. gha: fix fetch step in upstream sync workflow

    @dtrifiro
    dtrifiro committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    e96dd03 View commit details
    Browse the repository at this point in the history

  2. gha: always update sync workflow PR body/title

    @dtrifiro
    dtrifiro committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b4ecf73 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Dockerfile.ubi: bump vllm-tgis-adapter to 0.1.3

    @dtrifiro
    dtrifiro committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3ff733b View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Merge pull request opendatahub-io#65 from vllm-project/main 

    Sync with [email protected]
    @openshift-merge-bot
    openshift-merge-bot[bot] authored Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c624c10 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Relax the torch version dependency 

    The PyTorch project has released the patch version 2.3.1 with a number
of fixes. This change relaxes the version in the requirements files for
build and CUDA, in order to allow picking fixes, while not bumping to
the next minor version.

Signed-off-by: Fabien Dupont <[email protected]>
    @fabiendupont
    fabiendupont committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    4e9fcad View commit details
    Browse the repository at this point in the history