Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MultimodalQnA Image and Audio Support Phase 1 #1071

Open
wants to merge 52 commits into
base: main
Choose a base branch
from

Commits on Oct 14, 2024

  1. Initial implementation of image ingestion

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    97f4bc0 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Added ability to change LVM Model (#1)

    * added entrypoint override
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * fixed entrypoint container
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * removed workdir
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * reverted set env vars changes
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * added entrypoint for embedding model
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * added llava model to readme
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * removed stray \n
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * added entrypoint override in bridgetower hpu
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    ---------
    
    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    08956e5 View commit details
    Browse the repository at this point in the history
  2. Use same endpoint for image and video ingestion

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    56bd8c3 View commit details
    Browse the repository at this point in the history
  3. Update tests and docs

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b334dc2 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Configuration menu
    Copy the full SHA
    13c752a View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Renamed Dataprep Endpoints videos --> files (#3)

    * changed variable names
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * changed gaudi env vars
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * changed vars + docs
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * verified + updated readme
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * updated readme
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    * updated tests
    
    Signed-off-by: okhleif-IL <[email protected]>
    
    ---------
    
    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    5f4cf29 View commit details
    Browse the repository at this point in the history
  2. added LVM_MODEL_ID var to test file (#4)

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    271117e View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Updates tests per feedback

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    c4e0259 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #2 from mhbuehler/melanie/combined_image_video_ing…

    …estion
    
    Image ingestion improvements
    mhbuehler authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    a541140 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    30c311d View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Update LVM model for Xeon

    Signed-off-by: dmsuehir <[email protected]>
    dmsuehir committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    e83fc44 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #5 from mhbuehler/dina/lvm_model

    Update LVM model for Xeon
    mhbuehler authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    4b8a5ad View commit details
    Browse the repository at this point in the history
  3. Initial setup for ingest_with_text

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    a6d826c View commit details
    Browse the repository at this point in the history
  4. Write and send custom caption file

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    547a139 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Update docs and tests

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    7cfc343 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. MMQnA doc updates for audio ingestion (#7)

    Signed-off-by: dmsuehir <[email protected]>
    dmsuehir authored Oct 29, 2024
    Configuration menu
    Copy the full SHA
    69dbdfc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    834c668 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Fix UI request for follow up queries with no image (#8)

    Signed-off-by: dmsuehir <[email protected]>
    dmsuehir authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a8f8dc9 View commit details
    Browse the repository at this point in the history
  2. Updated for review suggestions

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    718d02e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d05cfb3 View commit details
    Browse the repository at this point in the history
  4. Add audio upload functionality to UI

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    72591c1 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #6 from mhbuehler/melanie/images_and_text

    Image+Text Upload
    mhbuehler authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    431e41b View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Configuration menu
    Copy the full SHA
    d535aa7 View commit details
    Browse the repository at this point in the history
  2. Minor refactor, improve display text, and suppress PDF tab

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    39f43fc View commit details
    Browse the repository at this point in the history
  3. Merge pull request #9 from mhbuehler/melanie/audio_ingest_ui

    UI Audio Upload
    mhbuehler authored Oct 31, 2024
    Configuration menu
    Copy the full SHA
    afc3c8a View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Small fixes

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    ddd5dfb View commit details
    Browse the repository at this point in the history
  2. Improve appearance

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    426c739 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Improve upload errors and revert multimodal query box

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    cfa1c8c View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Small text edit as suggested

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    cdec83f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    48baceb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    170b723 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Configuration menu
    Copy the full SHA
    3a23e5b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    65a8afd View commit details
    Browse the repository at this point in the history
  3. updated readmes with MMQA info

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    f95b946 View commit details
    Browse the repository at this point in the history
  4. removed stray char

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c4d5138 View commit details
    Browse the repository at this point in the history
  5. Fixed header

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    a1350c5 View commit details
    Browse the repository at this point in the history
  6. addressed review comments

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c7aadd2 View commit details
    Browse the repository at this point in the history
  7. removed video

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    7288faa View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Configuration menu
    Copy the full SHA
    e108ee9 View commit details
    Browse the repository at this point in the history
  2. Reorder new lvm-dependent tests and fix clear textbox

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    9fdd6fe View commit details
    Browse the repository at this point in the history
  3. Merge pull request #13 from mhbuehler/omar/mmqa-docs

    Updated main README and supported_examples with MMQA details
    mhbuehler authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    ee387a2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    aafcfe1 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #14 from mhbuehler/melanie/fix_tests

    Fix for lvm-dependent tests and clear textbox
    mhbuehler authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    359b6f8 View commit details
    Browse the repository at this point in the history
  6. fixed multimodalqna typos

    Signed-off-by: okhleif-IL <[email protected]>
    okhleif-IL committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    9d3ed45 View commit details
    Browse the repository at this point in the history
  7. Point git clone at specific branch of GenAIComps

    Signed-off-by: Melanie Buehler <[email protected]>
    mhbuehler committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    54cff40 View commit details
    Browse the repository at this point in the history
  8. Merge pull request #15 from mhbuehler/omar/dockimg_doc

    Fixed typos for MMQA in Docker Image List doc
    mhbuehler authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    fd9fd84 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    d88513a View commit details
    Browse the repository at this point in the history
  10. Merge pull request #16 from mhbuehler/melanie/clone_specific_branch

    Clone specific branch of GenAIComps for tests
    mhbuehler authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    24438e5 View commit details
    Browse the repository at this point in the history
  11. Fix xeon test to use llava-hf/llava-1.5-7b-hf (#17)

    Signed-off-by: dmsuehir <[email protected]>
    dmsuehir authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    df2511b View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Configuration menu
    Copy the full SHA
    6631601 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    59acc77 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9d4cb5f View commit details
    Browse the repository at this point in the history