Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

whisper : add batched decoding #1486

Merged
merged 14 commits into from
Nov 15, 2023
Merged

whisper : add batched decoding #1486

merged 14 commits into from
Nov 15, 2023

Commits on Nov 14, 2023

  1. whisper : add whisper_batch

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    3cbaaed View commit details
    Browse the repository at this point in the history

  2. whisper : move kv_self to whisper_state

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    8b943f9 View commit details
    Browse the repository at this point in the history

  3. whisper : full batched decoding support

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    91096da View commit details
    Browse the repository at this point in the history

  4. whisper : fix memory leak in whisper_batch

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    3d24e35 View commit details
    Browse the repository at this point in the history

  5. whisper : fix mem leak again + remove oboslete function

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    b2123cb View commit details
    Browse the repository at this point in the history

  6. whisper : clear kv cache when using whisper_decode API

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    d776035 View commit details
    Browse the repository at this point in the history

  7. whisper : speed-up sampling

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    9006946 View commit details
    Browse the repository at this point in the history

  8. whisper : fix decoders initializer

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    3ed9af3 View commit details
    Browse the repository at this point in the history

  9. bench : add batch size 5 bench

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    ae1bd69 View commit details
    Browse the repository at this point in the history

  10. whisper : add comment about the KV cache size

    @ggerganov
    ggerganov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    6c8a003 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. whisper : add check for max number of decoders

    @ggerganov
    ggerganov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    820f458 View commit details
    Browse the repository at this point in the history

  2. whisper : avoid starting sampling threads with bs=1

    @ggerganov
    ggerganov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    4c245ea View commit details
    Browse the repository at this point in the history

  3. whisper : enable beam-search by default

    @ggerganov
    ggerganov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    b7c82a3 View commit details
    Browse the repository at this point in the history

  4. cuda : sync llama.cpp fixes

    @ggerganov
    ggerganov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    270b1e4 View commit details
    Browse the repository at this point in the history