Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BREAKING: v2.0.0 #1433

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

BREAKING: v2.0.0 #1433

wants to merge 7 commits into from

Commits on Nov 11, 2024

  1. fix: Ensure seed is based on RNG State (#1193)

    @KennethEnevoldsen
    KennethEnevoldsen authored Nov 11, 2024
    Configuration menu
    Copy the full SHA
    e2520df View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Consolidate Retrieval/Reranking/Instruction Variants (#1359) 

    * update

* merged retrieval; working

* update tasks; working multilingual

* everything working except instructions

* working instructions; just need cleanup

* add metadata for all but MindSmall

* faster evaluation; mindsmall can compute in reasonable time

* fix bad merge of docs

* lint

* fix test

* qa

* updated mindsmall

* lint

* fix debug

* Update mteb/abstasks/dataloaders.py

Co-authored-by: Roman Solomatin <[email protected]>

* lint

---------

Co-authored-by: Roman Solomatin <[email protected]>
    @orionw @Samoed
    orionw and Samoed authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    9c58518 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. fix: Unsure TaskResults can handle runtime and version being unspecified

    @KennethEnevoldsen
    KennethEnevoldsen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    2a8a370 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'v2.0.0' of https://github.com/embeddings-benchmark/mteb … 

    …into v2.0.0
    @KennethEnevoldsen
    KennethEnevoldsen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    dea2b77 View commit details
    Browse the repository at this point in the history

  3. fix: remove NaN handling for retrieval

    @KennethEnevoldsen
    KennethEnevoldsen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    23d6cb2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into v2.0.0

    @KennethEnevoldsen
    KennethEnevoldsen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    8868cd4 View commit details
    Browse the repository at this point in the history

  5. fix: Merge main into v2 (#1454) 

    * fix: Count unique texts, data leaks in calculate metrics (#1438)

* add more stat

* add more stat

* update statistics

* fix: update task metadata to allow for null (#1448)

* Update tasks table

* 1.19.5

Automatically generated by python-semantic-release

* base

* sync with main

---------

Co-authored-by: Kenneth Enevoldsen <[email protected]>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions <[email protected]>
    @Samoed @KennethEnevoldsen @github-actions
    4 people authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    5470c88 View commit details
    Browse the repository at this point in the history