Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Add Russian models #21

Merged
merged 14 commits into from
Aug 6, 2024

Commits on Jul 28, 2024

  1. add russian leaderboard

    Samoed committed Jul 28, 2024
    Configuration menu
    Copy the full SHA
    804b114 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'refs/heads/main' into add_rusian_models

    # Conflicts:
    #	all_data_tasks/0/default.jsonl
    #	all_data_tasks/1/default.jsonl
    #	all_data_tasks/2/default.jsonl
    #	all_data_tasks/3/default.jsonl
    #	all_data_tasks/4/default.jsonl
    #	all_data_tasks/5/default.jsonl
    #	refresh.py
    Samoed committed Jul 28, 2024
    Configuration menu
    Copy the full SHA
    ed38465 View commit details
    Browse the repository at this point in the history
  3. fix french datasets

    Samoed committed Jul 28, 2024
    Configuration menu
    Copy the full SHA
    006466a View commit details
    Browse the repository at this point in the history
  4. change to hf config

    Samoed committed Jul 28, 2024
    Configuration menu
    Copy the full SHA
    162510c View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. update all data

    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    b23830c View commit details
    Browse the repository at this point in the history
  2. fix bge-m3 model size

    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    27a30e1 View commit details
    Browse the repository at this point in the history
  3. Update conf

    Muennighoff committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    735975d View commit details
    Browse the repository at this point in the history
  4. Merge branch 'refs/heads/main' into add_rusian_models

    # Conflicts:
    #	all_data_tasks/0/default.jsonl
    #	all_data_tasks/1/default.jsonl
    #	all_data_tasks/10/default.jsonl
    #	all_data_tasks/11/default.jsonl
    #	all_data_tasks/12/default.jsonl
    #	all_data_tasks/13/default.jsonl
    #	all_data_tasks/14/default.jsonl
    #	all_data_tasks/15/default.jsonl
    #	all_data_tasks/16/default.jsonl
    #	all_data_tasks/17/default.jsonl
    #	all_data_tasks/18/default.jsonl
    #	all_data_tasks/19/default.jsonl
    #	all_data_tasks/2/default.jsonl
    #	all_data_tasks/20/default.jsonl
    #	all_data_tasks/21/default.jsonl
    #	all_data_tasks/22/default.jsonl
    #	all_data_tasks/23/default.jsonl
    #	all_data_tasks/25/default.jsonl
    #	all_data_tasks/27/default.jsonl
    #	all_data_tasks/28/default.jsonl
    #	all_data_tasks/29/default.jsonl
    #	all_data_tasks/3/default.jsonl
    #	all_data_tasks/30/default.jsonl
    #	all_data_tasks/31/default.jsonl
    #	all_data_tasks/32/default.jsonl
    #	all_data_tasks/33/default.jsonl
    #	all_data_tasks/34/default.jsonl
    #	all_data_tasks/35/default.jsonl
    #	all_data_tasks/36/default.jsonl
    #	all_data_tasks/4/default.jsonl
    #	all_data_tasks/5/default.jsonl
    #	all_data_tasks/6/default.jsonl
    #	all_data_tasks/7/default.jsonl
    #	all_data_tasks/8/default.jsonl
    #	all_data_tasks/9/default.jsonl
    #	boards_data/bright/data_tasks/Retrieval/default.jsonl
    #	boards_data/da/data_tasks/BitextMining/default.jsonl
    #	boards_data/da/data_tasks/Classification/default.jsonl
    #	boards_data/de/data_tasks/Clustering/default.jsonl
    #	boards_data/en-x/data_tasks/BitextMining/default.jsonl
    #	boards_data/en/data_overall/default.jsonl
    #	boards_data/en/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_tasks/Clustering/default.jsonl
    #	boards_data/en/data_tasks/PairClassification/default.jsonl
    #	boards_data/en/data_tasks/Reranking/default.jsonl
    #	boards_data/en/data_tasks/Retrieval/default.jsonl
    #	boards_data/en/data_tasks/STS/default.jsonl
    #	boards_data/en/data_tasks/Summarization/default.jsonl
    #	boards_data/fr/data_overall/default.jsonl
    #	boards_data/fr/data_tasks/Classification/default.jsonl
    #	boards_data/fr/data_tasks/Clustering/default.jsonl
    #	boards_data/fr/data_tasks/PairClassification/default.jsonl
    #	boards_data/fr/data_tasks/Reranking/default.jsonl
    #	boards_data/fr/data_tasks/Retrieval/default.jsonl
    #	boards_data/fr/data_tasks/STS/default.jsonl
    #	boards_data/fr/data_tasks/Summarization/default.jsonl
    #	boards_data/instructions/data_tasks/InstructionRetrieval/default.jsonl
    #	boards_data/law/data_tasks/Retrieval/default.jsonl
    #	boards_data/longembed/data_tasks/Retrieval/default.jsonl
    #	boards_data/no/data_tasks/Classification/default.jsonl
    #	boards_data/other-cls/data_tasks/Classification/default.jsonl
    #	boards_data/other-sts/data_tasks/STS/default.jsonl
    #	boards_data/pl/data_overall/default.jsonl
    #	boards_data/pl/data_tasks/Classification/default.jsonl
    #	boards_data/pl/data_tasks/Clustering/default.jsonl
    #	boards_data/pl/data_tasks/PairClassification/default.jsonl
    #	boards_data/pl/data_tasks/Retrieval/default.jsonl
    #	boards_data/pl/data_tasks/STS/default.jsonl
    #	boards_data/rar-b/data_tasks/Retrieval/default.jsonl
    #	boards_data/se/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_overall/default.jsonl
    #	boards_data/zh/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_tasks/Clustering/default.jsonl
    #	boards_data/zh/data_tasks/PairClassification/default.jsonl
    #	boards_data/zh/data_tasks/Reranking/default.jsonl
    #	boards_data/zh/data_tasks/Retrieval/default.jsonl
    #	boards_data/zh/data_tasks/STS/default.jsonl
    #	model_meta.yaml
    #	refresh.py
    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    3ad26be View commit details
    Browse the repository at this point in the history
  5. fix model config names

    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    e6b79bf View commit details
    Browse the repository at this point in the history
  6. Merge branch 'refs/heads/main' into add_rusian_models

    # Conflicts:
    #	all_data_tasks/0/default.jsonl
    #	all_data_tasks/1/default.jsonl
    #	all_data_tasks/10/default.jsonl
    #	all_data_tasks/11/default.jsonl
    #	all_data_tasks/12/default.jsonl
    #	all_data_tasks/13/default.jsonl
    #	all_data_tasks/16/default.jsonl
    #	all_data_tasks/17/default.jsonl
    #	all_data_tasks/18/default.jsonl
    #	all_data_tasks/19/default.jsonl
    #	all_data_tasks/2/default.jsonl
    #	all_data_tasks/20/default.jsonl
    #	all_data_tasks/21/default.jsonl
    #	all_data_tasks/22/default.jsonl
    #	all_data_tasks/28/default.jsonl
    #	all_data_tasks/29/default.jsonl
    #	all_data_tasks/3/default.jsonl
    #	all_data_tasks/30/default.jsonl
    #	all_data_tasks/31/default.jsonl
    #	all_data_tasks/32/default.jsonl
    #	all_data_tasks/34/default.jsonl
    #	all_data_tasks/35/default.jsonl
    #	all_data_tasks/4/default.jsonl
    #	all_data_tasks/5/default.jsonl
    #	all_data_tasks/6/default.jsonl
    #	all_data_tasks/8/default.jsonl
    #	all_data_tasks/9/default.jsonl
    #	boards_data/en/data_overall/default.jsonl
    #	boards_data/en/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_tasks/Clustering/default.jsonl
    #	boards_data/en/data_tasks/PairClassification/default.jsonl
    #	boards_data/en/data_tasks/Reranking/default.jsonl
    #	boards_data/en/data_tasks/Retrieval/default.jsonl
    #	boards_data/en/data_tasks/STS/default.jsonl
    #	boards_data/en/data_tasks/Summarization/default.jsonl
    #	boards_data/fr/data_overall/default.jsonl
    #	boards_data/fr/data_tasks/Classification/default.jsonl
    #	boards_data/fr/data_tasks/Clustering/default.jsonl
    #	boards_data/fr/data_tasks/PairClassification/default.jsonl
    #	boards_data/fr/data_tasks/Reranking/default.jsonl
    #	boards_data/fr/data_tasks/Retrieval/default.jsonl
    #	boards_data/fr/data_tasks/STS/default.jsonl
    #	boards_data/fr/data_tasks/Summarization/default.jsonl
    #	boards_data/other-cls/data_tasks/Classification/default.jsonl
    #	boards_data/other-sts/data_tasks/STS/default.jsonl
    #	boards_data/pl/data_overall/default.jsonl
    #	boards_data/pl/data_tasks/Classification/default.jsonl
    #	boards_data/pl/data_tasks/Clustering/default.jsonl
    #	boards_data/pl/data_tasks/PairClassification/default.jsonl
    #	boards_data/pl/data_tasks/Retrieval/default.jsonl
    #	boards_data/pl/data_tasks/STS/default.jsonl
    #	boards_data/zh/data_overall/default.jsonl
    #	boards_data/zh/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_tasks/Clustering/default.jsonl
    #	boards_data/zh/data_tasks/PairClassification/default.jsonl
    #	boards_data/zh/data_tasks/Reranking/default.jsonl
    #	boards_data/zh/data_tasks/Retrieval/default.jsonl
    #	boards_data/zh/data_tasks/STS/default.jsonl
    #	model_meta.yaml
    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    444a0b2 View commit details
    Browse the repository at this point in the history
  7. Merge branch 'refs/heads/main' into add_rusian_models

    # Conflicts:
    #	EXTERNAL_MODEL_RESULTS.json
    #	all_data_tasks/0/default.jsonl
    #	all_data_tasks/1/default.jsonl
    #	all_data_tasks/10/default.jsonl
    #	all_data_tasks/11/default.jsonl
    #	all_data_tasks/12/default.jsonl
    #	all_data_tasks/13/default.jsonl
    #	all_data_tasks/14/default.jsonl
    #	all_data_tasks/15/default.jsonl
    #	all_data_tasks/16/default.jsonl
    #	all_data_tasks/17/default.jsonl
    #	all_data_tasks/18/default.jsonl
    #	all_data_tasks/19/default.jsonl
    #	all_data_tasks/2/default.jsonl
    #	all_data_tasks/20/default.jsonl
    #	all_data_tasks/21/default.jsonl
    #	all_data_tasks/22/default.jsonl
    #	all_data_tasks/23/default.jsonl
    #	all_data_tasks/25/default.jsonl
    #	all_data_tasks/26/default.jsonl
    #	all_data_tasks/28/default.jsonl
    #	all_data_tasks/29/default.jsonl
    #	all_data_tasks/3/default.jsonl
    #	all_data_tasks/30/default.jsonl
    #	all_data_tasks/31/default.jsonl
    #	all_data_tasks/32/default.jsonl
    #	all_data_tasks/33/default.jsonl
    #	all_data_tasks/35/default.jsonl
    #	all_data_tasks/36/default.jsonl
    #	all_data_tasks/4/default.jsonl
    #	all_data_tasks/5/default.jsonl
    #	all_data_tasks/6/default.jsonl
    #	all_data_tasks/8/default.jsonl
    #	all_data_tasks/9/default.jsonl
    #	boards_data/da/data_tasks/BitextMining/default.jsonl
    #	boards_data/da/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_overall/default.jsonl
    #	boards_data/en/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_tasks/Clustering/default.jsonl
    #	boards_data/en/data_tasks/PairClassification/default.jsonl
    #	boards_data/en/data_tasks/Reranking/default.jsonl
    #	boards_data/en/data_tasks/Retrieval/default.jsonl
    #	boards_data/en/data_tasks/STS/default.jsonl
    #	boards_data/en/data_tasks/Summarization/default.jsonl
    #	boards_data/fr/data_overall/default.jsonl
    #	boards_data/fr/data_tasks/Classification/default.jsonl
    #	boards_data/fr/data_tasks/Clustering/default.jsonl
    #	boards_data/fr/data_tasks/PairClassification/default.jsonl
    #	boards_data/fr/data_tasks/Reranking/default.jsonl
    #	boards_data/fr/data_tasks/Retrieval/default.jsonl
    #	boards_data/fr/data_tasks/STS/default.jsonl
    #	boards_data/fr/data_tasks/Summarization/default.jsonl
    #	boards_data/law/data_tasks/Retrieval/default.jsonl
    #	boards_data/longembed/data_tasks/Retrieval/default.jsonl
    #	boards_data/no/data_tasks/Classification/default.jsonl
    #	boards_data/other-sts/data_tasks/STS/default.jsonl
    #	boards_data/pl/data_overall/default.jsonl
    #	boards_data/pl/data_tasks/Classification/default.jsonl
    #	boards_data/pl/data_tasks/Clustering/default.jsonl
    #	boards_data/pl/data_tasks/PairClassification/default.jsonl
    #	boards_data/pl/data_tasks/Retrieval/default.jsonl
    #	boards_data/pl/data_tasks/STS/default.jsonl
    #	boards_data/rar-b/data_tasks/Retrieval/default.jsonl
    #	boards_data/se/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_overall/default.jsonl
    #	boards_data/zh/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_tasks/Clustering/default.jsonl
    #	boards_data/zh/data_tasks/PairClassification/default.jsonl
    #	boards_data/zh/data_tasks/Reranking/default.jsonl
    #	boards_data/zh/data_tasks/Retrieval/default.jsonl
    #	boards_data/zh/data_tasks/STS/default.jsonl
    Samoed committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    a2ea8e1 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Merge branch 'refs/heads/main' into add_rusian_models

    # Conflicts:
    #	EXTERNAL_MODEL_RESULTS.json
    #	all_data_tasks/0/default.jsonl
    #	all_data_tasks/1/default.jsonl
    #	all_data_tasks/10/default.jsonl
    #	all_data_tasks/11/default.jsonl
    #	all_data_tasks/12/default.jsonl
    #	all_data_tasks/13/default.jsonl
    #	all_data_tasks/15/default.jsonl
    #	all_data_tasks/16/default.jsonl
    #	all_data_tasks/17/default.jsonl
    #	all_data_tasks/18/default.jsonl
    #	all_data_tasks/19/default.jsonl
    #	all_data_tasks/2/default.jsonl
    #	all_data_tasks/20/default.jsonl
    #	all_data_tasks/21/default.jsonl
    #	all_data_tasks/22/default.jsonl
    #	all_data_tasks/23/default.jsonl
    #	all_data_tasks/28/default.jsonl
    #	all_data_tasks/29/default.jsonl
    #	all_data_tasks/3/default.jsonl
    #	all_data_tasks/30/default.jsonl
    #	all_data_tasks/31/default.jsonl
    #	all_data_tasks/32/default.jsonl
    #	all_data_tasks/33/default.jsonl
    #	all_data_tasks/34/default.jsonl
    #	all_data_tasks/35/default.jsonl
    #	all_data_tasks/36/default.jsonl
    #	all_data_tasks/4/default.jsonl
    #	all_data_tasks/5/default.jsonl
    #	all_data_tasks/6/default.jsonl
    #	all_data_tasks/8/default.jsonl
    #	all_data_tasks/9/default.jsonl
    #	boards_data/da/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_overall/default.jsonl
    #	boards_data/en/data_tasks/Classification/default.jsonl
    #	boards_data/en/data_tasks/Clustering/default.jsonl
    #	boards_data/en/data_tasks/PairClassification/default.jsonl
    #	boards_data/en/data_tasks/Reranking/default.jsonl
    #	boards_data/en/data_tasks/Retrieval/default.jsonl
    #	boards_data/en/data_tasks/STS/default.jsonl
    #	boards_data/en/data_tasks/Summarization/default.jsonl
    #	boards_data/fr/data_overall/default.jsonl
    #	boards_data/fr/data_tasks/Classification/default.jsonl
    #	boards_data/fr/data_tasks/Clustering/default.jsonl
    #	boards_data/fr/data_tasks/PairClassification/default.jsonl
    #	boards_data/fr/data_tasks/Reranking/default.jsonl
    #	boards_data/fr/data_tasks/Retrieval/default.jsonl
    #	boards_data/fr/data_tasks/STS/default.jsonl
    #	boards_data/fr/data_tasks/Summarization/default.jsonl
    #	boards_data/no/data_tasks/Classification/default.jsonl
    #	boards_data/other-cls/data_tasks/Classification/default.jsonl
    #	boards_data/other-sts/data_tasks/STS/default.jsonl
    #	boards_data/pl/data_overall/default.jsonl
    #	boards_data/pl/data_tasks/Classification/default.jsonl
    #	boards_data/pl/data_tasks/Clustering/default.jsonl
    #	boards_data/pl/data_tasks/PairClassification/default.jsonl
    #	boards_data/pl/data_tasks/Retrieval/default.jsonl
    #	boards_data/pl/data_tasks/STS/default.jsonl
    #	boards_data/rar-b/data_tasks/Retrieval/default.jsonl
    #	boards_data/se/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_overall/default.jsonl
    #	boards_data/zh/data_tasks/Classification/default.jsonl
    #	boards_data/zh/data_tasks/Clustering/default.jsonl
    #	boards_data/zh/data_tasks/PairClassification/default.jsonl
    #	boards_data/zh/data_tasks/Reranking/default.jsonl
    #	boards_data/zh/data_tasks/Retrieval/default.jsonl
    #	boards_data/zh/data_tasks/STS/default.jsonl
    Samoed committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    384359a View commit details
    Browse the repository at this point in the history
  2. upd

    Samoed committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    e5d84b5 View commit details
    Browse the repository at this point in the history
  3. Refresh

    Muennighoff committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    fd4f5be View commit details
    Browse the repository at this point in the history