Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added ROUGE-L metric for evaluation #500

Open
wants to merge 43 commits into
base: main
Choose a base branch
from
Open

Added ROUGE-L metric for evaluation #500

wants to merge 43 commits into from

Commits on Apr 30, 2023

  1. Added ROUGE-L evaluation. 

    Added ROUGE-L evaluation.
    @YourSaDady
    YourSaDady authored Apr 30, 2023
    Configuration menu
    Copy the full SHA
    290be18 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. Evaluation with ROUGE-L 

    A script similar to run_evaluation_with_lora.sh
    @YourSaDady
    YourSaDady authored May 4, 2023
    Configuration menu
    Copy the full SHA
    56ae992 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. typo fixed 

    .
    @YourSaDady
    YourSaDady authored May 10, 2023
    Configuration menu
    Copy the full SHA
    2aa8e02 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. Appended choices lists with ROUGE-L funtions 

    changed line 473, added choices of "rl", "rouge-l", and "ROUGE-L" to apply the ROUGE-L metric.
    @YourSaDady
    YourSaDady authored May 11, 2023
    Configuration menu
    Copy the full SHA
    3e321b2 View commit details
    Browse the repository at this point in the history

  2. changed the model_path and deleted lora_model_path 

    model: from facebook/galactica-1.3b to gpt2_large
    @YourSaDady
    YourSaDady authored May 11, 2023
    Configuration menu
    Copy the full SHA
    61b38a5 View commit details
    Browse the repository at this point in the history

  3. imported deepspeed 

    .
    @YourSaDady
    YourSaDady authored May 11, 2023
    Configuration menu
    Copy the full SHA
    6bc78ca View commit details
    Browse the repository at this point in the history

  4. typo fixed 

    ...
    @YourSaDady
    YourSaDady authored May 11, 2023
    Configuration menu
    Copy the full SHA
    3a5c0fc View commit details
    Browse the repository at this point in the history

  5. Add files via upload

    @YourSaDady
    YourSaDady authored May 11, 2023
    Configuration menu
    Copy the full SHA
    c88e18f View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2023

  1. Simplify the evaluator.py 

    Combine similar accuracy and ROUGE-L metrics into one metric
    @YourSaDady
    YourSaDady authored Jun 4, 2023
    Configuration menu
    Copy the full SHA
    ee17f1a View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. for testing

    @YourSaDady
    YourSaDady authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    5971fa7 View commit details
    Browse the repository at this point in the history

  2. the original evaluator file before June 4th

    @YourSaDady
    YourSaDady authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    1ab1afe View commit details
    Browse the repository at this point in the history

  3. the original version before June 4th

    @YourSaDady
    YourSaDady authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    64c3acf View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Newest version of the team

    @YourSaDady
    YourSaDady authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    dcac238 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Update args.py

    @YourSaDady
    YourSaDady authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    bdcc9f8 View commit details
    Browse the repository at this point in the history

  2. Update run_evaluation_with_rougel.sh

    @YourSaDady
    YourSaDady authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    5b6fb41 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. a test case for ROUGE-L metric in evaluation

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    545c808 View commit details
    Browse the repository at this point in the history

  2. test case for ROUGE-L

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    72500db View commit details
    Browse the repository at this point in the history

  3. update

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    5851f47 View commit details
    Browse the repository at this point in the history

  4. test ROUGE-L metric

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    9c5fd69 View commit details
    Browse the repository at this point in the history

  5. Added the function of evaluate.py

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    4861bcc View commit details
    Browse the repository at this point in the history

  6. updated

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f0304f5 View commit details
    Browse the repository at this point in the history

  7. Add files via upload

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    7fc95e7 View commit details
    Browse the repository at this point in the history

  8. import evaluate, not AutoPipeline

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    dd5005e View commit details
    Browse the repository at this point in the history

  9. import Test_rougel

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    621059a View commit details
    Browse the repository at this point in the history

  10. Add files via upload

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f74cb75 View commit details
    Browse the repository at this point in the history

  11. import Test_rougel

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    b1a615d View commit details
    Browse the repository at this point in the history

  12. Add inference_batch_size_per_device

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    19fd37e View commit details
    Browse the repository at this point in the history

  13. test for the validity of ROUGE-L metric

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    ff58720 View commit details
    Browse the repository at this point in the history

  14. split test.py and test_rougel.py

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f46e99b View commit details
    Browse the repository at this point in the history

  15. deleted the part of test.py

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    c3f09e6 View commit details
    Browse the repository at this point in the history

  16. Added inference_batch_size_per_device

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    782ebcf View commit details
    Browse the repository at this point in the history

  17. copied the function of Auto_pipeline inside

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    91e61cf View commit details
    Browse the repository at this point in the history

  18. Update test.py

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    4c51c35 View commit details
    Browse the repository at this point in the history

  19. tiny updates

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    73c1d2a View commit details
    Browse the repository at this point in the history

  20. fix issues of JSON dataset format

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    ddc294d View commit details
    Browse the repository at this point in the history

  21. fix the Pool issue

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f088ab6 View commit details
    Browse the repository at this point in the history

  22. fix Pool issue

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    b6f703f View commit details
    Browse the repository at this point in the history

  23. fix weird precision error in comparison of scores

    @YourSaDady
    YourSaDady authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    70cb3c6 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. similar to evaluate.py

    @YourSaDady
    YourSaDady authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    0a29167 View commit details
    Browse the repository at this point in the history

  2. Similar to evaluator.py

    @YourSaDady
    YourSaDady authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    727c82d View commit details
    Browse the repository at this point in the history

  3. Update test.py 

    Similar to evaluate.py
    @YourSaDady
    YourSaDady authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    48a392b View commit details
    Browse the repository at this point in the history

  4. Update test_rougel.py

    @YourSaDady
    YourSaDady authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    eefad15 View commit details
    Browse the repository at this point in the history

  5. Update rougel_test_case.sh

    @YourSaDady
    YourSaDady authored Jun 18, 2023
    Configuration menu
    Copy the full SHA
    b5abd56 View commit details
    Browse the repository at this point in the history