Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Eval on WxBS #35

Open
ducha-aiki opened this issue Oct 31, 2023 · 3 comments · May be fixed by #52
Open

Eval on WxBS #35

ducha-aiki opened this issue Oct 31, 2023 · 3 comments · May be fixed by #52

Comments

@ducha-aiki
Copy link

Hi,

Would you be interested in PR, adding the evaluation on WxBS?

https://github.com/ducha-aiki/wxbs-benchmark
F9cZN2qX0AAj_LA

And if yes - do you need it to be self-contained, or I just add wxbs-benchmark into requirements.txt?
@Phil26AT
Copy link
Collaborator

Hi @ducha-aiki

It would be great to have WxBS in glue-factory! I would prefer a self-contained port. I suggest adding the WxBS datasets to gluefactory/datasets, and then create a new eval pipeline. I am happy to help on the integration.

@ducha-aiki
Copy link
Author

Sounds good, I'll proceed with it

@ducha-aiki ducha-aiki linked a pull request Jan 4, 2024 that will close this issue
Open
@ducha-aiki
Copy link
Author

@Phil26AT PR is ready :) #52

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Adds evaluation on challenging WxBS and EVD datasets ducha-aiki/glue-factory
2 participants
@ducha-aiki @Phil26AT