Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add sequence probability support for PyTorch CRF model #421

Open
vrdn-23 opened this issue Jun 16, 2022 · 1 comment
Open

Add sequence probability support for PyTorch CRF model #421

vrdn-23 opened this issue Jun 16, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@vrdn-23
Copy link
Contributor

vrdn-23 commented Jun 16, 2022

For active learning, there a couple of strategies that we currently utilize using the CRF suite model's marginal probabilities. Studies have shown that returning sequence-level probabilities instead of token-level marginal probabilities works much better and this is something that can be implemented in a future release. So in order to modify this function, in addition to the best transition score (t,j) and corresponding backward link for the transition, we’ll have to store top-n transition scores and the corresponding n backward links, and then trace all n-paths, resulting in the n-best sequences and corresponding probabilities.

@vrdn-23 vrdn-23 added the enhancement New feature or request label Jun 16, 2022
@ritvikshrivastava
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants