Consider implementing advanced prompting techniques #502
rlouf
started this conversation in
Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This gist provides ideas and implementations of several advanced prompting techniques:
This would require substantial work, starting with a prompting DSL that allows users to give advanced prompting instructions. Everything else can otherwise be implemented by modifying the input prompts, attentions, or embeddings before the forward pass through the model. Probably by passing functions that pre-process these tensors to the
sequence_generator
.Beta Was this translation helpful? Give feedback.
All reactions