Question about promt templates

[sanitar1988]

Description

Good afternoon.

How and where (you can even have a code example, for example with llama 3.1) can I create a prompt template for LLM?

And how can I see (if possible) what the default prompt template looks like (also with a code example)?

Thank you

[martindevans]

We have the PromptTemplateTransformer which should automatically apply whatever template is embedded into the model.

If you want to see what that template looks like I think it's encoded as one of the model metadata items (I can't remember the name, but if you just print all of them it should be obvious which it is).

[asmirnov82]

You may find an example of using PromtTemplateTransformer in LLama3ChatSessions
Default template in case if PromtTemplateTransformer is not used - DefaultHistoryTransform

If you would like to see chat templates for different models without downloading them, here is a good link: https://github.com/chujiezheng/chat_templates/tree/main/chat_templates