Mistral 7B with vLLM, Ray Serve on Trn/Inf

[askulkarni2]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

A pattern that demonstrates running the Mistral 7B model with the cheapest Neuron instances.

Describe the solution you would like

Similar to the llama3-8B-Instruct pattern but for Mistral instead