New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TF Deploy LLM model on SageMaker #4

Open

4 tasks

wesdottoday opened this issue Sep 26, 2023 · 0 comments

Assignees

Labels

documentation enhancement

Contributor

wesdottoday commented Sep 26, 2023

TF takes the LLM model from S3 and makes it available as an endpoint in SageMaker
TF takes the instance type variable and uses that to decide what instance to deploy (default types?)
Set the endpoint URI to a variable in TF
Documentation of the URI and how to use it

Terraform should take the user's input and deploy the LLM model of choice to SageMaker.

wesdottoday added documentation enhancement labels

wesdottoday self-assigned this

wesdottoday mentioned this issue

TF Deploy FastAPI service on AppRunner #6

Open

6 tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment