aws-bedrock-app

Sample AWS Bedrock Application

Getting started

Note: This application requires the use of Node.js v20+.

1. Clone or fork this repository.

2. Install dependencies and run application

npm ci
cp .env.sample .env
# Fill out `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` and `NEW_RELIC_LICENSE_KEY` in .env and save 
npm start

1. Make requests to application.

# make a request to chat completions - provide a model to use or the default amazon-titan model will be used
# model options are: amazon-titan, anthropic, ai21, cohere, llama2, and llama3
curl -XPOST -H 'Content-Type: application/json' http://localhost:3000/chat-completion -d '{"message":"How much wood could a woodchuck chuck if a woodchuck could chuck wood?", "model": "amazon-titan"}'

# model options are: amazon-titan, anthropic, cohere - default model is amazon-titan
curl -XPOST -H 'Content-Type: application/json' http://localhost:3000/chat-completion-stream -d '{"message":"Explain the rules of jai alai"}'

# To leave feedback copy the id from response of a chat completion
curl -XPOST -H 'Content-Type: application/json' http://localhost:3000/feedback -d '{"id":"<response_id>"}'

# model options are: amazon-titan-embed, cohere-embed
curl -XPOST -H 'Content-type: application/json' http://localhost:3000/embedding -d '{"message":"Test embedding", "model": "amazon-titan-embed"}'