Bedrock cachePoint #3168
Unanswered
jarrodlugo
asked this question in
Q&A
Replies: 2 comments
-
My guess is that because prompt caching is still in preview mode, it's not available via SDKs yet. I've reached out to the Bedrock team to confirm. Have you signed up to participate in the preview? |
Beta Was this translation helpful? Give feedback.
0 replies
-
Thanks Debora! I just submitted a request to be added to the preview. But yeah - we'd still need a way to set that flag on certain ContentBlocks/etc via the Java SDK. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How can I set a
cachePoint
via the Bedrock API? I don't see it as an option onContentBlock
in 2.29.34 of the Java SDK, and I cannot find another way to set it when sending aMessage
.RE: https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions