adding support for cross region models

[rsgrewal-aws]

This PR is rebased from the approved PR #187

this includes the fixes and is re-based to the main branch

[rsgrewal-aws]

@3coins could you please review this PR -- this PR has been taken from #187 which has been approved and rebased to the main branch. we have a few customers asking for this

[3coins]

@rsgrewal-aws
#242 takes care of the cross-region inference ids without hard-coding the region prefixes as recommended by the Bedrock team. I am doing some validation integration checks on that PR, will be releasing this within a day or two.

[rsgrewal-aws]

@3coins why do we need the provider values and why do we need to parse the model id ? can we simply use the model id as is ?

[3coins]

@rsgrewal-aws
We use the model-id as is, but need the provider to determine the value to add for the disable_streaming attribute.

[rsgrewal-aws]

agreed but we try to parse the model id to get the streaming value -- for converse api we have to assume streaming is supported and for ChatBedrock we can have model_args being passed in -- one of the keys in this can be provider, second can be streaming . this will avoid any future issues of model id/arn etc

[3coins]

@rsgrewal-aws

for converse api we have to assume streaming is supported

As per the documentation, only Anthropic and Cohere support streaming with tools at the moment.
https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference-supported-models-features.html

one of the keys in this can be provider, second can be streaming

What do you mean by this?