Sidecar S3: in-bucket path

[CherrySuryp]

Hi Thanos community!

I'm planning to setup about 10 prometheus instances for different clients. For each instance I want to setup sidecar to backup metrics to MinIO S3.
During configuration I've notices that there's no option to setup in-bucket path, for example: bucket/custom-path/.
Can it be configured in S3 configuration, or there's no such option? I just don't want to create new bucket for each new client, instead I wanted to configure it like bucket/client-1, bucket/client-2, etc.

My current configuration

type: s3
config:
  bucket:     prometheus
  endpoint:   s3.example.com
  access_key: ""
  secret_key: ""

I tried add custom path like this, but it returned an error:

type: s3
config:
  bucket:     prometheus/client-1
  endpoint:   s3.example.com
  access_key: ""
  secret_key: ""

[dosubot[bot]]

Hey @CherrySuryp! I'm here to help you out with any issues or questions you have. Let's tackle this together!

You can configure an in-bucket path for MinIO S3 in Thanos sidecar by using the prefix field in the S3 configuration. This allows you to separate blocks coming from different sources into paths with different prefixes within the same bucket.

Here is an example configuration:

type: S3
config:
  bucket: "prometheus"
  endpoint: "s3.example.com"
  access_key: ""
  secret_key: ""
  prefix: "client-1"

This configuration will store the data under the prometheus/client-1 path within the specified bucket ^[1].

Additionally, there is no need for any extra configuration on the MinIO side to support the prefix field ^[1].

To continue talking to Dosu, mention @dosu.

[CherrySuryp]

This is correct configuration of prefix

type: S3
prefix: "client-1"
config:
  bucket: "prometheus"
  endpoint: "s3.example.com"
  access_key: ""
  secret_key: ""

[MichaHoffmann]

I think what the bot said was correct!

[CherrySuryp]

Yeah, it is working. Thank you for the lightning fast response!

[CherrySuryp]

@MichaHoffmann but actually bot's first response makes more sense, prefix should be in configuration block though🤔

[MichaHoffmann]

Yeah but it's shared between all providers. I don't know. I probably got used to it

[MichaHoffmann]

Changing it now would be breaking change anyway

[CherrySuryp]

Yeah, can relate. Anyway thanks again!