Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using Confluent Schema Registry since v0.25.0: Magic byte and Schema ID not removed from beginning of JSON value #1890

Open
Rob3681 opened this issue Aug 1, 2024 · 3 comments
Labels
bug Something isn't working registry Kafka Schema Registry

Comments

@Rob3681
Copy link

Rob3681 commented Aug 1, 2024

Starting with version 0.25.0 (and also 0.25.1), the bytes at positions 0-4 (magic byte + schema ID) are not removed from the beginning of a record value that was produced using a schema from the Confluent Schema Registry. This means that a JSON value is not displayed formatted, but instead as a one-liner. Furthermore, the data cannot be copied so easily with CTRL+A + CTRL+C; an empty string is written to the clipboard.

v0.25.1

v0.25.1

I use the following configuration:

akhq:
  connections:
    test:
      properties:
        bootstrap.servers: abc.europe-west3.gcp.confluent.cloud:9092
        security.protocol: SASL_SSL
        sasl.mechanism: PLAIN
        sasl.jaas.config: >-
          org.apache.kafka.common.security.plain.PlainLoginModule required
          username="KAFKA-API-KEY"
          password="KAFKA-API-SECRET";
      schema-registry:
        url: https://xyz.europe-west3.gcp.confluent.cloud
        type: confluent
        basic-auth-username: SR-API-KEY
        basic-auth-password: SR-API-SECRET

Access to the schema registry generally works. It is recognized that the value was produced using a schema from the Confluent Schema Registry, I can display the schema content and I can also specify the schema when producing a message.

With the identical configuration, the problem does not occur in version 0.24.0:

v0.24.0

v0.24.0

@Rob3681 Rob3681 changed the title Using Confluent Schema Registry since v0.25.0: Magic byte and Schema ID not removed from beginning of value Using Confluent Schema Registry since v0.25.0: Magic byte and Schema ID not removed from beginning of JSON value Aug 1, 2024
@AlexisSouquiere
Copy link
Collaborator

Strange issue. I'm also using a Confluent registry with version 0.25.1 in my company and we don't have such issue.
Can you paste the entire application.yml ?

@AlexisSouquiere AlexisSouquiere added the wait for reply Need more information from reporter label Aug 1, 2024
@Rob3681
Copy link
Author

Rob3681 commented Aug 1, 2024

Do you use JSON schemas or AVRO schemas? I only have the problem with JSON schemas. The problem does not occur with AVRO schemas.

The configuration that I wrote in the issue is the entire content of my application.yaml.

@AlexisSouquiere
Copy link
Collaborator

Ok that's probably why I don't have the issue. We are only using Avro. I will investigate

@AlexisSouquiere AlexisSouquiere added bug Something isn't working registry Kafka Schema Registry and removed wait for reply Need more information from reporter labels Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working registry Kafka Schema Registry
Projects
Status: Backlog
Development

No branches or pull requests

2 participants