-
Notifications
You must be signed in to change notification settings - Fork 959
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Redshift dialect implementation #1214
base: master
Are you sure you want to change the base?
Conversation
|
Thanks for the review @jirufik .. At this point we aren't looking at new dialects. @NathanNam , can you plz confirm if this something we want to add? Thanks! |
I think there is no point in submitting improvements for this. As you can see confluent is not interested. There is an apache fork maintained by another team that we all need to switch to. See https://github.com/aiven/jdbc-connector-for-apache-kafka |
Problem
The current implementation of kafka-connect-jdbc does not properly support Redshift. Adding multiple columns does not work. Redshift converts the TEXT type to VARCHAR(256) by default. For many data, this is a short length. Converts the date from Debezium to TEXT.
Solution
Creating a dialect for Redshift based on the modified PostgreSQL dialect.
Does this solution apply anywhere else?
If yes, where?
In the datamesh functionality of the EBAC organization https://ebaconline.com.br/
Test Strategy
Added several modules to check the Redshift language. Manual testing was carried out on the EBAC developer platform.
Testing done: