Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: Support writing to a Solace message broker #31905

Open
1 of 16 tasks
iht opened this issue Jul 16, 2024 · 1 comment · May be fixed by #32060
Open
1 of 16 tasks

[Feature Request]: Support writing to a Solace message broker #31905

iht opened this issue Jul 16, 2024 · 1 comment · May be fixed by #32060
Assignees
@iht
Labels
java new feature P3

Comments

@iht
Copy link
Contributor

iht commented Jul 16, 2024 •
edited
Loading

What would you like to happen?

I'd like to add a native Java connector to write messages to Solace message broker. See the design doc for details: https://docs.google.com/document/d/1mPQFT4OCEUjFIoEwkL3W4mQVj0JuCC0TXmYt-8CBV-E/edit?usp=sharing

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@iht iht mentioned this issue Jul 16, 2024
Open
iht added a commit to iht/beam that referenced this issue Jul 16, 2024
@iht
JCSMP properties providers for new SolaceIO write connector
9929c8d 
This adds a base class and two providers for the new SolaceIO write
connector. The basic authentication provider just uses a username and
password.

Users can write their own providers to set authentication mechanisms
and other session properties, by extending from the base class. As an
example, we provide a GoogleCloudSecretProvider, to show how to create
your own. This provider can also be used "as is", but it is mainly
meant as an example to implement your own.

In upcoming PRs, I will be submitting the rest of the write
connector. It is thousands of lines of code, so I am splitting in
smaller PRs, to facilitate code reviews.

This PR contributes to apache#31905
This was referenced Jul 17, 2024
Merged
Closed
Abacn pushed a commit that referenced this issue Jul 22, 2024
@iht
JCSMP properties providers for new SolaceIO write connector (#31906)
04ed95d 
* JCSMP properties providers for new SolaceIO write connector

This adds a base class and two providers for the new SolaceIO write
connector. The basic authentication provider just uses a username and
password.

Users can write their own providers to set authentication mechanisms
and other session properties, by extending from the base class. As an
example, we provide a GoogleCloudSecretProvider, to show how to create
your own. This provider can also be used "as is", but it is mainly
meant as an example to implement your own.

In upcoming PRs, I will be submitting the rest of the write
connector. It is thousands of lines of code, so I am splitting in
smaller PRs, to facilitate code reviews.

This PR contributes to #31905

* Fix CheckStyle and Spotbugs errors

* Fix class dependencies declaration

* Unify session and auth providers/factories for the read and write connectors

* Fix format violations in comment
iht added a commit to iht/beam that referenced this issue Jul 23, 2024
@iht
This is a followup PR to apache#31906, and part of the issue apache#3…
7d469e0 
…1905

This adds the interface of the Write connector and a few classes (data
classes, POutput) that are used by the connector.
iht added a commit to iht/beam that referenced this issue Jul 23, 2024
@iht
This is a followup PR to apache#31906, and part of the issue apache#3…
4d4d5b5 
…1905

This adds the interface of the Write connector and a few classes (data
classes, POutput) that are used by the connector.
@iht iht mentioned this issue Jul 23, 2024
Merged
@bzablocki bzablocki mentioned this issue Jul 24, 2024
Closed
16 tasks
Abacn pushed a commit that referenced this issue Jul 29, 2024
@iht
This is a followup PR to #31906, and part of the issue #31905 (#31953)
493e0ba 
This adds the interface of the Write connector and a few classes (data
classes, POutput) that are used by the connector.
@iht iht linked a pull request Aug 2, 2024 that will close this issue
Open
@iht
Copy link
Contributor Author

iht commented Aug 27, 2024

.take-issue

iht added a commit to iht/beam that referenced this issue Aug 27, 2024
@iht
This is a follow-up PR to apache#31953, and part of the issue apache#…
e5d67fd 
…31905.

This PR adds the actual writer functionality, and some additional
testing, including integration testing.

This should be final PR for the SolaceIO write connector to be
complete.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iht iht

Labels
java new feature P3
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

SolaceIO write connector iht/beam
1 participant
@iht