Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[yaml] Normalize RunInference transform #28700

Open
2 of 16 tasks
Polber opened this issue Sep 27, 2023 · 3 comments
Open
2 of 16 tasks

[yaml] Normalize RunInference transform #28700

Polber opened this issue Sep 27, 2023 · 3 comments

Comments

@Polber
Copy link
Contributor

Polber commented Sep 27, 2023

What would you like to happen?

This bug is part of the Beam YAML milestone. More information about Beam YAML can be found here: https://github.com/apache/beam/tree/master/sdks/python/apache_beam/yaml#beam-yaml-api

A Beam YAML contribution guide can be found here: https://s.apache.org/beam-yaml-contribute


The RunInference transform should be normalized to be compatible with Beam YAML. There is a doc for normalizing the Beam IO's for Beam YAML, but the general process can be carried over to this work. That doc can be found here.

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@smeet07
Copy link
Contributor

smeet07 commented Sep 28, 2023

.take-issue

@smeet07
Copy link
Contributor

smeet07 commented Mar 20, 2024

@Polber can you guide me here

@Polber
Copy link
Contributor Author

Polber commented Mar 28, 2024

I would suggest taking a look at one of the other transforms that need normalizing:
https://github.com/apache/beam/issues?q=is%3Aopen+is%3Aissue+label%3Ayaml+normalize

TFRecord would be a good candidate if your interest is in ML transforms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants