Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve the documentation of ManagedTableDataset #894

Open
noklam opened this issue Oct 17, 2024 · 1 comment
Open

Improve the documentation of ManagedTableDataset #894

noklam opened this issue Oct 17, 2024 · 1 comment

Comments

@noklam
Copy link
Contributor

noklam commented Oct 17, 2024

Description

Is your feature request related to a problem? A clear and concise description of what the problem is: "I'm always frustrated when ..."

Hello Kedro community,
I have currently a problem on how my databricks.ManagedTableDataset is created (Problem of type, precision of DecimalType.
To avoid that, I want to define schema in my yaml file in order define schema should have the ManagedTableDataset in databricks.
Would you have some yaml example on how to create this schema ? (with the DecimalType if possible 🙂 ). I did not find any example, and IntegerType (a spark type) did not match anything for example.
Thanks and have a good day !

Context

Why is this change important to you? How would you use it? How can it benefit other users?

Users are struggling to use this dataset as there are limited example. I also found that the docstring has weird reference. The schema field requires user dumping a big json schema in YAML format which I find suboptimal as well.

It's not easy to figure out how to put that JSON format in yaml, so this is what I suggested temporarily to put this on catalgo.

image
@noklam
Copy link
Contributor Author

noklam commented Oct 17, 2024

Comments from the user:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant