Releases: flyteorg/flytekit
Releases · flyteorg/flytekit
v1.13.7
What's Changed
- eager workflow: use event loop instead of asyncio.run by @cosmicBboy in #2737
- [Flyte Deck] Fix Lazy Import Error for Pandas and Plotly by @Future-Outlier in #2783
- Fixes for fast register by @wild-endeavor in #2782
- Use uv in agent image by @eapolinario in #2780
Full Changelog: v1.13.6...v1.13.7
v1.13.6
What's Changed
- Core/fix register remote by @novahow in #2303
- Deprecate scopes by @pingsutw in #2671
- Move vscode plugin to flytekit by @pingsutw in #2689
- Add Perian Job Platform agent by @otarabai in #2537
- Fix
test_real_config
func by unsetFLYTE_AWS_ENDPOINT
env by @Future-Outlier in #2722 - Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
- Streamline fast register options with new flag by @wild-endeavor in #2690
- fix local test
test_list_containing_multiple_annotated_pandas_dataframes
fail by @Mecoli1219 in #2725 - add motherduck support for duckdb plugin by @dansola in #2680
- Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
- Better error for min_success_ratio<1 by @pingsutw in #2724
- Fix backfill command by @pingsutw in #2730
- Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
- Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
- Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
- fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
- Imgspec/copy auto by @wild-endeavor in #2731
- GH-5732: Make
TypeEngine.lazy_import_transformers()
thread safe by @Tom-Newton in #2735 - Revert #2303 by @pingsutw in #2746
- reference lp example for flyteremote by @dansola in #2747
- Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
- Types/generic alias - assert fix only by @wild-endeavor in #2743
- Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
- add ollama to flytekit-inference by @samhita-alla in #2677
- pin duckdb version in plugin by @dansola in #2739
- feat(image_spec): validate container registry names by @pingsutw in #2748
- add resources to input downloader in the ollama plugin by @samhita-alla in #2754
- Read offloaded literals by @eapolinario in #2685
- Fix: Make flyte-iap catch when trying to generate token for service account from user credentials by @fg91 in #2738
- [Bug] Set bindings for ArrayNode by @pvditt in #2742
- [flyteagent] All agents return dict instead of literal map by @Future-Outlier in #2762
- GH-5768: Better pyflyte boolean parsing by @Tom-Newton in #2764
- add dest_dir into pythonpath before loading modules by @arbaobao in #2692
- Fix reading Flyte secrets and using PERIAN secrets param by @otarabai in #2767
- Bump cryptography from 42.0.7 to 43.0.1 by @dependabot in #2736
- [Flyte Decks] support ydata-profiling in python 3.12 by @Future-Outlier in #2766
- Update pyflyte defaults to use --copy behavior by @wild-endeavor in #2755
- Enable Spark Fast Register by @pingsutw in #2765
- Add FlyteNonRecoverableSystemException by @pingsutw in #2700
- [Flytekit] Support extra copy commands in ImageSpec by @mao3267 in #2715
- Revert dev-requirements.in change for MacOS by @Future-Outlier in #2769
- Propagate custom_info Dict through agent Resource by @ddl-ebrown in #2426
- Mock addPyFile in spark test by @pingsutw in #2770
- enabled copy-all for programmatic fast-registration via FlyteRemote by @granthamtaylor in #2768
- Do not copy flytekit itself during fast registration by @thomasjpfan in #2775
- Add correct types to
Scalar
andPrimitive
constructors inliterals.py
by @felixmulder in #2778
New Contributors
- @otarabai made their first contribution in #2537
- @ddl-ebrown made their first contribution in #2426
- @granthamtaylor made their first contribution in #2768
- @felixmulder made their first contribution in #2778
Full Changelog: v1.13.5...v1.13.6
v1.13.6b2
What's Changed
- Read offloaded literals by @eapolinario in #2685
Full Changelog: v1.13.6b1...v1.13.6b2
v1.13.6b1
What's Changed
- pin duckdb version in plugin by @dansola in #2739
- feat(image_spec): validate container registry names by @pingsutw in #2748
- add resources to input downloader in the ollama plugin by @samhita-alla in #2754
Full Changelog: v1.13.6b0...v1.13.6b1
v1.13.6b0
What's Changed
- Core/fix register remote by @novahow in #2303
- Deprecate scopes by @pingsutw in #2671
- Move vscode plugin to flytekit by @pingsutw in #2689
- Add Perian Job Platform agent by @otarabai in #2537
- Fix
test_real_config
func by unsetFLYTE_AWS_ENDPOINT
env by @Future-Outlier in #2722 - Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
- Streamline fast register options with new flag by @wild-endeavor in #2690
- fix local test
test_list_containing_multiple_annotated_pandas_dataframes
fail by @Mecoli1219 in #2725 - add motherduck support for duckdb plugin by @dansola in #2680
- Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
- Better error for min_success_ratio<1 by @pingsutw in #2724
- Fix backfill command by @pingsutw in #2730
- Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
- Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
- Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
- fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
- Imgspec/copy auto by @wild-endeavor in #2731
- GH-5732: Make
TypeEngine.lazy_import_transformers()
thread safe by @Tom-Newton in #2735 - Revert #2303 by @pingsutw in #2746
- reference lp example for flyteremote by @dansola in #2747
- Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
- Types/generic alias - assert fix only by @wild-endeavor in #2743
- Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
- add ollama to flytekit-inference by @samhita-alla in #2677
New Contributors
Full Changelog: v1.13.5...v1.13.6b0
v1.13.5
What's Changed
- Fix race conditions in the Authentication client by @rdeaton-freenome in #2635
- Update uv to 0.2.37 in default image builder by @thomasjpfan in #2687
- Input through file and pipe by @mao3267 in #2552
- Improve error message for get signed url failure by @pingsutw in #2679
- Add pythonpath "." before loading modules by @arbaobao in #2673
- Better error message for FailureNodeInputMismatch error by @pingsutw in #2693
- Remove prerelease flag with uv in image builder by @thomasjpfan in #2697
- Fix: Catch unsupported node types in map node array task by @fg91 in #2699
- Deprecation notice for pod plugin by @wild-endeavor in #2698
- Fix integration tests by @eapolinario in #2701
- Add pip_extra_index_url as a supported parameter in default builder by @thomasjpfan in #2704
- remove upper bound of plugin dependencies for flytekit-polars by @Mecoli1219 in #2514
- fix: cover 500 errors for new Harbor repos by @dylanspag-lmco in #2696
- Fix local test
test_get_config_file
fail by @Mecoli1219 in #2705 - Fix local test
test_get_remote
fail by @Mecoli1219 in #2706 - Fix local test
test_saving_remote
fail by @Mecoli1219 in #2707 - Default execution name should be generated in flyteadmin by @wayner0628 in #2678
- Support default values in typing.List[dataclass] and typing.Dict[str, dataclass] by @mao3267 in #2603
- Use logger.debug when numpy is not found by @thomasjpfan in #2712
- refactor(core): Update with_overrides signatures and type hints by @pingsutw in #2323
- Make task loading a part of dispatch execute by @thomasjpfan in #2711
- Adds neptune plugin for experiment tracking by @thomasjpfan in #2686
- Add Echo task by @pingsutw in #2654
- [Remote] check subworkflows for launch plan nodes by @wild-endeavor in #2714
- Improve jupyter repr and
__repr__
for Flyte models by @thomasjpfan in #2647 - Improve error message for entity not found in flytekit cli by @pingsutw in #2713
- Polars lazyframe by @cosmicBboy in #2695
- unify the image spec hash function by @pingsutw in #2593
- Provide upper bound to great expectations by @thomasjpfan in #2717
New Contributors
- @mao3267 made their first contribution in #2552
- @dylanspag-lmco made their first contribution in #2696
Full Changelog: v1.13.4...v1.13.5
v1.13.4
What's Changed
- Update env variables and runtime name for default image builder by @thomasjpfan in #2670
- Copy user files that were imported by workflow in pyflyte run by @thomasjpfan in #2663
- [fix] Validate workflow input name is lowercase by @ddl-rliu in #2656
- Do not use micromamba lockfiles by @thomasjpfan in #2672
- Update uv and remove pip workaround in default image builder by @thomasjpfan in #2674
- Return explicit task execution code not found by @iaroslav-ciupin in #2659
- Replace Exceptions with specific errors by @pingsutw in #2668
- Follow FLYTE_PUSH_IMAGE_SPEC in default image builder by @thomasjpfan in #2682
- Fix docker warnings by @eapolinario in #2683
- Move UV install to after the ENV is set by @thomasjpfan in #2681
- Remove false error inside dynamic task in local executions by @pingsutw in #2675
- Create duckdb connection during execution by @thomasjpfan in #2684
- Fix None deserialization bug in dataclass outputs by @JackUrb in #2610
Full Changelog: v1.13.3...v1.13.4
v1.13.3
What's Changed
- Bump grpc receive message size by @wild-endeavor in #2640
- Raise an exception when filters' value isn't a list. by @arbaobao in #2576
- Update error message for TypeTransformerFailedError by @wayner0628 in #2648
- [Error Message] Dataclasses Mismatched Type by @Future-Outlier in #2650
- Added warning for command list and shell true by @pryce-turner in #2653
- In
FlyteRemote.upload_file
, pass the file object directly rather than the entire bytes buffer by @redartera in #2641 - Modify test_array_node.py to support running in python 3.8 by @eapolinario in #2652
- Handle common cases of mutable default arguments explicitly by @eapolinario in #2651
- allow a hash method to be present for numpy arrays by @demmerichs in #2649
- return exceptions when gathering by @wild-endeavor in #2657
- Correct FlyteFile docstring by @ppiegaze in #2658
- Remove pip cache after install by @thomasjpfan in #2662
- Adds validation to image_spec for parameters that are list of strings by @thomasjpfan in #2655
- Make elastic timeout configurable for HorovovJob. by @supercharleszhu in #2631
- Fix overriding of loader_args task resolver in papermill plugin by @eapolinario in #2660
- Catch all exceptions when rendering python dependencies by @thomasjpfan in #2664
- Don't check the return statement for reference_launch_plan by @pingsutw in #2665
- Bump flyteidl to 1.13.1 by @eapolinario in #2666
New Contributors
- @arbaobao made their first contribution in #2576
- @wayner0628 made their first contribution in #2648
- @demmerichs made their first contribution in #2649
- @supercharleszhu made their first contribution in #2631
Full Changelog: v1.13.2...v1.13.3
v1.13.2
What's Changed
- [Elastic/Artifacts] Pass through model card by @wild-endeavor in #2575
- Remove pyarrow as a direct dependency by @thomasjpfan in #2228
- Boolean flag to show local container logs to the terminal by @aditya7302 in #2521
- Enable Ray Fast Register by @fiedlerNr9 in #2606
- [Artifacts/Elastic] Skip partitions by @wild-endeavor in #2620
- Install flyteidl from master in plugins tests by @eapolinario in #2621
- Quality of Life: Using ParamSpec to show underlying typehinting by @JackUrb in #2617
- Support ArrayNode mapping over Launch Plans by @pvditt in #2480
- Richer printing for some artifact objects by @wild-endeavor in #2624
- ci: Add Python 3.9 to build matrix by @pingsutw in #2622
- bump idl by @wild-endeavor in #2627
- Added alt prefix head to FlyteFile.new_remote by @pryce-turner in #2601
- Feature gate for FlyteMissingReturnValueException by @pingsutw in #2623
- Remove use of multiprocessing from the OAuth client by @rdeaton-freenome in #2626
- Update codespell in precommit to version 2.3.0 by @eapolinario in #2630
- Fix Snowflake Agent Bug by @Future-Outlier in #2605
- run test_missing_return_value on python 3.10+ by @pingsutw in #2637
- [Elastic] Fix context usage and apply fix to fork method by @wild-endeavor in #2628
- Add flytekit-omegaconf plugin by @mg515 in #2299
- Adds extra-index-url to default image builder by @thomasjpfan in #2636
- reference_task should inherit from PythonTask by @pingsutw in #2643
- Fix Get Agent Secret Using Key by @Future-Outlier in #2644
- Fix Snowflake Agent Secret Bug by @Future-Outlier in #2645
- Don't call remote when --help in remote-X by @wild-endeavor in #2642
New Contributors
- @aditya7302 made their first contribution in #2521
- @JackUrb made their first contribution in #2617
- @mg515 made their first contribution in #2299
Full Changelog: v1.13.1...v1.13.2
[Beta] v1.13.2b1
from v1.13.2b0
What's Changed
- [Artifacts/Elastic] Skip partitions by @wild-endeavor in #2620
- Install flyteidl from master in plugins tests by @eapolinario in #2621
- Quality of Life: Using ParamSpec to show underlying typehinting by @JackUrb in #2617
- Support ArrayNode mapping over Launch Plans by @pvditt in #2480
- Richer printing for some artifact objects by @wild-endeavor in #2624
- ci: Add Python 3.9 to build matrix by @pingsutw in #2622
- bump idl by @wild-endeavor in #2627
- Added alt prefix head to FlyteFile.new_remote by @pryce-turner in #2601
- Feature gate for FlyteMissingReturnValueException by @pingsutw in #2623
- Remove use of multiprocessing from the OAuth client by @rdeaton-freenome in #2626
- Update codespell in precommit to version 2.3.0 by @eapolinario in #2630
- Fix Snowflake Agent Bug by @Future-Outlier in #2605
- run test_missing_return_value on python 3.10+ by @pingsutw in #2637
- [Elastic] Fix context usage and apply fix to fork method by @wild-endeavor in #2628
New Contributors
Full Changelog: v1.13.2b0...v1.13.2b1