convert some pipelines to run locally, as they will cause hung due to receiver lost. #19467
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
m-schen
requested review from
ouyuanning,
aunjgr,
badboynt1 and
qingxinhome
as code owners
ouyuanning
approved these changes
Oct 19, 2024
m-schen
changed the title
1 task
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What type of PR is this?
Which issue(s) this PR fixes:
issue #17540
What this PR does / why we need it:
由于某些pipeline需要往其他pipeline发送数据（例如insert到唯一约束的列，需要发送一份数据到去重pipeline），无法发送到远程单独执行，这会导致找不到dispatch算子的数据接收者而卡死的问题。
对于这些pipeline在记录info级别的log后转换为本地执行。