Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

canal云平台RDS解决binlog被删除的问题 #745

Open
BLAZZ opened this issue Nov 27, 2022 · 0 comments
Open

canal云平台RDS解决binlog被删除的问题 #745

BLAZZ opened this issue Nov 27, 2022 · 0 comments

Comments

@BLAZZ
Copy link
Contributor

BLAZZ commented Nov 27, 2022

alibaba/canal#727
由于云平台数据库会在一定时间后把binlog清理到云存储,导致本地binlog消失,而且binlog越大消失越快。
对于出现位点消费异常导致消费中断,如果修复时间较长会导致恢复后无法继续消费位点的情况,为保证消费连续性,新增PR #741
来实现遇到binlog文件消失时,通过文件下载方法,将binlog文件下载本地解析后再推送给EventHandler处理。
完成自动的离线binlog和在线binlog之间的切换,保证canal消费的连续性。
各云平台可根据自己的API来实现文件下载方法。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant