Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: reduce memory alloc in makeBatchRows #19701

Merged
merged 3 commits into from
Nov 7, 2024
Merged

Conversation

huby2358
Copy link
Contributor

What type of PR is this?

  • API-change
  • BUG
  • Improvement
  • Documentation
  • Feature
  • Test and CI
  • Code Refactoring

Which issue(s) this PR fixes:

issue # #18807

What this PR does / why we need it:

之前一个pr将makeBatchRows这里batch提前分配8192行内存(实际可能并不需要这么多),改为按照实际数据分配

@huby2358
Copy link
Contributor Author

企业微信截图_a983336c-7e76-43d1-9f88-92e690c7c12c 这是修改前的,initbatch这里占了。alloc space 0.2% 企业微信截图_a3c8fabe-b7f4-499e-b8be-ed314b2cc34a 这是修改后,这里占0.1%,alloc space有一定优化 企业微信截图_5a321b1e-b13a-4dc4-922c-da8791c395c9 企业微信截图_3dc38699-384e-4c26-a107-a91fdb35b422

修改前后跑这个suwen的load时间性能基本没有差别

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/refactor Code refactor size/M Denotes a PR that changes [100,499] lines
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants