Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Tpch5T query Q9 caused 3cn oom #17693

Closed
1 task done
heni02 opened this issue Jul 24, 2024 · 3 comments
Closed
1 task done

[Bug]: Tpch5T query Q9 caused 3cn oom #17693

heni02 opened this issue Jul 24, 2024 · 3 comments
Assignees
Labels
kind/bug Something isn't working long-term-job phase/testing severity/s0 Extreme impact: Cause the application to break down and seriously affect the use to-next-release
Milestone

Comments

@heni02
Copy link
Contributor

heni02 commented Jul 24, 2024

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch Name

main

Commit ID

9304352

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

job:https://github.com/matrixorigin/mo-nightly-regression/actions/runs/10054767838/job/27819600253
企业微信截图_69260cc1-e43a-4c8a-bda6-548e4f330261
企业微信截图_855f449b-818c-4439-9003-9dea63f508af
企业微信截图_47bc8fc4-1406-466a-8421-588082d6a907

heap:
https://grafana.ci.matrixorigin.cn/explore?panes=%7B%22LeX%22:%7B%22datasource%22:%22pyroscope%22,%22queries%22:%5B%7B%22groupBy%22:%5B%5D,%22labelSelector%22:%22%7Bnamespace%3D%5C%22mo-ben-nightly-93043522e-20240723%5C%22%7D%22,%22queryType%22:%22both%22,%22refId%22:%22A%22,%22profileTypeId%22:%22memory:alloc_objects:count:space:bytes%22,%22datasource%22:%7B%22type%22:%22grafana-pyroscope-datasource%22,%22uid%22:%22pyroscope%22%7D%7D%5D,%22range%22:%7B%22from%22:%221721793404415%22,%22to%22:%221721794680616%22%7D%7D%7D&schemaVersion=1&orgId=1
Q9:
select
nation,
o_year,
sum(amount) as sum_profit
from
(
select
n_name as nation,
extract(year from o_orderdate) as o_year,
l_extendedprice * (1 - l_discount) - ps_supplycost * l_quantity as amount
from
part,
supplier,
lineitem,
partsupp,
orders,
nation
where
s_suppkey = l_suppkey
and ps_suppkey = l_suppkey
and ps_partkey = l_partkey
and p_partkey = l_partkey
and o_orderkey = l_orderkey
and s_nationkey = n_nationkey
and p_name like '%:1%'
) as profit
group by
nation,
o_year
order by
nation,
o_year desc;

tpch5T table counts:
lineitem: 30000006798
customer: 750000000
partsupp: 4000000000
orders: 7500000000
part: 1000000000
supplier:50000000
nation:25
region:5

Expected Behavior

No response

Steps to Reproduce

tke 3cn tpch5T test

Additional information

No response

@heni02 heni02 added kind/bug Something isn't working needs-triage severity/s0 Extreme impact: Cause the application to break down and seriously affect the use labels Jul 24, 2024
@heni02 heni02 added this to the 1.3.0 milestone Jul 24, 2024
@ouyuanning ouyuanning assigned badboynt1 and unassigned matrix-meow Jul 24, 2024
@badboynt1
Copy link
Contributor

依赖spill的实现

@badboynt1
Copy link
Contributor

现在可以验证一下,q9应该不会oom了
需要改一下gomemlimit调小到4g, gogc改回默认值100

@badboynt1 badboynt1 assigned heni02 and unassigned badboynt1 Oct 16, 2024
@sukki37 sukki37 modified the milestones: 2.1.0, 2.0.0 Oct 19, 2024
@aressu1985
Copy link
Contributor

fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working long-term-job phase/testing severity/s0 Extreme impact: Cause the application to break down and seriously affect the use to-next-release
Projects
None yet
Development

No branches or pull requests

5 participants