[Bug]: loading data was hung on eks with 3*cn on daily regression(occasional)

[aressu1985]

Is there an existing issue for the same bug?

• I have checked the existing issues.

Environment

- Version or commit-id (e.g. v0.1.0 or 8b23a93):bf23f2a999702b465669249f95a9c4bf8bf37322
- Hardware parameters:
  2*CN : 16C  64G
  1*DN : 16C  64G
  3*LOG : 16C  64G
- OS type:
- Others:
  MEMCACHE: 16G
  DISKCACHE: 100G

Actual Behavior

on daily regression 23 Jun, the loading data was hung.

but when trying reproducing, it did not happen again.

https://github.com/matrixorigin/mo-nightly-regression/actions/runs/5347746368/jobs/9699327123

the mo log can be get from loki by ns: mo-nightly-regression and the time that the loading data was hung.

Expected Behavior

No response

Steps to Reproduce

No response

Additional information

No response

[XuPeng-SH]

@jianwan0214

[aressu1985]

https://github.com/matrixorigin/matrixone/actions/runs/5368078768/jobs/9738749085

this merge run has reproed again

[jianwan0214]

复现定位中

[jianwan0214]

今天未复现

[jianwan0214]

本地一直未复现，原因还在定位中

[jianwan0214]

今天未复现

[aressu1985]

未定位出原因，也没有在复现过，先降级处理

[aressu1985]

repro from job：
https://github.com/matrixorigin/matrixone/actions/runs/5441445915/jobs/9895548735

[daviszhen]

repro from job： https://github.com/matrixorigin/matrixone/actions/runs/5441445915/jobs/9895548735

从日志看。是create table 卡住。

[jianwan0214]

正在准备加点日志，在卡住的时候，把goroutine dump出来

[jianwan0214]

加了点定位信息，等合进去复现看看

[jianwan0214]

还在看

[jianwan0214]

未复现，还在看

[guguducken]

comment from @jianwan0214 未复现，还在看

[jianwan0214]

未复现

[ouyuanning]

not working on it

[ouyuanning]

not working on it

[ouyuanning]

not working on it

[ouyuanning]

not working on it

[ouyuanning]

not working on it

[ouyuanning]

waiting for repro in daily run.

[aressu1985]

downgrade to s1

[sukki37]

This issue has been inactive for a while. To help keep our backlog clear, I'm going to close this. If you feel this is still relevant, please comment or reopen.