Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decrease the test concurrency for WASM on CI #4382

Merged
merged 2 commits into from
Oct 17, 2024
Merged

Conversation

mewim
Copy link
Member

@mewim mewim commented Oct 17, 2024

No description provided.

Copy link

Benchmark Result

Master commit hash: 4b61d17b3f985d01416b05b6138a6ad236d37933
Branch commit hash: a8dfa1d1ace5f68e934744c2420e466d5ed61e2b

Query Group Query Name Mean Time - Commit (ms) Mean Time - Master (ms) Diff
aggregation q24 658.36 660.89 -2.54 (-0.38%)
aggregation q28 11651.63 11480.14 171.49 (1.49%)
filter q14 143.67 147.84 -4.17 (-2.82%)
filter q15 144.35 145.46 -1.12 (-0.77%)
filter q16 323.58 323.15 0.44 (0.13%)
filter q17 462.45 462.92 -0.47 (-0.10%)
filter q18 1945.67 1942.44 3.23 (0.17%)
fixed_size_expr_evaluator q07 560.23 558.78 1.45 (0.26%)
fixed_size_expr_evaluator q08 788.33 774.97 13.37 (1.73%)
fixed_size_expr_evaluator q09 778.06 773.98 4.08 (0.53%)
fixed_size_expr_evaluator q10 254.00 253.68 0.32 (0.13%)
fixed_size_expr_evaluator q11 249.73 248.87 0.86 (0.34%)
fixed_size_expr_evaluator q12 250.46 250.17 0.30 (0.12%)
fixed_size_expr_evaluator q13 1494.64 1484.83 9.81 (0.66%)
fixed_size_seq_scan q23 131.43 133.79 -2.35 (-1.76%)
join q29 658.54 636.75 21.79 (3.42%)
join q30 1485.29 1442.84 42.45 (2.94%)
join q31 9.89 6.15 3.74 (60.82%)
ldbc_snb_ic q35 456.07 509.72 -53.65 (-10.53%)
ldbc_snb_ic q36 40.71 41.21 -0.50 (-1.22%)
ldbc_snb_is q32 7.23 9.95 -2.71 (-27.28%)
ldbc_snb_is q33 17.37 15.60 1.77 (11.35%)
ldbc_snb_is q34 5.20 6.36 -1.16 (-18.27%)
multi-rel multi-rel-large-scan 1660.24 1873.46 -213.22 (-11.38%)
multi-rel multi-rel-lookup 74.99 70.19 4.80 (6.83%)
multi-rel multi-rel-small-scan 88.67 67.09 21.58 (32.17%)
order_by q25 147.97 145.07 2.89 (1.99%)
order_by q26 487.21 486.69 0.52 (0.11%)
order_by q27 1505.56 1516.92 -11.36 (-0.75%)
scan_after_filter q01 185.01 187.52 -2.52 (-1.34%)
scan_after_filter q02 174.14 173.59 0.55 (0.32%)
shortest_path_ldbc100 q37 3381.63 3392.66 -11.03 (-0.33%)
shortest_path_ldbc100 q38 71.12 64.76 6.35 (9.81%)
shortest_path_ldbc100 q39 46.27 46.00 0.27 (0.58%)
shortest_path_ldbc100 q40 84.43 72.62 11.81 (16.27%)
var_size_expr_evaluator q03 2071.19 2073.44 -2.24 (-0.11%)
var_size_expr_evaluator q04 2282.70 2292.12 -9.42 (-0.41%)
var_size_expr_evaluator q05 2669.73 2678.32 -8.59 (-0.32%)
var_size_expr_evaluator q06 1334.22 1334.98 -0.76 (-0.06%)
var_size_seq_scan q19 1482.18 1473.63 8.56 (0.58%)
var_size_seq_scan q20 2672.74 2667.88 4.86 (0.18%)
var_size_seq_scan q21 2288.59 2278.19 10.40 (0.46%)
var_size_seq_scan q22 132.20 131.55 0.65 (0.49%)

Copy link

Benchmark Result

Master commit hash: 4b61d17b3f985d01416b05b6138a6ad236d37933
Branch commit hash: 76591fe073be69d4cf0369c644b065895f5e028a

Query Group Query Name Mean Time - Commit (ms) Mean Time - Master (ms) Diff
aggregation q24 659.98 660.89 -0.92 (-0.14%)
aggregation q28 11934.97 11480.14 454.83 (3.96%)
filter q14 141.50 147.84 -6.34 (-4.29%)
filter q15 144.41 145.46 -1.05 (-0.72%)
filter q16 325.74 323.15 2.59 (0.80%)
filter q17 461.84 462.92 -1.08 (-0.23%)
filter q18 1930.94 1942.44 -11.50 (-0.59%)
fixed_size_expr_evaluator q07 558.68 558.78 -0.10 (-0.02%)
fixed_size_expr_evaluator q08 771.68 774.97 -3.28 (-0.42%)
fixed_size_expr_evaluator q09 772.69 773.98 -1.29 (-0.17%)
fixed_size_expr_evaluator q10 255.17 253.68 1.49 (0.59%)
fixed_size_expr_evaluator q11 248.99 248.87 0.11 (0.04%)
fixed_size_expr_evaluator q12 248.66 250.17 -1.51 (-0.60%)
fixed_size_expr_evaluator q13 1486.21 1484.83 1.38 (0.09%)
fixed_size_seq_scan q23 132.71 133.79 -1.07 (-0.80%)
join q29 623.70 636.75 -13.05 (-2.05%)
join q30 1452.53 1442.84 9.69 (0.67%)
join q31 9.84 6.15 3.69 (60.01%)
ldbc_snb_ic q35 393.40 509.72 -116.32 (-22.82%)
ldbc_snb_ic q36 37.67 41.21 -3.54 (-8.59%)
ldbc_snb_is q32 7.29 9.95 -2.66 (-26.76%)
ldbc_snb_is q33 13.90 15.60 -1.70 (-10.91%)
ldbc_snb_is q34 5.47 6.36 -0.90 (-14.11%)
multi-rel multi-rel-large-scan 1831.02 1873.46 -42.45 (-2.27%)
multi-rel multi-rel-lookup 59.36 70.19 -10.83 (-15.43%)
multi-rel multi-rel-small-scan 89.47 67.09 22.38 (33.36%)
order_by q25 148.58 145.07 3.50 (2.41%)
order_by q26 483.29 486.69 -3.40 (-0.70%)
order_by q27 1514.35 1516.92 -2.57 (-0.17%)
scan_after_filter q01 187.16 187.52 -0.36 (-0.19%)
scan_after_filter q02 174.07 173.59 0.48 (0.28%)
shortest_path_ldbc100 q37 3446.87 3392.66 54.21 (1.60%)
shortest_path_ldbc100 q38 72.37 64.76 7.61 (11.75%)
shortest_path_ldbc100 q39 45.54 46.00 -0.46 (-1.01%)
shortest_path_ldbc100 q40 89.90 72.62 17.28 (23.80%)
var_size_expr_evaluator q03 2075.99 2073.44 2.56 (0.12%)
var_size_expr_evaluator q04 2291.41 2292.12 -0.71 (-0.03%)
var_size_expr_evaluator q05 2674.43 2678.32 -3.89 (-0.15%)
var_size_expr_evaluator q06 1336.09 1334.98 1.11 (0.08%)
var_size_seq_scan q19 1481.54 1473.63 7.91 (0.54%)
var_size_seq_scan q20 2659.71 2667.88 -8.17 (-0.31%)
var_size_seq_scan q21 2277.58 2278.19 -0.61 (-0.03%)
var_size_seq_scan q22 132.90 131.55 1.35 (1.03%)

Copy link

codecov bot commented Oct 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 88.21%. Comparing base (4b61d17) to head (239137c).
Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4382      +/-   ##
==========================================
- Coverage   88.21%   88.21%   -0.01%     
==========================================
  Files        1355     1355              
  Lines       53640    53640              
  Branches     7110     7108       -2     
==========================================
- Hits        47320    47316       -4     
- Misses       6146     6150       +4     
  Partials      174      174              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mewim mewim merged commit 6308ba4 into master Oct 17, 2024
25 checks passed
@mewim mewim deleted the decrease-wasm-concurrency branch October 17, 2024 04:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants