Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

202206_OneFlow_Compare_Master_DLPerf_Test_Result #27

Open
github-actions bot opened this issue Jun 8, 2022 · 20 comments
Open

202206_OneFlow_Compare_Master_DLPerf_Test_Result #27

github-actions bot opened this issue Jun 8, 2022 · 20 comments

Comments

@github-actions
Copy link

github-actions bot commented Jun 8, 2022

202206_OneFlow_Compare_Master_DLPerf_Test_Result
@github-actions
Copy link
Author

github-actions bot commented Jun 8, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 7feedc44(20220608) 83ed0ba5(20220607)
Y Throughput 293.41 294.36
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 7feedc44(20220608) 83ed0ba5(20220607)
Y Throughput 1359.11 1355.29
Y Memory 24076 MiB 24058 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 7feedc44(20220608) 83ed0ba5(20220607)
Y Throughput 378.46 378.82
Y Memory 24166 MiB 24166 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 7feedc44(20220608) 83ed0ba5(20220607)
Y Throughput 1326.63 1326.99
Y Memory 24872 MiB 24864 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 7feedc44(20220608) 83ed0ba5(20220607)
Y Throughput 368.1 372.73
Y Memory 24902 MiB 24896 MiB

@github-actions
Copy link
Author

github-actions bot commented Jun 9, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 319.23 317.46
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 293.05 293.41
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 1519.63 1517.36
Y Memory 22914 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 1347.39 1359.11
Y Memory 24076 MiB 24076 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 388.13 387.64
Y Memory 23044 MiB 22996 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 378.92 378.46
Y Memory 24144 MiB 24166 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 1509.31 1507.07
Y Memory 23696 MiB 23700 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 1339.87 1326.63
Y Memory 24850 MiB 24872 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 384.91 385.7
N Memory 23798 MiB 23730 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 372.23 368.1
Y Memory 24916 MiB 24902 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 300.584 300.506
Y Memory 5628 MiB 5626 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 41.412 41.118
Y Memory 2702 MiB 2700 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 4.726 4.661
Y Memory 1828 MiB 1826 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 8.079 8.025
Y Memory 2228 MiB 2226 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 121.588 120.588
Y Memory 3814 MiB 3812 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 22.054 22.336
Y Memory 2440 MiB 2438 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 161.284 163.472
Y Memory 4756 MiB 4754 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 23.655 23.893
Y Memory 3997 MiB 3995 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 4.232 4.251
Y Memory 2851 MiB 2849 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 97.31 94.498
Y Memory 2860 MiB 2858 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0fd888c(20220609) 7feedc44(20220608)
Y Throughput 13.88 13.947
Y Memory 3419 MiB 3449 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 318.58 319.23
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 293.35 293.05
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 1509.85 1519.63
Y Memory 22914 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 1345.59 1347.39
Y Memory 24076 MiB 24076 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 388.33 388.13
Y Memory 22998 MiB 23044 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 379.5 378.92
Y Memory 24186 MiB 24144 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 1500.94 1509.31
Y Memory 23696 MiB 23696 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 1327.27 1339.87
Y Memory 24840 MiB 24850 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 384.8 384.91
Y Memory 23760 MiB 23798 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 469f72d8(20220610) 0fd888c(20220609)
Y Throughput 371.86 372.23
N Memory 24858 MiB 24916 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 301.41 300.584
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 41.151 41.412
Y Memory 2702 MiB 2702 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 4.745 4.726
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 7.931 8.079
Y Memory 2228 MiB 2228 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 117.932 121.588
Y Memory 3814 MiB 3814 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 21.256 22.054
Y Memory 2440 MiB 2440 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 164.904 161.284
Y Memory 4756 MiB 4756 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 23.657 23.655
Y Memory 3997 MiB 3997 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 4.242 4.232
Y Memory 2851 MiB 2851 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 93.883 97.31
Y Memory 2860 MiB 2860 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g d98132ee(20220610) 0fd888c(20220609)
Y Throughput 13.86 13.88
Y Memory 3419 MiB 3419 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 317.66 318.58
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 293.82 293.35
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 1506.34 1509.85
Y Memory 22914 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 1332.06 1345.59
Y Memory 24058 MiB 24076 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 386.67 388.33
Y Memory 23044 MiB 22998 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 379.26 379.5
Y Memory 24186 MiB 24186 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 1490.3 1500.94
Y Memory 23696 MiB 23696 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 1366.51 1327.27
Y Memory 24852 MiB 24840 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 385.95 384.8
Y Memory 23734 MiB 23760 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 5686581c(20220611) 469f72d8(20220610)
Y Throughput 370.82 371.86
N Memory 24922 MiB 24858 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 300.695 301.41
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 41.429 41.151
Y Memory 2702 MiB 2702 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 4.451 4.745
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 8.101 7.931
Y Memory 2228 MiB 2228 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 118.888 117.932
Y Memory 3814 MiB 3814 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 22.254 21.256
Y Memory 2440 MiB 2440 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 166.461 164.904
Y Memory 4756 MiB 4756 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 23.87 23.657
N Memory 4061 MiB 3997 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 4.245 4.242
Y Memory 2851 MiB 2851 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 5686581c(20220611) d98132ee(20220610)
Y Throughput 90.894 93.883
N Memory 3116 MiB 2860 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 5686581c(20220611) d98132ee(20220610)
Y Throughput 13.979 13.86
Y Memory 3419 MiB 3419 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 15eef189(20220612) 5686581c(20220611)
Y Throughput 318.79 317.66
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 292.85 293.82
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 15eef189(20220612) 5686581c(20220611)
Y Throughput 1515.21 1506.34
Y Memory 22914 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 1337.8 1332.06
Y Memory 24054 MiB 24058 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 15eef189(20220612) 5686581c(20220611)
Y Throughput 388.51 386.67
Y Memory 23042 MiB 23044 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 378.76 379.26
Y Memory 24158 MiB 24186 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 15eef189(20220612) 5686581c(20220611)
Y Throughput 1501.69 1490.3
Y Memory 23702 MiB 23696 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 1365.64 1366.51
Y Memory 24830 MiB 24852 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 15eef189(20220612) 5686581c(20220611)
Y Throughput 384.32 385.95
Y Memory 23762 MiB 23734 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 373.28 370.82
Y Memory 24876 MiB 24922 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 41.706 41.429
Y Memory 2702 MiB 2702 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 7.958 8.101
Y Memory 2228 MiB 2228 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 22.049 22.254
Y Memory 2440 MiB 2440 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 23.77 23.87
Y Memory 4061 MiB 4061 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 4.197 4.245
Y Memory 2851 MiB 2851 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 15eef189(20220612) 5686581c(20220611)
Y Throughput 13.779 13.979
Y Memory 3419 MiB 3419 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 15eef189(20220613) 15eef189(20220612)
Y Throughput 318.84 318.79
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 294.08 292.85
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 15eef189(20220613) 15eef189(20220612)
Y Throughput 1520.57 1515.21
Y Memory 22914 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 1350.5 1337.8
Y Memory 24076 MiB 24054 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 15eef189(20220613) 15eef189(20220612)
Y Throughput 388.32 388.51
Y Memory 23032 MiB 23042 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 379.55 378.76
Y Memory 24124 MiB 24158 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 15eef189(20220613) 15eef189(20220612)
Y Throughput 1499.5 1501.69
Y Memory 23694 MiB 23702 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 1347.38 1365.64
N Memory 24884 MiB 24830 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 15eef189(20220613) 15eef189(20220612)
Y Throughput 386.47 384.32
N Memory 23704 MiB 23762 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 369.53 373.28
Y Memory 24910 MiB 24876 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 41.279 41.706
Y Memory 2702 MiB 2702 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 8.013 7.958
Y Memory 2228 MiB 2228 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 21.6 22.049
Y Memory 2440 MiB 2440 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 23.585 23.77
Y Memory 4061 MiB 4061 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 4.245 4.197
Y Memory 2851 MiB 2851 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 15eef189(20220613) 15eef189(20220612)
Y Throughput 13.971 13.779
Y Memory 3451 MiB 3419 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 319.58 318.84
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 292.97 294.08
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 1524.02 1520.57
Y Memory 22918 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 1357.79 1350.5
Y Memory 24060 MiB 24076 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 389.89 388.32
Y Memory 23048 MiB 23032 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 378.39 379.55
N Memory 24176 MiB 24124 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 1505.22 1499.5
Y Memory 23682 MiB 23694 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 1387.46 1347.38
N Memory 24824 MiB 24884 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 388.23 386.47
Y Memory 23730 MiB 23704 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 370.31 369.53
Y Memory 24884 MiB 24910 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 303.103 301.205
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 40.688 41.279
Y Memory 2702 MiB 2702 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 4.717 4.867
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 7.879 8.013
Y Memory 2228 MiB 2228 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 120.231 119.143
Y Memory 3814 MiB 3814 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 21.948 21.6
Y Memory 2440 MiB 2440 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 163.121 166.494
N Memory 4756 MiB 4246 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 23.681 23.585
Y Memory 4059 MiB 4061 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 4.229 4.245
Y Memory 2849 MiB 2851 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g e8547b45(20220614) 15eef189(20220613)
Y Throughput 93.524 91.695
Y Memory 3116 MiB 3116 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g e8547b45(20220614) 15eef189(20220613)
Y Throughput 13.878 13.971
Y Memory 3417 MiB 3451 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 319.55 319.58
Y Memory 26942 MiB 26942 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 1524.92 1524.02
Y Memory 22918 MiB 22918 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 391.21 389.89
Y Memory 23020 MiB 23048 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 1508.35 1505.22
Y Memory 23696 MiB 23682 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 389.02 388.23
Y Memory 23742 MiB 23730 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 301.206 303.103
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 4.396 4.717
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 113.756 120.231
Y Memory 3814 MiB 3814 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 177.844 163.121
N Memory 4246 MiB 4756 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 041f7871(20220615) e8547b45(20220614)
Y Throughput 99.397 93.524
Y Memory 3116 MiB 3116 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 300.913 301.206
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 4.335 4.396
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 112.597 113.756
Y Memory 3814 MiB 3814 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 183.478 177.844
N Memory 4756 MiB 4246 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 4af9b7a4(20220616) 041f7871(20220615)
Y Throughput 99.927 99.397
Y Memory 3116 MiB 3116 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 301.411 300.913
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 4.63 4.335
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 117.883 112.597
Y Memory 3814 MiB 3814 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 163.608 183.478
Y Memory 4756 MiB 4756 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f6c3cb6(20220617) 4af9b7a4(20220616)
Y Throughput 95.995 99.927
Y Memory 3116 MiB 3116 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 318.33 318.6
Y Memory 26942 MiB 26942 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 295.09 293.9
Y Memory 27342 MiB 27342 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 1497.51 1510.79
Y Memory 22914 MiB 22918 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 1369.05 1348.32
Y Memory 24060 MiB 24082 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 387.12 386.63
Y Memory 23038 MiB 23068 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 379.71 379.66
N Memory 24112 MiB 24202 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 1480.54 1482.02
Y Memory 23698 MiB 23684 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 1385.99 1364.88
Y Memory 24824 MiB 24848 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 384.98 383.62
Y Memory 23756 MiB 23776 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 369.42 372.19
Y Memory 24936 MiB 24908 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 303.497 301.411
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 4.523 4.63
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 115.591 117.883
Y Memory 3814 MiB 3814 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 172.676 163.608
N Memory 5146 MiB 4756 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f7532fd(20220618) f6c3cb6(20220617)
Y Throughput 2.563 0
N Memory 1642 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f7532fd(20220618) f6c3cb6(20220617)
N Throughput 0 95.995
N Memory None MiB 3116 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 318.6 318.33
Y Memory 26942 MiB 26942 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 1505.49 1497.51
Y Memory 22912 MiB 22914 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 385.51 387.12
Y Memory 23038 MiB 23038 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 1483.49 1480.54
Y Memory 23694 MiB 23698 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 385.39 384.98
Y Memory 23774 MiB 23756 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 301.119 303.497
Y Memory 5628 MiB 5628 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 4.655 4.523
Y Memory 1828 MiB 1828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 111.866 115.591
Y Memory 3814 MiB 3814 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 182.78 172.676
Y Memory 5146 MiB 5146 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 2.611 2.563
Y Memory 1642 MiB 1642 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g d7ef39f(20220619) f7532fd(20220618)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 9a5e7506(20220623) ca3cbdd(20220622)
Y Throughput 319.03 318.93
Y Memory 27004 MiB 27004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 9a5e7506(20220623) ca3cbdd(20220622)
Y Throughput 1502.63 1511.86
Y Memory 22976 MiB 22976 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 9a5e7506(20220623) ca3cbdd(20220622)
Y Throughput 389.81 392.38
Y Memory 23096 MiB 23096 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 9a5e7506(20220623) ca3cbdd(20220622)
Y Throughput 1480.35 1490.37
Y Memory 23750 MiB 23760 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 9a5e7506(20220623) ca3cbdd(20220622)
Y Throughput 387.26 388.27
Y Memory 23828 MiB 23820 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 302.403 301.322
Y Memory 5688 MiB 5688 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 4.507 4.402
Y Memory 1888 MiB 1888 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 115.696 119.719
Y Memory 3874 MiB 3874 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 173.679 172.585
Y Memory 4822 MiB 4822 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 2.724 2.695
Y Memory 1702 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 9a5e7506(20220623) 3cbf392(20220622)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 319.31 319.03
Y Memory 27004 MiB 27004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 1505.56 1502.63
Y Memory 22976 MiB 22976 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 389.11 389.81
Y Memory 23098 MiB 23096 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 1486.33 1480.35
Y Memory 23740 MiB 23750 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 386.54 387.26
Y Memory 23832 MiB 23828 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 301.417 302.403
Y Memory 5688 MiB 5688 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 4.342 4.507
Y Memory 1888 MiB 1888 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 115.988 115.696
Y Memory 3874 MiB 3874 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 174.6 173.679
Y Memory 4822 MiB 4822 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 2.656 2.724
Y Memory 1702 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g a4a20016(20220624) 9a5e7506(20220623)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 320.28 319.31
Y Memory 27004 MiB 27004 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 26fe902(20220625) a4a20016(20220624)
Y Throughput 296.68 294.11
Y Memory 27404 MiB 27404 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 1523.86 1505.56
Y Memory 22976 MiB 22976 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 26fe902(20220625) a4a20016(20220624)
Y Throughput 1373.93 1377.85
Y Memory 24078 MiB 24122 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 392.79 389.11
Y Memory 23098 MiB 23098 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 26fe902(20220625) a4a20016(20220624)
Y Throughput 382.6 382.05
Y Memory 24182 MiB 24226 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 1489.09 1486.33
Y Memory 23740 MiB 23740 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 26fe902(20220625) a4a20016(20220624)
Y Throughput 1384.49 1386.66
N Memory 24848 MiB 24922 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 391.54 386.54
Y Memory 23836 MiB 23832 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 26fe902(20220625) a4a20016(20220624)
Y Throughput 377.91 363.51
Y Memory 24890 MiB 24918 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 26fe902(20220625) a4a20016(20220624)
N Throughput 538.82 301.417
Y Memory 5688 MiB 5688 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 80.383 79.495
Y Memory 2762 MiB 2762 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 7.328 4.342
Y Memory 1888 MiB 1888 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 10.492 10.422
Y Memory 2288 MiB 2288 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 26fe902(20220625) a4a20016(20220624)
N Throughput 221.011 115.988
Y Memory 3874 MiB 3874 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 43.128 42.392
Y Memory 2500 MiB 2500 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 176.196 174.6
Y Memory 4822 MiB 4822 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 2.715 2.656
Y Memory 1702 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 0 4.12
N Memory None MiB 2909 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 26fe902(20220625) a4a20016(20220624)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 26fe902(20220625) 3b90b60(20220624)
Y Throughput 13.908 13.713
Y Memory 3489 MiB 3509 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 320.03 320.28
Y Memory 27004 MiB 27004 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 298.01 296.68
Y Memory 27404 MiB 27404 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 1513.4 1523.86
Y Memory 22976 MiB 22976 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 1385.28 1373.93
Y Memory 24080 MiB 24078 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 390.18 392.79
Y Memory 23098 MiB 23098 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 380.83 382.6
Y Memory 24178 MiB 24182 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 1491.98 1489.09
Y Memory 23740 MiB 23740 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g ca9fd64(20220626) 26fe902(20220625)
N Throughput 1334.49 1384.49
Y Memory 24856 MiB 24848 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 387.0 391.54
Y Memory 23814 MiB 23836 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 372.58 377.91
Y Memory 24926 MiB 24890 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 524.222 538.82
Y Memory 5690 MiB 5688 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 79.74 80.383
Y Memory 2764 MiB 2762 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 7.348 7.328
Y Memory 1890 MiB 1888 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 10.366 10.492
Y Memory 2290 MiB 2288 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 231.46 221.011
Y Memory 3876 MiB 3874 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 43.322 43.128
Y Memory 2502 MiB 2500 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 165.881 176.196
Y Memory 4824 MiB 4822 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 2.689 2.715
Y Memory 1704 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 4.091 0
N Memory 2891 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g ca9fd64(20220626) 26fe902(20220625)
N Throughput 96.695 0
N Memory 2938 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g ca9fd64(20220626) 26fe902(20220625)
Y Throughput 0 13.908
N Memory None MiB 3489 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 319.81 320.03
Y Memory 27004 MiB 27004 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 297.92 298.01
Y Memory 27404 MiB 27404 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 1518.56 1513.4
Y Memory 22980 MiB 22976 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 1385.53 1385.28
Y Memory 24078 MiB 24080 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 392.47 390.18
Y Memory 23104 MiB 23098 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 381.93 380.83
Y Memory 24178 MiB 24178 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 1500.12 1491.98
Y Memory 23748 MiB 23740 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 1304.7 1334.49
Y Memory 24850 MiB 24856 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 389.5 387.0
Y Memory 23828 MiB 23814 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 371.82 372.58
Y Memory 24922 MiB 24926 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 501.337 524.222
Y Memory 5690 MiB 5690 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 79.543 79.74
Y Memory 2764 MiB 2764 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 7.059 7.348
Y Memory 1890 MiB 1890 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 10.422 10.366
Y Memory 2290 MiB 2290 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 219.626 231.46
Y Memory 3876 MiB 3876 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 43.176 43.322
Y Memory 2502 MiB 2502 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 168.306 165.881
Y Memory 4818 MiB 4824 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 24.157 0
N Memory 4101 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 2.697 2.689
Y Memory 1702 MiB 1704 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 4.125 4.091
Y Memory 2891 MiB 2891 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 94.488 96.695
N Memory 3178 MiB 2938 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0c35fd17(20220627) ca9fd64(20220626)
Y Throughput 13.803 0
N Memory 3491 MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 320.09 319.81
Y Memory 27004 MiB 27004 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 297.9 297.92
Y Memory 27404 MiB 27404 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 1525.79 1518.56
Y Memory 22980 MiB 22980 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 1378.02 1385.53
Y Memory 24078 MiB 24078 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 391.82 392.47
Y Memory 23104 MiB 23104 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 379.83 381.93
Y Memory 24134 MiB 24178 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 1496.31 1500.12
Y Memory 23766 MiB 23748 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 1330.91 1304.7
Y Memory 24866 MiB 24850 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 390.72 389.5
Y Memory 23820 MiB 23828 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 372.01 371.82
Y Memory 24906 MiB 24922 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 524.095 501.337
Y Memory 5690 MiB 5690 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 80.103 79.543
Y Memory 2764 MiB 2764 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 7.312 7.059
Y Memory 1890 MiB 1890 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 10.393 10.422
Y Memory 2290 MiB 2290 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 222.684 219.626
Y Memory 3876 MiB 3876 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 42.616 43.176
Y Memory 2502 MiB 2502 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 173.796 168.306
Y Memory 4818 MiB 4818 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 0 24.157
N Memory None MiB 4101 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 2.684 2.697
Y Memory 1702 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 4.091 4.125
Y Memory 2891 MiB 2891 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 94.907 94.488
Y Memory 3178 MiB 3178 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g f52ec97(20220628) 0c35fd17(20220627)
Y Throughput 0 13.803
N Memory None MiB 3491 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 318.66 320.09
Y Memory 27032 MiB 27004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 1512.09 1525.79
Y Memory 23008 MiB 22980 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 388.25 391.82
Y Memory 23132 MiB 23104 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 1500.54 1496.31
Y Memory 23774 MiB 23766 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 385.29 390.72
Y Memory 23852 MiB 23820 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 514.783 524.095
Y Memory 5718 MiB 5690 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 7.205 7.312
Y Memory 1918 MiB 1890 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 228.022 222.684
Y Memory 3904 MiB 3876 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 162.452 173.796
N Memory 4336 MiB 4818 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 2.559 2.684
Y Memory 1730 MiB 1702 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2aaa2a9(20220629) f52ec97(20220628)
Y Throughput 89.581 94.907
N Memory 2950 MiB 3178 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 319.05 318.66
Y Memory 27032 MiB 27032 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 1513.19 1512.09
Y Memory 23008 MiB 23008 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 387.85 388.25
Y Memory 23132 MiB 23132 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 1490.39 1500.54
Y Memory 23788 MiB 23774 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 388.46 385.29
Y Memory 23858 MiB 23852 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 533.287 514.783
Y Memory 5718 MiB 5718 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 7.024 7.205
Y Memory 1918 MiB 1918 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 224.217 228.022
Y Memory 3904 MiB 3904 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 175.679 162.452
Y Memory 4336 MiB 4336 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 2.666 2.559
Y Memory 1730 MiB 1730 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 99b1eff7(20220630) 2aaa2a9(20220629)
Y Throughput 92.08 89.581
Y Memory 2950 MiB 2950 MiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants