Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

202205_OneFlow_Compare_Master_DLPerf_Test_Result #25

Open
github-actions bot opened this issue May 3, 2022 · 16 comments
Open

202205_OneFlow_Compare_Master_DLPerf_Test_Result #25

github-actions bot opened this issue May 3, 2022 · 16 comments

Comments

@github-actions
Copy link

github-actions bot commented May 3, 2022

202205_OneFlow_Compare_Master_DLPerf_Test_Result
@github-actions
Copy link
Author

github-actions bot commented May 3, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 319.35 319.26
Y Memory 27060 MiB 27060 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 293.47 293.81
Y Memory 27460 MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 1510.3 1518.46
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 1349.11 1362.1
Y Memory 24048 MiB 24048 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 386.16 383.73
N Memory 22982 MiB 23036 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 381.29 380.84
Y Memory 24158 MiB 24128 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 1505.41 1472.46
Y Memory 23674 MiB 23660 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 1297.85 1337.31
Y Memory 24844 MiB 24842 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 386.29 383.53
Y Memory 23748 MiB 23778 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 375.53 368.26
N Memory 24878 MiB 24936 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 302.034 300.811
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 4.141 4.107
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 118.901 121.478
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 165.721 172.34
N Memory 4746 MiB 5130 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 1.501 1.487
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g eb628c7(20220503) bc3af66a(20220502)
Y Throughput 93.194 97.794
N Memory 2850 MiB 3106 MiB

@github-actions
Copy link
Author

github-actions bot commented May 7, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0d33e09(20220507) 195162b(20220506)
Y Throughput 318.88 317.13
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0d33e09(20220507) 195162b(20220506)
Y Throughput 1519.96 1517.84
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0d33e09(20220507) 195162b(20220506)
Y Throughput 388.3 389.34
N Memory 22986 MiB 23036 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0d33e09(20220507) 195162b(20220506)
Y Throughput 1484.33 1490.49
Y Memory 23692 MiB 23682 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0d33e09(20220507) 195162b(20220506)
Y Throughput 385.43 388.64
Y Memory 23694 MiB 23718 MiB

@github-actions
Copy link
Author

github-actions bot commented May 8, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 319.17 318.88
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 1520.12 1519.96
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 390.22 388.3
Y Memory 22988 MiB 22986 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 1484.46 1484.33
Y Memory 23670 MiB 23692 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 388.52 385.43
N Memory 23756 MiB 23694 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 301.124 301.532
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 4.096 4.138
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 116.19 118.445
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 167.181 166.579
Y Memory 4746 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 1.54 1.438
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 33e604b9(20220508) 0d33e09(20220507)
Y Throughput 97.485 96.594
Y Memory 3106 MiB 3106 MiB

@github-actions
Copy link
Author

github-actions bot commented May 9, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 4abe359b(20220509) 33e604b9(20220508)
Y Throughput 294.87 294.31
Y Memory 27460 MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 4abe359b(20220509) 33e604b9(20220508)
Y Throughput 1343.72 1357.74
Y Memory 24088 MiB 24050 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 4abe359b(20220509) 33e604b9(20220508)
Y Throughput 380.02 381.18
Y Memory 24126 MiB 24112 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 4abe359b(20220509) 33e604b9(20220508)
Y Throughput 1320.0 1281.44
Y Memory 24832 MiB 24814 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 4abe359b(20220509) 33e604b9(20220508)
Y Throughput 375.29 374.02
N Memory 24830 MiB 24898 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 293.77 294.87
Y Memory 27460 MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 1354.91 1343.72
Y Memory 24048 MiB 24088 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 380.71 380.02
Y Memory 24158 MiB 24126 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 1331.34 1320.0
Y Memory 24826 MiB 24832 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 372.42 375.29
N Memory 24880 MiB 24830 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 41.757 41.9
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 6.76 6.556
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 21.517 21.565
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 21.304 21.71
Y Memory 2909 MiB 2957 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 3.36 3.253
Y Memory 2191 MiB 2191 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 4abe359b(20220510) 4abe359b(20220509)
Y Throughput 12.51 12.149
Y Memory 2579 MiB 2579 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 318.74 318.63
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 1508.99 1524.89
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 386.33 388.8
Y Memory 22984 MiB 22986 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 1482.3 1510.71
Y Memory 23684 MiB 23714 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 385.08 389.59
Y Memory 23750 MiB 23760 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 304.404 300.926
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 4.07 4.064
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 119.617 117.947
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 170.906 167.71
N Memory 4746 MiB 4236 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 1.478 1.517
Y Memory 1478 MiB 1478 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 6421a51(20220511) 4abe359b(20220510)
Y Throughput 93.989 94.695
Y Memory 3106 MiB 3106 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 319.27 318.74
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 1515.18 1508.99
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 388.76 386.33
N Memory 23036 MiB 22984 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 1485.54 1482.3
Y Memory 23682 MiB 23684 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 386.08 385.08
Y Memory 23708 MiB 23750 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 301.62 304.404
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 4.098 4.07
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 119.324 119.617
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 171.799 170.906
Y Memory 4746 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 1.499 1.478
Y Memory 1476 MiB 1478 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2925f00f(20220512) 6421a51(20220511)
Y Throughput 96.298 93.989
Y Memory 3106 MiB 3106 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 319.34 319.27
Y Memory 27060 MiB 27060 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 295.45 294.49
Y Memory 27460 MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 1512.34 1515.18
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 1351.9 1337.23
Y Memory 24090 MiB 24088 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 384.34 388.76
N Memory 22986 MiB 23036 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 379.62 379.67
Y Memory 24148 MiB 24148 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 1484.41 1485.54
Y Memory 23678 MiB 23682 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 1346.38 1342.93
Y Memory 24858 MiB 24818 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 383.69 386.08
Y Memory 23698 MiB 23708 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 370.84 373.44
Y Memory 24874 MiB 24904 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 318.833 301.62
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 40.831 41.966
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 4.314 4.098
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 6.635 6.595
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 137.039 119.324
Y Memory 3550 MiB 3550 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 21.403 21.249
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 158.392 171.799
Y Memory 4746 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 21.326 21.859
Y Memory 2973 MiB 2973 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 1.463 1.499
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 3.299 3.369
Y Memory 2191 MiB 2191 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 8ae6c41(20220513) 2925f00f(20220512)
Y Throughput 84.343 96.298
Y Memory 3106 MiB 3106 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0ad6733(20220513) 2925f00f(20220512)
Y Throughput 12.271 12.459
Y Memory 2547 MiB 2571 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 319.29 319.34
Y Memory 27060 MiB 27060 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 944ad628(20220514) 0ad6733(20220513)
Y Throughput 294.94 295.45
Y Memory 27460 MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 1512.03 1512.34
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 944ad628(20220514) 0ad6733(20220513)
Y Throughput 1340.06 1351.9
Y Memory 24088 MiB 24090 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 392.03 384.34
Y Memory 22982 MiB 22986 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 944ad628(20220514) 0ad6733(20220513)
Y Throughput 378.67 379.62
Y Memory 24144 MiB 24148 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 1503.81 1484.41
Y Memory 23692 MiB 23678 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 944ad628(20220514) 0ad6733(20220513)
Y Throughput 1341.16 1346.38
Y Memory 24846 MiB 24858 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 385.77 383.69
N Memory 23764 MiB 23698 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 944ad628(20220514) 0ad6733(20220513)
Y Throughput 371.38 370.84
Y Memory 24852 MiB 24874 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 301.728 318.833
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 4.148 4.314
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 120.909 137.039
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 170.4 158.392
Y Memory 4746 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 1.506 1.463
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 944ad628(20220514) 8ae6c41(20220513)
Y Throughput 97.99 84.343
N Memory 3042 MiB 3106 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 319.08 319.29
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 1509.87 1512.03
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 389.5 392.03
Y Memory 22986 MiB 22982 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 1510.65 1503.81
Y Memory 23688 MiB 23692 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 389.6 385.77
N Memory 23708 MiB 23764 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 300.922 301.728
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 4.082 4.148
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 118.528 120.909
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 166.115 170.4
Y Memory 4746 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 1.497 1.506
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 3042749(20220515) 944ad628(20220514)
Y Throughput 96.59 97.99
N Memory 3106 MiB 3042 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 318.83 319.08
Y Memory 27060 MiB 27060 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 1519.44 1509.87
Y Memory 22906 MiB 22906 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 387.26 389.5
Y Memory 22984 MiB 22986 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 1493.92 1510.65
Y Memory 23704 MiB 23688 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 383.87 389.6
N Memory 23788 MiB 23708 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 301.2 300.922
Y Memory 5424 MiB 5424 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 4.154 4.082
Y Memory 1834 MiB 1834 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 117.789 118.528
Y Memory 3550 MiB 3550 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 166.574 166.115
N Memory 4236 MiB 4746 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 1.519 1.497
Y Memory 1476 MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 4787170d0(20220516) 3042749(20220515)
Y Throughput 94.698 96.59
Y Memory 3106 MiB 3106 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g cdf34dbc2(20220517) 5e6451ca7(20220516)
N Throughput 0 293.95
N Memory None MiB 27460 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g cdf34dbc2(20220517) 5e6451ca7(20220516)
N Throughput 0 1349.26
N Memory None MiB 24068 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g cdf34dbc2(20220517) 5e6451ca7(20220516)
N Throughput 0 378.38
N Memory None MiB 24160 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g cdf34dbc2(20220517) 5e6451ca7(20220516)
N Throughput 0 1346.04
N Memory None MiB 24890 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g cdf34dbc2(20220517) 5e6451ca7(20220516)
N Throughput 0 373.54
N Memory None MiB 24920 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g a2145c727(20220517) 4787170d0(20220516)
N Throughput 0 166.574
N Memory None MiB 4236 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g a2145c727(20220517) 4787170d0(20220516)
Y Throughput 0 1.519
N Memory None MiB 1476 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g a2145c727(20220517) 4787170d0(20220516)
N Throughput 0 94.698
N Memory None MiB 3106 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 318.33 321.87
Y Memory 27066 MiB 27066 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 1509.46 1540.91
Y Memory 22912 MiB 22912 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 387.77 394.09
Y Memory 23014 MiB 23038 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 1496.67 1520.75
Y Memory 23700 MiB 23694 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 385.71 395.84
Y Memory 23746 MiB 23724 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 309.593 312.148
Y Memory 5430 MiB 5430 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 4.202 4.187
Y Memory 1840 MiB 1840 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 129.661 130.221
Y Memory 3556 MiB 3556 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 165.803 153.164
Y Memory 4752 MiB 4752 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 1.458 1.455
Y Memory 1482 MiB 1482 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 38b6495(20220521) ad9aa8c(20220520)
Y Throughput 85.308 80.483
N Memory 3112 MiB 3048 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 318.75 318.33
Y Memory 27066 MiB 27066 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 7476de9(20220522) 38b6495(20220521)
Y Throughput 293.8 294.51
Y Memory 27466 MiB 27466 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 1517.78 1509.46
Y Memory 22912 MiB 22912 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 7476de9(20220522) 38b6495(20220521)
Y Throughput 1352.13 1343.25
Y Memory 24074 MiB 24074 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 387.46 387.77
Y Memory 22990 MiB 23014 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 7476de9(20220522) 38b6495(20220521)
Y Throughput 380.18 380.24
Y Memory 24148 MiB 24190 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 1490.34 1496.67
Y Memory 23688 MiB 23700 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 7476de9(20220522) 38b6495(20220521)
Y Throughput 1340.98 1354.03
Y Memory 24878 MiB 24846 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 387.15 385.71
Y Memory 23726 MiB 23746 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 7476de9(20220522) 38b6495(20220521)
Y Throughput 375.24 371.25
Y Memory 24912 MiB 24890 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 302.327 309.593
Y Memory 5430 MiB 5430 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 4.156 4.202
Y Memory 1840 MiB 1840 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 119.752 129.661
Y Memory 3556 MiB 3556 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 167.894 165.803
Y Memory 4752 MiB 4752 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 1.424 1.458
Y Memory 1484 MiB 1482 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0afc09f(20220522) 38b6495(20220521)
Y Throughput 89.498 85.308
Y Memory 3112 MiB 3112 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 318.9 318.75
Y Memory 27066 MiB 27066 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 7476de9(20220523) 7476de9(20220522)
Y Throughput 293.36 293.8
Y Memory 27466 MiB 27466 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 1510.76 1517.78
Y Memory 22912 MiB 22912 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 7476de9(20220523) 7476de9(20220522)
Y Throughput 1337.78 1352.13
Y Memory 24074 MiB 24074 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 387.92 387.46
N Memory 23042 MiB 22990 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 7476de9(20220523) 7476de9(20220522)
Y Throughput 378.68 380.18
Y Memory 24154 MiB 24148 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 1496.37 1490.34
Y Memory 23702 MiB 23688 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 7476de9(20220523) 7476de9(20220522)
Y Throughput 1352.92 1340.98
Y Memory 24842 MiB 24878 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 387.02 387.15
Y Memory 23716 MiB 23726 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 7476de9(20220523) 7476de9(20220522)
Y Throughput 367.8 375.24
Y Memory 24900 MiB 24912 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 304.22 302.327
Y Memory 5430 MiB 5430 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 4.146 4.156
Y Memory 1840 MiB 1840 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 120.272 119.752
Y Memory 3556 MiB 3556 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 168.918 167.894
Y Memory 4752 MiB 4752 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 1.51 1.424
Y Memory 1482 MiB 1484 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 7476de9(20220523) 0afc09f(20220522)
Y Throughput 94.299 89.498
N Memory 2856 MiB 3112 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 318.91 318.01
Y Memory 27066 MiB 27066 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 1508.85 1520.92
Y Memory 22912 MiB 22912 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 390.03 387.07
Y Memory 23018 MiB 23066 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 1498.06 1504.9
Y Memory 23690 MiB 23690 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 391.05 387.3
Y Memory 23740 MiB 23712 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 300.898 304.905
Y Memory 5430 MiB 5430 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 4.12 4.051
Y Memory 1840 MiB 1840 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 120.549 127.475
Y Memory 3556 MiB 3556 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 167.498 168.931
Y Memory 4752 MiB 4752 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 1.492 1.492
Y Memory 1482 MiB 1482 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g a447420(20220527) 3bf33ad(20220526)
Y Throughput 93.0 90.501
N Memory 3112 MiB 2856 MiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants