Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

202203_OneFlow_Compare_Master_DLPerf_Test_Result #19

Open
github-actions bot opened this issue Mar 2, 2022 · 26 comments
Open

202203_OneFlow_Compare_Master_DLPerf_Test_Result #19

github-actions bot opened this issue Mar 2, 2022 · 26 comments

Comments

@github-actions
Copy link

github-actions bot commented Mar 2, 2022

202203_OneFlow_Compare_Master_DLPerf_Test_Result
@github-actions
Copy link
Author

github-actions bot commented Mar 2, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 323.85 333.47
Y Memory 26916 MiB 26916 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 291.19 292.01
Y Memory 27348 MiB 27348 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 1361.54 1408.41
Y Memory 22984 MiB 22984 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 1160.45 1168.34
N Memory 24062 MiB 24122 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 399.15 405.52
N Memory 23128 MiB 23072 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 373.45 375.19
N Memory 24242 MiB 24186 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 1397.88 1433.85
Y Memory 23748 MiB 23770 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 1315.39 1278.57
Y Memory 24846 MiB 24892 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 394.52 401.37
Y Memory 23846 MiB 23854 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 381.16 380.99
N Memory 24904 MiB 24848 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 1413.076 1442.363
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 11015.689 10967.812
Y Memory 23720 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 385.16 392.874
Y Memory 22782 MiB 22752 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 3036.189 3039.35
Y Memory 23308 MiB 23332 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 1404.854 1442.12
Y Memory 23888 MiB 23878 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 0799967(20220302) 0e930ab(20220301)
N Throughput 10764.059 10509.082
Y Memory 24502 MiB 24496 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 382.429 390.672
Y Memory 23460 MiB 23426 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 0799967(20220302) 0e930ab(20220301)
Y Throughput 2976.729 2975.573
Y Memory 24046 MiB 24054 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 303.038 301.342
Y Memory 5530 MiB 5530 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 41.336 41.697
Y Memory 2804 MiB 2804 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 4.081 4.082
Y Memory 1922 MiB 1922 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 6.503 6.381
Y Memory 2336 MiB 2336 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 121.407 120.97
Y Memory 3656 MiB 3656 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 21.402 21.38
Y Memory 2574 MiB 2574 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 175.712 173.184
N Memory 4914 MiB 4404 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 21.359 21.386
N Memory 2849 MiB 2913 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 1.592 1.536
Y Memory 1644 MiB 1644 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 3.016 2.934
Y Memory 2131 MiB 2131 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0799967(20220302) b769add(20220301)
Y Throughput 98.596 94.993
Y Memory 3274 MiB 3274 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g bc2a158(20220302) 0e930ab(20220301)
Y Throughput 12.284 12.059
Y Memory 2519 MiB 2519 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 3, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 330.55 323.85
Y Memory 26916 MiB 26916 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 59b40b9(20220303) 0799967(20220302)
Y Throughput 291.73 291.19
Y Memory 27348 MiB 27348 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 1408.04 1361.54
Y Memory 22984 MiB 22984 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 59b40b9(20220303) 0799967(20220302)
N Throughput 699.35 1160.45
Y Memory 24082 MiB 24062 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 405.97 399.15
Y Memory 23116 MiB 23128 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 59b40b9(20220303) 0799967(20220302)
Y Throughput 371.02 373.45
Y Memory 24214 MiB 24242 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 1434.9 1397.88
Y Memory 23762 MiB 23748 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 59b40b9(20220303) 0799967(20220302)
N Throughput 0 1315.39
N Memory None MiB 24846 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 404.51 394.52
Y Memory 23874 MiB 23846 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 59b40b9(20220303) 0799967(20220302)
N Throughput 0 381.16
N Memory None MiB 24904 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 1435.946 1413.076
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 59b40b9(20220303) 0799967(20220302)
N Throughput 11073.852 11015.689
Y Memory 23720 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 392.839 385.16
Y Memory 22776 MiB 22782 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 59b40b9(20220303) 0799967(20220302)
Y Throughput 3038.091 3036.189
Y Memory 23260 MiB 23308 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 1443.449 1404.854
Y Memory 23928 MiB 23888 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 59b40b9(20220303) 0799967(20220302)
N Throughput 10594.144 10764.059
Y Memory 24514 MiB 24502 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 390.786 382.429
Y Memory 23450 MiB 23460 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 59b40b9(20220303) 0799967(20220302)
Y Throughput 2991.026 2976.729
Y Memory 24004 MiB 24046 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 302.416 303.038
Y Memory 5530 MiB 5530 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 4.074 4.081
Y Memory 1922 MiB 1922 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 115.926 121.407
Y Memory 3656 MiB 3656 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 178.335 175.712
N Memory 4404 MiB 4914 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 1.595 1.592
Y Memory 1644 MiB 1644 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 59b40b9(20220303) 0799967(20220302)
Y Throughput 99.997 98.596
N Memory 3018 MiB 3274 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 4, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 329.49 330.55
Y Memory 26918 MiB 26916 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 291.07 291.73
Y Memory 27350 MiB 27348 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 1406.09 1408.04
Y Memory 22986 MiB 22984 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 678.52 699.35
Y Memory 24084 MiB 24082 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 405.78 405.97
Y Memory 23142 MiB 23116 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 368.13 371.02
Y Memory 24206 MiB 24214 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 1416.14 1434.9
Y Memory 23750 MiB 23762 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 0 0
N Memory None MiB None MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 402.67 404.51
N Memory 23802 MiB 23874 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 0 0
N Memory None MiB None MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 1418.704 1435.946
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 11034.553 11073.852
Y Memory 23720 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 393.389 392.839
Y Memory 22748 MiB 22776 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 3031.699 3038.091
Y Memory 23272 MiB 23260 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 1434.54 1443.449
Y Memory 23902 MiB 23928 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g f98e143(20220304) 59b40b9(20220303)
N Throughput 10422.073 10594.144
Y Memory 24502 MiB 24514 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 390.4 390.786
Y Memory 23424 MiB 23450 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g f98e143(20220304) 59b40b9(20220303)
Y Throughput 3003.858 2991.026
Y Memory 23974 MiB 24004 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 302.317 302.416
Y Memory 5532 MiB 5530 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 4.123 4.074
Y Memory 1924 MiB 1922 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 121.655 115.926
Y Memory 3658 MiB 3656 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 175.941 178.335
N Memory 4916 MiB 4404 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 1.461 1.595
Y Memory 1648 MiB 1644 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f98e143(20220304) 59b40b9(20220303)
Y Throughput 95.087 99.997
N Memory 3276 MiB 3018 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 5, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 325.23 329.49
Y Memory 26918 MiB 26918 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 290.79 291.07
Y Memory 27350 MiB 27350 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 1383.28 1406.09
Y Memory 22986 MiB 22986 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 674.36 678.52
Y Memory 24084 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 400.59 405.78
Y Memory 23144 MiB 23142 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 364.23 368.13
Y Memory 24196 MiB 24206 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 1413.1 1416.14
Y Memory 23744 MiB 23750 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 0 0
N Memory None MiB None MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 399.05 402.67
Y Memory 23838 MiB 23802 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 0 0
N Memory None MiB None MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 1444.211 1418.704
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 952e06f(20220305) f98e143(20220304)
N Throughput 10977.762 11034.553
Y Memory 23722 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 391.443 393.389
Y Memory 22756 MiB 22748 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 3036.545 3031.699
Y Memory 23260 MiB 23272 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 1432.202 1434.54
Y Memory 23918 MiB 23902 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 952e06f(20220305) f98e143(20220304)
N Throughput 10680.286 10422.073
Y Memory 24490 MiB 24502 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 388.682 390.4
Y Memory 23400 MiB 23424 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 3000.611 3003.858
Y Memory 24002 MiB 23974 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 300.933 302.317
Y Memory 5532 MiB 5532 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 40.701 41.352
Y Memory 2806 MiB 2806 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 4.057 4.123
Y Memory 1924 MiB 1924 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 6.413 6.491
Y Memory 2338 MiB 2338 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 119.277 121.655
Y Memory 3658 MiB 3658 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 20.946 21.712
Y Memory 2576 MiB 2576 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 173.88 175.941
N Memory 4406 MiB 4916 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 34.413 32.708
Y Memory 2897 MiB 2849 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 1.567 1.461
Y Memory 1646 MiB 1648 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 3.165 3.205
Y Memory 2133 MiB 2133 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 952e06f(20220305) f98e143(20220304)
Y Throughput 93.717 95.087
Y Memory 3276 MiB 3276 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 952e06f(20220305) f98e143(20220304)
Y Throughput 17.744 18.708
Y Memory 2487 MiB 2519 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 6, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 323.47 325.23
Y Memory 26918 MiB 26918 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 289.98 290.79
Y Memory 27350 MiB 27350 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 1372.34 1383.28
Y Memory 22986 MiB 22986 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g afd568f(20220306) 952e06f(20220305)
N Throughput 1083.64 674.36
Y Memory 24066 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 396.48 400.59
N Memory 23080 MiB 23144 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 373.33 364.23
N Memory 24134 MiB 24196 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 1408.5 1413.1
Y Memory 23742 MiB 23744 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g afd568f(20220306) 952e06f(20220305)
N Throughput 1328.6 0
N Memory 24892 MiB None MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 394.66 399.05
Y Memory 23816 MiB 23838 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g afd568f(20220306) 952e06f(20220305)
N Throughput 373.91 0
N Memory 24924 MiB None MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 1440.649 1444.211
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 10963.874 10977.762
Y Memory 23720 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 383.431 391.443
N Memory 22698 MiB 22756 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 3034.997 3036.545
Y Memory 23284 MiB 23260 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 1406.552 1432.202
Y Memory 23894 MiB 23918 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g afd568f(20220306) 952e06f(20220305)
N Throughput 10621.911 10680.286
Y Memory 24484 MiB 24490 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 381.234 388.682
Y Memory 23426 MiB 23400 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 2968.907 3000.611
Y Memory 24032 MiB 24002 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 301.006 300.933
Y Memory 5532 MiB 5532 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 41.516 40.701
Y Memory 2806 MiB 2806 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 4.091 4.057
Y Memory 1924 MiB 1924 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 6.492 6.413
Y Memory 2338 MiB 2338 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 119.799 119.277
Y Memory 3658 MiB 3658 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 21.505 20.946
Y Memory 2576 MiB 2576 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 175.598 173.88
N Memory 4916 MiB 4406 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 21.887 34.413
Y Memory 2915 MiB 2897 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 1.579 1.567
Y Memory 1646 MiB 1646 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 2.987 3.165
Y Memory 2133 MiB 2133 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g afd568f(20220306) 952e06f(20220305)
Y Throughput 99.786 93.717
N Memory 3212 MiB 3276 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g afd568f(20220306) 952e06f(20220305)
Y Throughput 12.351 17.744
Y Memory 2521 MiB 2487 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 7, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 327.54 323.47
Y Memory 26922 MiB 26918 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 290.9 289.98
Y Memory 27356 MiB 27350 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 1391.94 1372.34
Y Memory 22992 MiB 22986 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
N Throughput 1170.79 1083.64
Y Memory 24068 MiB 24066 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 400.62 396.48
Y Memory 23078 MiB 23080 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 375.34 373.33
Y Memory 24140 MiB 24134 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 1419.23 1408.5
Y Memory 23778 MiB 23742 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
N Throughput 1273.58 1328.6
Y Memory 24844 MiB 24892 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 398.97 394.66
Y Memory 23810 MiB 23816 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 380.82 373.91
Y Memory 24944 MiB 24924 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 1423.954 1440.649
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 10952.26 10963.874
Y Memory 23722 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 391.363 383.431
N Memory 22756 MiB 22698 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 3033.521 3034.997
Y Memory 23280 MiB 23284 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 1423.063 1406.552
Y Memory 23922 MiB 23894 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 10670.743 10621.911
Y Memory 24494 MiB 24484 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 387.57 381.234
Y Memory 23454 MiB 23426 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 2944.978 2968.907
Y Memory 24042 MiB 24032 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 300.881 301.006
Y Memory 5538 MiB 5532 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 40.895 41.516
Y Memory 2812 MiB 2806 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 3.925 4.091
Y Memory 1930 MiB 1924 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 6.498 6.492
Y Memory 2344 MiB 2338 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 122.603 119.799
Y Memory 3664 MiB 3658 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 21.62 21.505
Y Memory 2582 MiB 2576 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 31bb9f1(20220307) afd568f(20220306)
N Throughput 0 175.598
N Memory None MiB 4916 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 0 21.887
N Memory None MiB 2915 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 0 1.579
N Memory None MiB 1646 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 0 2.987
N Memory None MiB 2133 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 31bb9f1(20220307) afd568f(20220306)
N Throughput 0 99.786
N Memory None MiB 3212 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 31bb9f1(20220307) afd568f(20220306)
Y Throughput 0 12.351
N Memory None MiB 2521 MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 8, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 325.01 327.54
Y Memory 26934 MiB 26922 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 290.22 290.9
Y Memory 27368 MiB 27356 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1402.75 1391.94
Y Memory 23004 MiB 22992 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1180.79 1170.79
Y Memory 24100 MiB 24068 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 400.94 400.62
Y Memory 23102 MiB 23078 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 376.99 375.34
N Memory 24212 MiB 24140 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1426.55 1419.23
Y Memory 23774 MiB 23778 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1313.52 1273.58
N Memory 24918 MiB 24844 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 399.66 398.97
Y Memory 23814 MiB 23810 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 380.48 380.82
Y Memory 24930 MiB 24944 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1429.309 1423.954
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 10964.334 10952.26
Y Memory 23722 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 390.194 391.363
N Memory 22696 MiB 22756 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 3038.909 3033.521
Y Memory 23280 MiB 23280 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 1417.199 1423.063
Y Memory 23902 MiB 23922 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 10641.573 10670.743
Y Memory 24494 MiB 24494 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 390.584 387.57
Y Memory 23454 MiB 23454 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 687dcdd(20220308) 31bb9f1(20220307)
N Throughput 3012.314 2944.978
Y Memory 24030 MiB 24042 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 302.9 300.881
Y Memory 5550 MiB 5538 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 41.754 40.895
Y Memory 2824 MiB 2812 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 4.075 3.925
Y Memory 1942 MiB 1930 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 6.557 6.498
Y Memory 2356 MiB 2344 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 116.876 122.603
Y Memory 3676 MiB 3664 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 21.556 21.62
Y Memory 2594 MiB 2582 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 687dcdd(20220308) 31bb9f1(20220307)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

github-actions bot commented Mar 9, 2022

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 327.71 325.01
Y Memory 26936 MiB 26934 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 288.83 290.22
Y Memory 27368 MiB 27368 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1416.71 1402.75
Y Memory 23004 MiB 23004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1205.64 1180.79
Y Memory 24080 MiB 24100 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 405.0 400.94
Y Memory 23094 MiB 23102 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 384.76 376.99
N Memory 24158 MiB 24212 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1429.49 1426.55
Y Memory 23784 MiB 23774 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1319.27 1313.52
Y Memory 24896 MiB 24918 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 402.17 399.66
N Memory 23876 MiB 23814 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 380.44 380.48
Y Memory 24964 MiB 24930 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1440.353 1429.309
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 10926.907 10964.334
Y Memory 23722 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 392.944 390.194
Y Memory 22696 MiB 22696 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 3038.458 3038.909
Y Memory 23270 MiB 23280 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 1427.933 1417.199
Y Memory 23882 MiB 23902 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
N Throughput 10518.548 10641.573
Y Memory 24486 MiB 24494 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 389.653 390.584
Y Memory 23480 MiB 23454 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 3005.384 3012.314
N Memory 24096 MiB 24030 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 301.93 302.9
Y Memory 5550 MiB 5550 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 42.141 41.754
Y Memory 2824 MiB 2824 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 4.05 4.075
Y Memory 1942 MiB 1942 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 6.642 6.557
Y Memory 2356 MiB 2356 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 119.319 116.876
Y Memory 3676 MiB 3676 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 21.957 21.556
Y Memory 2594 MiB 2594 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g f2c4d41(20220309) 687dcdd(20220308)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 349.07 327.71
Y Memory 26936 MiB 26936 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 314.59 288.83
Y Memory 27368 MiB 27368 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 1462.3 1416.71
Y Memory 23002 MiB 23004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g a81140c(20220310) f2c4d41(20220309)
N Throughput 1296.05 1205.64
Y Memory 24080 MiB 24080 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 396.58 405.0
Y Memory 23094 MiB 23094 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 388.27 384.76
Y Memory 24194 MiB 24158 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 1415.19 1429.49
Y Memory 23792 MiB 23784 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 1325.82 1319.27
Y Memory 24892 MiB 24896 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 396.23 402.17
Y Memory 23886 MiB 23876 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 380.8 380.44
Y Memory 24922 MiB 24964 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 1422.741 1440.353
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 10912.442 10926.907
Y Memory 23722 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 385.899 392.944
N Memory 22748 MiB 22696 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 3038.379 3038.458
Y Memory 23284 MiB 23270 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 1425.776 1427.933
Y Memory 23912 MiB 23882 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g a81140c(20220310) f2c4d41(20220309)
N Throughput 10590.304 10518.548
Y Memory 24520 MiB 24486 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 384.063 389.653
Y Memory 23448 MiB 23480 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 2994.398 3005.384
N Memory 24042 MiB 24096 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 301.108 301.93
Y Memory 5550 MiB 5550 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 41.825 42.141
Y Memory 2824 MiB 2824 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 4.077 4.05
Y Memory 1942 MiB 1942 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 6.47 6.642
Y Memory 2356 MiB 2356 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 118.493 119.319
Y Memory 3676 MiB 3676 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 21.202 21.957
Y Memory 2594 MiB 2594 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g a81140c(20220310) f2c4d41(20220309)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 301.615 301.108
N Memory 5388 MiB 5550 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 42.549 41.825
N Memory 2662 MiB 2824 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 4.074 4.077
N Memory 1798 MiB 1942 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 6.494 6.47
N Memory 2212 MiB 2356 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 115.333 118.493
N Memory 3514 MiB 3676 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 21.25 21.202
N Memory 2432 MiB 2594 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 277e7a3(20220311) a81140c(20220310)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 301.817 301.615
Y Memory 5388 MiB 5388 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 41.399 42.549
Y Memory 2662 MiB 2662 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 4.084 4.074
Y Memory 1798 MiB 1798 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 6.474 6.494
Y Memory 2212 MiB 2212 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 120.047 115.333
Y Memory 3514 MiB 3514 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 21.689 21.25
Y Memory 2432 MiB 2432 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g bada333(20220312) 277e7a3(20220311)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 347.82 346.02
Y Memory 26938 MiB 26936 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 316.3 311.85
Y Memory 27370 MiB 27368 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 1487.51 1479.17
Y Memory 23006 MiB 23004 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 1321.88 1302.63
Y Memory 24126 MiB 24122 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 400.3 398.85
Y Memory 23134 MiB 23148 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 388.22 389.12
Y Memory 24214 MiB 24192 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 1419.66 1427.24
Y Memory 23772 MiB 23806 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 1344.96 1345.0
Y Memory 24908 MiB 24912 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 398.73 395.0
N Memory 23874 MiB 23814 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 382.52 383.35
N Memory 24892 MiB 24968 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 1431.12 1415.157
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 1c48559(20220313) bada333(20220312)
N Throughput 11010.022 10765.699
Y Memory 23722 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 390.584 386.615
Y Memory 22748 MiB 22772 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 3035.369 3031.407
N Memory 23258 MiB 23318 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 1420.126 1412.691
Y Memory 23928 MiB 23912 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 1c48559(20220313) bada333(20220312)
N Throughput 10441.406 10727.877
Y Memory 24500 MiB 24510 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 387.507 384.089
Y Memory 23470 MiB 23468 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 3004.745 3001.736
Y Memory 24032 MiB 24054 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 303.956 301.817
Y Memory 5390 MiB 5388 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 40.899 41.399
Y Memory 2664 MiB 2662 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 4.074 4.084
Y Memory 1800 MiB 1798 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 6.49 6.474
Y Memory 2214 MiB 2212 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 117.543 120.047
Y Memory 3516 MiB 3514 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 21.287 21.689
Y Memory 2434 MiB 2432 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 1c48559(20220313) bada333(20220312)
Y Throughput 0 0
N Memory None MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 344.87 347.82
Y Memory 26938 MiB 26938 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 1467.12 1487.51
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 395.07 400.3
Y Memory 23098 MiB 23134 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 1389.13 1419.66
Y Memory 23796 MiB 23772 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 394.13 398.73
Y Memory 23904 MiB 23874 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 1428.364 1431.12
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 381.054 390.584
Y Memory 22772 MiB 22748 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 1390.417 1420.126
Y Memory 23928 MiB 23928 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 379.291 387.507
Y Memory 23482 MiB 23470 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 305.742 303.956
Y Memory 5390 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 4.301 4.074
Y Memory 1800 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 127.911 117.543
Y Memory 3516 MiB 3516 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g e3a35be(20220314) 1c48559(20220313)
N Throughput 158.282 0
N Memory 4266 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g e3a35be(20220314) 1c48559(20220313)
Y Throughput 1.457 0
N Memory 1508 MiB None MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g e3a35be(20220314) 1c48559(20220313)
N Throughput 84.597 0
N Memory 3136 MiB None MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 355.56 344.87
Y Memory 26938 MiB 26938 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 1473.46 1467.12
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 405.67 395.07
N Memory 23150 MiB 23098 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 1438.79 1389.13
Y Memory 23794 MiB 23796 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 402.35 394.13
N Memory 23810 MiB 23904 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 1449.743 1428.364
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 392.646 381.054
N Memory 22720 MiB 22772 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 1433.078 1390.417
N Memory 23878 MiB 23928 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 391.018 379.291
Y Memory 23468 MiB 23482 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 302.855 305.742
Y Memory 5390 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 4.082 4.301
Y Memory 1800 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 118.307 127.911
Y Memory 3516 MiB 3516 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 173.931 158.282
Y Memory 4266 MiB 4266 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 1.583 1.457
Y Memory 1508 MiB 1508 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 927e05b(20220315) e3a35be(20220314)
Y Throughput 98.796 84.597
N Memory 3072 MiB 3136 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 346.87 355.56
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 314.87 313.29
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 1479.85 1473.46
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 1318.47 1309.79
Y Memory 24084 MiB 24124 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 395.2 405.67
Y Memory 23102 MiB 23150 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 388.73 389.08
Y Memory 24174 MiB 24196 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 1408.89 1438.79
Y Memory 23800 MiB 23794 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 1282.44 1282.85
Y Memory 24900 MiB 24914 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 395.7 402.35
N Memory 23884 MiB 23810 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 380.45 381.76
N Memory 24990 MiB 24900 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 1407.69 1449.743
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 09bbafe(20220316) 927e05b(20220315)
N Throughput 10989.743 10825.055
Y Memory 23722 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 382.814 392.646
Y Memory 22698 MiB 22720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 3022.653 3033.444
Y Memory 23304 MiB 23322 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 1411.582 1433.078
Y Memory 23896 MiB 23878 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 09bbafe(20220316) 927e05b(20220315)
N Throughput 11000.238 10431.883
Y Memory 24502 MiB 24500 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 380.636 391.018
Y Memory 23482 MiB 23468 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 09bbafe(20220316) 927e05b(20220315)
Y Throughput 2995.667 2985.043
Y Memory 24006 MiB 24040 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 302.521 302.855
Y Memory 5390 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 40.758 42.018
Y Memory 2664 MiB 2664 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 3.922 4.082
Y Memory 1800 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 6.551 6.475
Y Memory 2214 MiB 2214 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 117.965 118.307
Y Memory 3516 MiB 3516 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 21.672 21.529
Y Memory 2434 MiB 2434 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 174.495 173.931
N Memory 4776 MiB 4266 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 21.699 21.65
Y Memory 2901 MiB 2917 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 1.467 1.583
Y Memory 1506 MiB 1508 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 2.753 2.742
Y Memory 2135 MiB 2135 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 66e1957(20220316) 927e05b(20220315)
Y Throughput 96.292 98.796
N Memory 3136 MiB 3072 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 66e1957(20220316) 927e05b(20220315)
Y Throughput 12.121 12.386
Y Memory 2491 MiB 2491 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 347.38 346.87
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 314.47 314.87
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 1455.25 1479.85
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 1300.31 1318.47
N Memory 24146 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 398.52 395.2
Y Memory 23094 MiB 23102 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 388.93 388.73
N Memory 24268 MiB 24174 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 1417.92 1408.89
Y Memory 23816 MiB 23800 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 70270a21e(20220317) 09bbafe(20220316)
N Throughput 1341.34 1282.44
Y Memory 24904 MiB 24900 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 397.15 395.7
Y Memory 23880 MiB 23884 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 382.02 380.45
N Memory 24892 MiB 24990 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 1413.811 1407.69
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 70270a21e(20220317) 09bbafe(20220316)
N Throughput 10925.244 10989.743
Y Memory 23722 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 385.076 382.814
N Memory 22748 MiB 22698 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 3035.195 3022.653
Y Memory 23308 MiB 23304 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 1413.618 1411.582
Y Memory 23888 MiB 23896 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 70270a21e(20220317) 09bbafe(20220316)
N Throughput 10719.885 11000.238
Y Memory 24540 MiB 24502 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 381.855 380.636
Y Memory 23462 MiB 23482 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 70270a21e(20220317) 09bbafe(20220316)
Y Throughput 2986.521 2995.667
Y Memory 24044 MiB 24006 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 302.135 302.521
Y Memory 5390 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 42.246 40.758
Y Memory 2664 MiB 2664 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 4.073 3.922
Y Memory 1800 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 6.514 6.551
Y Memory 2214 MiB 2214 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 120.727 117.965
Y Memory 3516 MiB 3516 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 20.52 21.672
Y Memory 2434 MiB 2434 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 173.511 174.495
N Memory 4266 MiB 4776 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 21.836 21.699
Y Memory 2853 MiB 2901 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 1.562 1.467
Y Memory 1506 MiB 1506 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 2.744 2.753
Y Memory 2135 MiB 2135 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 91.302 96.292
N Memory 2880 MiB 3136 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 70270a21e(20220317) 66e1957(20220316)
Y Throughput 12.312 12.121
Y Memory 2523 MiB 2491 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 357.21 347.38
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 314.07 314.47
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1485.51 1455.25
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1316.98 1300.31
Y Memory 24124 MiB 24146 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 405.78 398.52
Y Memory 23100 MiB 23094 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 388.07 388.93
N Memory 24204 MiB 24268 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1425.29 1417.92
Y Memory 23806 MiB 23816 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
N Throughput 1288.06 1341.34
N Memory 24840 MiB 24904 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 403.14 397.15
Y Memory 23866 MiB 23880 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 378.51 382.02
N Memory 24998 MiB 24892 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1453.927 1413.811
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 10877.477 10925.244
Y Memory 23720 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 391.443 385.076
Y Memory 22772 MiB 22748 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 3040.553 3035.195
Y Memory 23280 MiB 23308 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1437.011 1413.618
Y Memory 23904 MiB 23888 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
N Throughput 10600.176 10719.885
Y Memory 24514 MiB 24540 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 391.823 381.855
Y Memory 23420 MiB 23462 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 2959.605 2986.521
Y Memory 24036 MiB 24044 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 303.741 302.135
Y Memory 5390 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 40.745 42.246
Y Memory 2664 MiB 2664 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 4.041 4.073
Y Memory 1800 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 6.443 6.514
Y Memory 2214 MiB 2214 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 114.96 120.727
Y Memory 3516 MiB 3516 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 21.362 20.52
Y Memory 2434 MiB 2434 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 182.225 173.511
N Memory 4776 MiB 4266 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 21.835 21.836
N Memory 2917 MiB 2853 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 1.518 1.562
Y Memory 1506 MiB 1506 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 2.663 2.744
Y Memory 2135 MiB 2135 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 99.596 91.302
Y Memory 2880 MiB 2880 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g d73fb1bad(20220318) 70270a21e(20220317)
Y Throughput 12.097 12.312
Y Memory 2491 MiB 2523 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 348.7 357.21
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 319.05 314.07
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1474.63 1485.51
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1322.6 1316.98
Y Memory 24124 MiB 24124 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 401.0 405.78
Y Memory 23120 MiB 23100 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 389.31 388.07
Y Memory 24210 MiB 24204 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1405.82 1425.29
Y Memory 23772 MiB 23806 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
N Throughput 1349.36 1288.06
Y Memory 24850 MiB 24840 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 398.57 403.14
Y Memory 23862 MiB 23866 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 384.07 378.51
N Memory 24946 MiB 24998 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1419.515 1453.927
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
N Throughput 10977.943 10877.477
Y Memory 23722 MiB 23720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 389.547 391.443
Y Memory 22752 MiB 22772 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 3038.208 3040.553
Y Memory 23308 MiB 23280 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1421.643 1437.011
Y Memory 23892 MiB 23904 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
N Throughput 10477.691 10600.176
Y Memory 24500 MiB 24514 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 388.21 391.823
Y Memory 23444 MiB 23420 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 2986.072 2959.605
Y Memory 24010 MiB 24036 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 305.695 303.741
Y Memory 5392 MiB 5390 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 41.678 40.745
Y Memory 2666 MiB 2664 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 4.028 4.041
Y Memory 1802 MiB 1800 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 6.506 6.443
Y Memory 2216 MiB 2214 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 121.415 114.96
Y Memory 3518 MiB 3516 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 21.043 21.362
Y Memory 2436 MiB 2434 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 177.213 182.225
Y Memory 4778 MiB 4776 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 21.693 21.835
Y Memory 2919 MiB 2917 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 1.528 1.518
Y Memory 1508 MiB 1506 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 2.686 2.663
Y Memory 2137 MiB 2135 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 98.677 99.596
N Memory 3138 MiB 2880 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 2ccb633(20220319) d73fb1bad(20220318)
Y Throughput 12.088 12.097
Y Memory 2525 MiB 2491 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 345.04 348.7
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 316.73 319.05
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1474.73 1474.63
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1323.59 1322.6
Y Memory 24104 MiB 24124 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 394.08 401.0
Y Memory 23158 MiB 23120 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 389.81 389.31
N Memory 24156 MiB 24210 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1414.21 1405.82
Y Memory 23768 MiB 23772 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1351.07 1349.36
Y Memory 24882 MiB 24850 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 394.55 398.57
Y Memory 23874 MiB 23862 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 382.89 384.07
Y Memory 24902 MiB 24946 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1429.564 1419.515
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
N Throughput 10870.208 10977.943
Y Memory 23724 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 383.944 389.547
Y Memory 22720 MiB 22752 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 3035.012 3038.208
Y Memory 23282 MiB 23308 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1419.512 1421.643
Y Memory 23908 MiB 23892 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
N Throughput 10562.453 10477.691
Y Memory 24492 MiB 24500 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 382.741 388.21
Y Memory 23436 MiB 23444 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 2990.565 2986.072
Y Memory 23984 MiB 24010 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 301.313 305.695
Y Memory 5392 MiB 5392 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 41.407 41.678
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 4.111 4.028
Y Memory 1802 MiB 1802 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 6.624 6.506
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 118.747 121.415
Y Memory 3518 MiB 3518 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 21.616 21.043
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 177.6 177.213
Y Memory 4778 MiB 4778 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 21.003 21.693
Y Memory 2919 MiB 2919 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 1.512 1.528
Y Memory 1510 MiB 1508 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 2.808 2.686
Y Memory 2137 MiB 2137 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 99.308 98.677
N Memory 3074 MiB 3138 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g f67aafb(20220320) 2ccb633(20220319)
Y Throughput 12.129 12.088
Y Memory 2493 MiB 2525 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 345.86 345.04
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 318.35 316.73
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 1455.79 1474.73
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 1317.7 1323.59
Y Memory 24084 MiB 24104 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 396.14 394.08
Y Memory 23150 MiB 23158 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 389.66 389.81
N Memory 24270 MiB 24156 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 1426.23 1414.21
Y Memory 23776 MiB 23768 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 1304.46 1351.07
Y Memory 24872 MiB 24882 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 395.4 394.55
N Memory 23816 MiB 23874 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 383.0 382.89
Y Memory 24892 MiB 24902 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 1424.803 1429.564
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g f67aafb(20220321) f67aafb(20220320)
N Throughput 10800.888 10870.208
Y Memory 23722 MiB 23724 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 382.997 383.944
Y Memory 22750 MiB 22720 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 3035.503 3035.012
Y Memory 23316 MiB 23282 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 1405.803 1419.512
Y Memory 23884 MiB 23908 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g f67aafb(20220321) f67aafb(20220320)
N Throughput 10701.558 10562.453
Y Memory 24518 MiB 24492 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g b56df22(20220321) f67aafb(20220320)
Y Throughput 380.028 382.741
Y Memory 23482 MiB 23436 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 2981.835 2990.565
N Memory 24052 MiB 23984 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 300.512 301.313
Y Memory 5392 MiB 5392 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 41.939 41.407
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 3.948 4.111
Y Memory 1802 MiB 1802 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 6.464 6.624
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 113.286 118.747
Y Memory 3518 MiB 3518 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 21.16 21.616
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 181.913 177.6
Y Memory 4778 MiB 4778 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 22.035 21.003
Y Memory 2919 MiB 2919 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 1.541 1.512
Y Memory 1508 MiB 1510 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 2.734 2.808
Y Memory 2137 MiB 2137 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g f67aafb(20220321) f67aafb(20220320)
Y Throughput 99.091 99.308
N Memory 3138 MiB 3074 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g f67aafb(20220321) f67aafb(20220320)
Y Throughput 11.966 12.129
Y Memory 2525 MiB 2493 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 355.05 345.86
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 318.74 318.35
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 1492.63 1455.79
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 1338.44 1317.7
Y Memory 24084 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 408.44 396.14
Y Memory 23164 MiB 23150 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 390.06 389.66
Y Memory 24252 MiB 24270 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 1436.37 1426.23
Y Memory 23776 MiB 23776 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 1334.76 1304.46
Y Memory 24860 MiB 24872 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 404.67 395.4
Y Memory 23820 MiB 23816 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 379.51 383.0
N Memory 24954 MiB 24892 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 1424.949 1424.803
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 393.343 382.997
Y Memory 22732 MiB 22750 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 1436.964 1405.803
Y Memory 23916 MiB 23884 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g b56df22(20220322) b56df22(20220321)
Y Throughput 390.935 380.028
Y Memory 23462 MiB 23482 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 304.529 300.512
Y Memory 5392 MiB 5392 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 41.251 41.939
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 4.085 3.948
Y Memory 1802 MiB 1802 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 6.6 6.464
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 123.028 113.286
Y Memory 3518 MiB 3518 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 21.357 21.16
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 170.595 181.913
N Memory 4650 MiB 4778 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 21.938 22.035
Y Memory 2919 MiB 2919 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 1.498 1.541
Y Memory 1508 MiB 1508 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 2.714 2.734
Y Memory 2137 MiB 2137 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g b56df22(20220322) f67aafb(20220321)
Y Throughput 97.201 99.091
Y Memory 3138 MiB 3138 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g b56df22(20220322) f67aafb(20220321)
Y Throughput 12.031 11.966
Y Memory 2493 MiB 2525 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 348.07 355.05
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 318.74 318.74
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 1459.13 1492.63
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 1324.62 1338.44
Y Memory 24104 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 398.3 408.44
N Memory 23104 MiB 23164 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 389.57 390.06
Y Memory 24222 MiB 24252 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 1400.39 1436.37
Y Memory 23766 MiB 23776 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 1310.23 1334.76
Y Memory 24858 MiB 24860 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 395.2 404.67
Y Memory 23804 MiB 23820 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 384.49 379.51
N Memory 24900 MiB 24954 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 1426.094 1424.949
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 384.945 393.343
Y Memory 22728 MiB 22732 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 1404.764 1436.964
Y Memory 23884 MiB 23916 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 382.749 390.935
Y Memory 23414 MiB 23462 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 305.034 304.529
Y Memory 5392 MiB 5392 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 40.792 41.251
Y Memory 2666 MiB 2666 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 4.03 4.085
Y Memory 1802 MiB 1802 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b512_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 6.424 6.6
Y Memory 2216 MiB 2216 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 119.5 123.028
Y Memory 3518 MiB 3518 MiB
Check WDL_ddp_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 21.564 21.357
Y Memory 2436 MiB 2436 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 173.411 170.595
N Memory 4778 MiB 4650 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b131072_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 21.326 21.938
N Memory 2855 MiB 2919 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 1.538 1.498
Y Memory 1508 MiB 1508 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b512_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 2.711 2.714
Y Memory 2137 MiB 2137 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n1g 0d77085(20220323) b56df22(20220322)
Y Throughput 92.606 97.201
Y Memory 3138 MiB 3138 MiB
Check WDL_graph_dlperf_vs2322444_devs16_hun2_b65536_1n8g 0d77085(20220323) b56df22(20220322)
Y Throughput 11.924 12.031
Y Memory 2525 MiB 2493 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 348.72 349.67
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 316.91 318.05
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1460.28 1482.71
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1319.55 1324.09
Y Memory 24104 MiB 24104 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 400.36 402.6
Y Memory 23102 MiB 23150 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 389.66 389.53
Y Memory 24180 MiB 24228 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1425.23 1435.77
Y Memory 23782 MiB 23808 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1299.82 1323.45
Y Memory 24878 MiB 24862 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 398.51 396.87
Y Memory 23854 MiB 23810 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 384.93 382.77
Y Memory 24918 MiB 24956 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1443.223 1454.642
Y Memory 23132 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 5a66b1b83(20220328) d873356b6(20220327)
N Throughput 11006.065 10937.215
Y Memory 23722 MiB 23738 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 391.681 392.915
Y Memory 22748 MiB 22748 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 3035.599 3040.59
Y Memory 23260 MiB 23300 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 1414.275 1415.563
Y Memory 23902 MiB 23892 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 5a66b1b83(20220328) d873356b6(20220327)
N Throughput 10771.664 10655.63
Y Memory 24546 MiB 24510 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 388.75 393.55
Y Memory 23470 MiB 23424 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 5a66b1b83(20220328) d873356b6(20220327)
Y Throughput 2957.329 2988.711
Y Memory 24030 MiB 24022 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 342.38 348.72
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 317.38 316.91
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 1474.78 1460.28
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 1343.37 1319.55
Y Memory 24084 MiB 24104 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 397.22 400.36
N Memory 23154 MiB 23102 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 390.13 389.66
Y Memory 24208 MiB 24180 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 1424.81 1425.23
Y Memory 23780 MiB 23782 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 1339.96 1299.82
Y Memory 24880 MiB 24878 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 395.02 398.51
Y Memory 23824 MiB 23854 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 383.89 384.93
Y Memory 24938 MiB 24918 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 1426.241 1443.223
Y Memory 23118 MiB 23132 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
N Throughput 10909.141 11006.065
Y Memory 23724 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 382.521 391.681
Y Memory 22760 MiB 22748 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 3036.257 3035.599
Y Memory 23308 MiB 23260 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 1408.18 1414.275
Y Memory 23902 MiB 23902 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
N Throughput 10711.979 10771.664
N Memory 24492 MiB 24546 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 24543a5(20220329) 5a66b1b83(20220328)
Y Throughput 379.223 388.75
Y Memory 23474 MiB 23470 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 0f45edd(20220329) 5a66b1b83(20220328)
Y Throughput 2976.101 2957.329
Y Memory 24014 MiB 24030 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 349.38 342.38
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 317.17 317.38
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 1480.79 1474.78
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 1335.89 1343.37
Y Memory 24104 MiB 24084 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 399.54 397.22
Y Memory 23174 MiB 23154 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 388.43 390.13
Y Memory 24174 MiB 24208 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 1419.69 1424.81
Y Memory 23776 MiB 23780 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 1320.83 1339.96
Y Memory 24866 MiB 24880 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 396.48 395.02
N Memory 23908 MiB 23824 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 381.36 383.89
Y Memory 24978 MiB 24938 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 1411.982 1426.241
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 10895.295 10909.141
Y Memory 23722 MiB 23724 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 386.821 382.521
Y Memory 22756 MiB 22760 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 3033.269 3036.257
Y Memory 23276 MiB 23308 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 1417.703 1408.18
Y Memory 23896 MiB 23902 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g c7fc63421(20220330) 0f45edd(20220329)
N Throughput 10595.254 10711.979
Y Memory 24488 MiB 24492 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g 0f45edd(20220330) 24543a5(20220329)
Y Throughput 384.205 379.223
Y Memory 23434 MiB 23474 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g c7fc63421(20220330) 0f45edd(20220329)
Y Throughput 2969.733 2976.101
Y Memory 24022 MiB 24014 MiB

@github-actions
Copy link
Author

  • OneFlow Master 基于V100上性能测试对比(前一日commit与当天commit的对比)
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 350.67 346.11
Y Memory 26938 MiB 26938 MiB
Check ResNet50_ddp_dlperf_cpudecode_FP32_b256_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 316.82 317.17
Y Memory 27370 MiB 27370 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 1498.63 1470.86
Y Memory 23006 MiB 23006 MiB
Check ResNet50_graph_dlperf_cpudecode_FP16_b512_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 1334.78 1335.89
Y Memory 24084 MiB 24104 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 398.72 396.56
N Memory 23150 MiB 23096 MiB
Check ResNet50_graph_dlperf_cpudecode_FP32_b256_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 388.69 388.43
N Memory 24240 MiB 24174 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 1467.91 1471.66
Y Memory 23790 MiB 23782 MiB
Check ResNet50_graph_dlperf_gpudecode_FP16_b512_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
N Throughput 1258.66 1320.83
Y Memory 24870 MiB 24866 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 395.4 393.9
Y Memory 23846 MiB 23872 MiB
Check ResNet50_graph_dlperf_gpudecode_FP32_b256_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 383.13 381.36
Y Memory 24936 MiB 24978 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 1425.143 1425.162
Y Memory 23118 MiB 23118 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP16_b512_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 10872.467 10895.295
Y Memory 23720 MiB 23722 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 387.144 382.893
Y Memory 22720 MiB 22700 MiB
Check ResNet50_lazy_dlperf_cpudecode_FP32_b256_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 3037.84 3033.269
Y Memory 23318 MiB 23276 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 1419.381 1399.12
Y Memory 23892 MiB 23884 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP16_b512_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
N Throughput 10729.363 10595.254
Y Memory 24504 MiB 24488 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n1g cdae64a(20220331) c7fc63421(20220330)
Y Throughput 383.298 380.248
Y Memory 23488 MiB 23478 MiB
Check ResNet50_lazy_dlperf_gpudecode_FP32_b256_1n8g 6045c4f1e(20220331) c7fc63421(20220330)
Y Throughput 2992.309 2969.733
Y Memory 24006 MiB 24022 MiB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants