[TorchBench] Performance Signal Detected

[zzpmiracle]

TorchBench CI has detected a performance signal.

Affected Tests:

• eval-cuda-fp32:
  • detectron2_fasterrcnn_r_101_c4[dynamo-blade (latency)] status changed, 80.596 -> AttributeError
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (latency)] status changed, 146.281 -> AttributeError
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (clusters)] status changed, 15.0 -> N/A
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (compiled)] status changed, 1445.0 -> N/A
  • detectron2_fasterrcnn_r_101_dc5[dynamo-blade (latency)] status changed, 41.958 -> AttributeError
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (latency)] status changed, 54.014 -> AttributeError
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (clusters)] status changed, 14.0 -> N/A
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (compiled)] status changed, 1453.0 -> N/A
  • detectron2_fasterrcnn_r_101_fpn[dynamo-blade (latency)] status changed, 30.999 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-blade (latency)] status changed, 76.17 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (latency)] status changed, 33.887 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (clusters)] status changed, 16.0 -> N/A
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (compiled)] status changed, 958.0 -> N/A
  • detectron2_fasterrcnn_r_50_dc5[dynamo-blade (latency)] status changed, 38.074 -> AttributeError
  • detectron2_fasterrcnn_r_50_fpn[dynamo-blade (latency)] status changed, 25.299 -> AttributeError
  • detectron2_maskrcnn_r_101_c4[dynamo-blade (latency)] status changed, 90.31 -> AttributeError
  • detectron2_maskrcnn_r_50_c4[dynamo-blade (latency)] status changed, 84.526 -> AttributeError
  • detectron2_maskrcnn_r_50_fpn[dynamo-blade (latency)] status changed, 29.93 -> AttributeError
  • functorch_maml_omniglot[blade (latency)] 0.71 -> 0.601, +15.3521%
  • hf_Bart[dynamo-disc (compiled)] 1426 -> 1418
  • hf_Bert_mini[disc (latency)] 0.817 -> 0.6, +26.5606%
  • hf_Bert_mini[dynamo-disc (latency)] 0.87 -> 0.639, +26.5517%
  • maml_omniglot[dynamo-blade (latency)] 0.495 -> 0.463, +6.4646%
  • pyhpc_isoneutral_mixing[blade (latency)] 10.566 -> 11.767, -11.3666%
  • pyhpc_isoneutral_mixing[dynamo-blade (latency)] 9.696 -> 10.63, -9.6328%
  • pyhpc_turbulent_kinetic_energy[dynamo-blade (latency)] 11.627 -> 10.501, +9.6844%
  • Super_SloMo[disc (compiled)] 1351 -> 885
  • Super_SloMo[disc (clusters)] 32 -> 31
  • Super_SloMo[dynamo-disc (clusters)] 32 -> 31
  • Super_SloMo[dynamo-disc (compiled)] 1351 -> 885
  • vision_maskrcnn[dynamo-blade (latency)] status changed, RuntimeError -> 201.147
  • yolov3[disc (latency)] status changed, 37.075 -> RuntimeError
  • yolov3[disc (compiled)] status changed, 964.0 -> N/A
  • yolov3[disc (clusters)] status changed, 11.0 -> N/A
• eval-cuda-fp16:
  • alexnet[dynamo-blade (latency)] 3.759 -> 4.015, -6.8103%
  • attention_is_all_you_need_pytorch[disc (latency)] 2.738 -> 2.594, +5.2593%
  • dcgan[blade (latency)] 1.247 -> 1.359, -8.9816%
  • detectron2_fasterrcnn_r_101_c4[dynamo-blade (latency)] status changed, 49.353 -> AttributeError
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (latency)] status changed, 58.206 -> AttributeError
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (clusters)] status changed, 15.0 -> N/A
  • detectron2_fasterrcnn_r_101_c4[dynamo-disc (compiled)] status changed, 1445.0 -> N/A
  • detectron2_fasterrcnn_r_101_dc5[dynamo-blade (latency)] status changed, 26.425 -> AttributeError
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (latency)] status changed, 31.067 -> AttributeError
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (clusters)] status changed, 14.0 -> N/A
  • detectron2_fasterrcnn_r_101_dc5[dynamo-disc (compiled)] status changed, 1453.0 -> N/A
  • detectron2_fasterrcnn_r_101_fpn[dynamo-blade (latency)] status changed, 19.83 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-blade (latency)] status changed, 47.455 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (latency)] status changed, 18.222 -> AttributeError
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (clusters)] status changed, 16.0 -> N/A
  • detectron2_fasterrcnn_r_50_c4[dynamo-disc (compiled)] status changed, 958.0 -> N/A
  • detectron2_fasterrcnn_r_50_dc5[dynamo-blade (latency)] status changed, 24.353 -> AttributeError
  • detectron2_fasterrcnn_r_50_fpn[dynamo-blade (latency)] status changed, 16.632 -> AttributeError
  • detectron2_maskrcnn_r_101_c4[dynamo-blade (latency)] status changed, 53.855 -> AttributeError
  • detectron2_maskrcnn_r_50_c4[dynamo-blade (latency)] status changed, 49.114 -> AttributeError
  • detectron2_maskrcnn_r_50_fpn[dynamo-blade (latency)] status changed, 18.985 -> AttributeError
  • dlrm[dynamo-disc (latency)] 1.754 -> 1.664, +5.1311%
  • hf_Bart[dynamo-disc (latency)] 6.827 -> 6.449, +5.5368%
  • hf_Bert_mini[disc (latency)] 0.744 -> 0.585, +21.371%
  • hf_Bert_mini[dynamo-disc (latency)] 0.783 -> 0.625, +20.1788%
  • maml_omniglot[dynamo-blade (latency)] 0.486 -> 0.377, +22.428%
  • pyhpc_equation_of_state[dynamo-blade (latency)] 2.023 -> 2.157, -6.6238%
  • pyhpc_isoneutral_mixing[blade (latency)] 7.581 -> 7.057, +6.912%
  • pyhpc_isoneutral_mixing[dynamo-blade (latency)] 6.667 -> 6.195, +7.0796%
  • pyhpc_turbulent_kinetic_energy[blade (latency)] 6.198 -> 5.778, +6.7764%
  • resnet18[blade (latency)] 0.994 -> 0.903, +9.1549%
  • Super_SloMo[disc (latency)] 75.056 -> 69.594, +7.2772%
  • Super_SloMo[dynamo-disc (latency)] 74.896 -> 69.533, +7.1606%
  • Super_SloMo[disc (compiled)] 1351 -> 885
  • Super_SloMo[disc (clusters)] 32 -> 31
  • Super_SloMo[dynamo-disc (clusters)] 32 -> 31
  • Super_SloMo[dynamo-disc (compiled)] 1351 -> 885
  • yolov3[disc (latency)] status changed, 17.386 -> RuntimeError
  • yolov3[disc (compiled)] status changed, 964.0 -> N/A
  • yolov3[disc (clusters)] status changed, 11.0 -> N/A

detail data can be seen in oss://bladedisc-ci/TorchBench/gpu/full/20230728-15
created by TorchBench CI automatically