V2 Performance Signal Detected by TorchBench CI on '2.6.0.dev20240917+cu124'

[xuzhao9]

TorchBench CI has detected a performance signal.

Base PyTorch version: 2.4.0.dev20240606+cu121

Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1

Affected PyTorch version: 2.6.0.dev20240917+cu124

Affected PyTorch commit: 37a08b33bb86ad0fce3db6fc98f90c9e02d77cba

Affected Tests:

• test_train[Super_SloMo-cuda-eager]: +14.62766%
• test_eval[Super_SloMo-cuda-eager]: +11.07496%
• test_train[Super_SloMo-cuda-jit]: +14.74094%
• test_eval[Super_SloMo-cuda-jit]: +11.20760%
• test_eval[alexnet-cuda-eager]: +10.33393%
• test_eval[alexnet-cuda-jit]: +13.68206%
• test_train[dcgan-cuda-eager]: +63.62549%
• test_train[dcgan-cuda-jit]: +63.68281%
• test_eval[pyhpc_equation_of_state-cpu-jit]: +10.55933%
• test_eval[pytorch_stargan-cpu-eager]: -14.15109%
• test_eval[shufflenet_v2_x1_0-cpu-eager]: +12.14505%
• test_eval[shufflenet_v2_x1_0-cuda-jit]: -27.39666%
• test_eval[timm_regnet-cuda-eager]: +169.47718%
• test_eval[timm_regnet-cuda-jit]: +356.91370%
• test_train[yolov3-cuda-eager]: -9.73554%

cc @xuzhao9

Result json:

{
  "start": "ffaea656b5d8ff6518669494cc8f664b94f8e8b1",
  "end": "37a08b33bb86ad0fce3db6fc98f90c9e02d77cba",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "8759ed2ac50",
      "commit1_time": "2024-09-04 17:18:21 +0000",
      "commit1_digest": {
        "test_eval[shufflenet_v2_x1_0-cpu-eager]": 0.16593277025967837
      },
      "commit2": "7858045491f",
      "commit2_time": "2024-09-04 17:21:32 +0000",
      "commit2_digest": {
        "test_eval[shufflenet_v2_x1_0-cpu-eager]": 0.15055387476459145
      }
    }
  ]
}

Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/10919529125