Accelerate through onediff

[ccssu]

Install OneDiff and its dependencies.

 python3 -m pip install --pre oneflow -f https://oneflow-pro.oss-cn-beijing.aliyuncs.com/branch/community/cu121 && 
git clone https://github.com/siliconflow/onediff.git &&
cd onediff &&
python3 -m pip install -e . &&
cd onediff_diffusers_extensions &&
python3 -m pip install -e .

Accelerate

• warmup 2 times

• speed:

  • baseline: 2.77it/s
  • onediff: 5.18it/s
  • (5.18 - 2.77) / 2.77 = 0.87 (87% faster)

• e2e:

  • baseline: 20.18 s
  • onediff: 11.88 s
  • (20.18 - 11.88) / 20.18 = 0.41 (41% faster)

Add the 📷OneDiff Speed Up node as shown in the following diagram:：

env

• NVIDIA A100-PCIE-40GB
• torch.version='2.1.2+cu121'
• python = 3.10.13
• python -m oneflow --doctor
  version: 0.9.1.dev20240219+cu121
  git_commit: 6621521
  cmake_build_type: Release
  rdma: True
  mlir: True
  enterprise: False