Inference Time

[Hammour-steak]

I tried to generate a single image on my PC, it takes about 7 min on the single RTX 2060, is this normal？

[limuloo]

@Hammour-steak We haven't tested it on 2060 yet. Have you tested the speed of running stable diffusion directly on your device? I think you can compare the speed of stable diffusion to determine whether there is a problem.

[Hammour-steak]

Is it convenient that you can provide what and how many gpu you tested? Thank you

[limuloo]

@Hammour-steak It only takes about 10 seconds on both RTX 3090 and V100. It takes 30 seconds on a T4 GPU. You can verify this through our colab demo. https://colab.research.google.com/drive/1rkhi7EylHXACbzfXvWiblM4m1BCGOX5-?usp=sharing

[Hammour-steak]

Thank you for your reply, I'll check it again.