about training from pretrain

would you mind giving a instruction
I follow [ControlNet](https://github.com/lllyasviel/ControlNet) and take [fill50k](https://huggingface.co/lllyasviel/ControlNet) and do the same but it seems not to be OK. If it is right way, please confirm for me