Loss cannot converge

[CYL0089]

As shown above，the fine-tune loss become larger, the config and training details are all follow yours. could you please tell me some possible reasons？

[CYL0089]

2 epoch, the losses have not decreased yet.

[SuroshAhmadZobair]

Hi @CYL0089
have you tried reducing the batch_size number?

For me it converges on batch_size 2 but not on 3. I am using 2X3090s.

Cheers