All loss values become nan

[AniketGurav]

Respected Sir,

Thanks for your work.
I am working on images that have only horizontal text.

During training following loss values eventually become nan after few steps.
Those loss are bbox_loss,seg_loss,angle_loss and loss
These values are present in train.py between lines 487 to 497

Can you please let me know what can be the issue and is there any
change required in code when only horizontal text is present.

--- Aniket

[MichalBusta]

Hi,
The horizontal and vertical text are supported.

• with no additional information, I think the issue will be in data feeding. (nan values can be result of len(gt) > len(features) - for ctc loss the gt must be able to fit length of the feature vector).

you can run training with a debug option to see, what are you feeding in ...

the data format description: https://github.com/MichalBusta/E2E-MLT/tree/master/sample_train_data/MLT

• note, that for ICDAR format, order of the coordinates matter.

Hope it helps, Michal

[AniketGurav]

Thank you