Did anyone try AdaCos?

[borisgribkov]

I will in a couple of days and compare it with ArcFace using Megaface and other tests, will present the results. But I'm a bit confused about M parameter.

[borisgribkov]

Works strange, loss starts with something about 17, slightly decreases to 13 - 12 and than suddenly rises up to 80, convergence stops. Used Ms-Celeb (not aligned) and initial softmax trained weights, M = 0.5

[borisgribkov]

Tried different M the same as lr, result is the same.