Hi, I have read this great work.
However I have some questions especially in the PMMs module code. First, What is the purpose of L2 normalization in Line 61 of PMMs.py ? Dose it affect to remove it? Second, the input to EM algorithm is the masked feature representation, however, zero value positions are not removed after mask operation. The masked feature will have many zero elements. Does this affect the result of EM algorithm?
Hi, I have read this great work.
However I have some questions especially in the PMMs module code. First, What is the purpose of L2 normalization in Line 61 of PMMs.py ? Dose it affect to remove it? Second, the input to EM algorithm is the masked feature representation, however, zero value positions are not removed after mask operation. The masked feature will have many zero elements. Does this affect the result of EM algorithm?