A conditional generative model on top of BERT.
Considered BERT as a Markov Random Field (MRF) inspired by thr research paper 'BERT has a Mouth, and It Must Speak: BERT as Markov Random Field Lnguage Model'.
Paper available at https://arxiv.org/abs/1902.04094