In paper, you metioned: <img width="1197" height="208" alt="Image" src="https://github.com/user-attachments/assets/60088e7d-3fe9-465e-b3ca-643e80d97b96" /> Did you mean llm hidden states were not fed into `lm_head`, but a single 256-way mlp? In this way, we don't need to add special tokens to the vlm? Thanks.
In paper, you metioned:
Did you mean llm hidden states were not fed into
lm_head, but a single 256-way mlp? In this way, we don't need to add special tokens to the vlm?Thanks.