Changing character sprite based on emotion of reply

[laggykiller]

This could be implemented by using models such as https://huggingface.co/datasets/dair-ai/emotion

The output of chatbot is used as input of the emotion model. Based on string output of emotion model, the corresponding character sprite is used (e.g. anger -> anger.png)

[Rubiksman78]

I have personally tested this model: https://huggingface.co/michellejieli/emotion_text_classifier that was doing pretty good.

The thing is that to do that, it would need people to add a lot of sprites themselves which can be a little problematic for people without designing abilities. Maybe with a diffusion model generating the sprites itself but it would take some time to add and I don't plan on maintaining it for a long time.

[Sndragon88]

I have personally tested this model: https://huggingface.co/michellejieli/emotion_text_classifier that was doing pretty good.

If it's not too difficult, could you implement it in a new release? I think you can make it optional, people who can't insert sprites can just use one default picture.

Actually this guy https://github.com/kwaroran/RisuAI made it possible to change expressions, but the chatbot either repeats itself a lot or says nothing in my case, so I can't use it. Maybe you can join force? He's the only dev ower there.