Skip to content
This repository was archived by the owner on Jul 14, 2023. It is now read-only.
This repository was archived by the owner on Jul 14, 2023. It is now read-only.

Apply real-time voice conversion to the user's voice #17

@philpax

Description

@philpax

Based on my preliminary research, machine learning research is at the stage where real-time voice conversion is possible, but not easy. The largest proof-of-concept in this area is realtime-yukarin, which appears to work surprisingly well.

Open questions:

  • What's the current state of the art now?
  • How easy is it to integrate?
  • Can we produce the full range of voices you'd expect from FFXIV characters?
  • Can the proposed solution handle gender-bending?
  • What is the latency on conversion?

Metadata

Metadata

Assignees

No one assigned

    Labels

    researchFurther research needed, including potentially of the academic kindvoice chatFully-spatialised voice chat with potential real-time voice conversion is quite difficult

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions