Skip to content
This repository was archived by the owner on Sep 1, 2024. It is now read-only.
This repository was archived by the owner on Sep 1, 2024. It is now read-only.

1. Differences between "extract_finetune" and "extract_features" and 2. extract discrete unit feature #118

Description

@hyunbin70

Hi, Thank you for your dedicated work.

  1. Actually, I want to extract the features from the AV-HuBERT, so I decided to use the "extract_finetune".
    But, I just would like to understand the difference between the functions, "extract_finetune" and "extract_features".
    In the Colab demo, it appears that "extract_finetune" is used to obtain features regardless of whether the model and checkpoint are pre-trained or fine-tuned. Can I use the "extract_finetune" function for both pre-trained and fine-tuned models and checkpoints?

  2. Additionally, I would like to extract the discrete unit feature from AV-HuBERT, not the continuous features obtained via "extract_finetune". Could you provide guidance on extracting features similar to the unit feature described in this paper?: https://arxiv.org/pdf/2204.02967

Thank you for your assistance.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions