Skip to content

[SUGGESTION] More demucs (models), more fun ! #469

@MarcoRavich

Description

@MarcoRavich

I've recently tested @CarlGao4's Demucs GUI that allows to inference - even on CPU (but without OpenVINO afaik) many interesting separation models/versions.

Models details from @adefossez's Demucs-fork-git:

  • htdemucs: first version of Hybrid Transformer Demucs. Trained on MusDB + 800 songs. Default model.
  • htdemucs_ft: fine-tuned version of htdemucs, separation will take 4 times more time but might be a bit better. Same training set as htdemucs.
  • htdemucs_6s: 6 sources version of htdemucs, with piano and guitar being added as sources. Note that the piano source is not working great at the moment.
  • hdemucs_mmi: Hybrid Demucs v3, retrained on MusDB + 800 songs.
  • mdx: trained only on MusDB HQ, winning model on track A at the [MDX][mdx] challenge.
  • mdx_extra: trained with extra training data (including MusDB test set), ranked 2nd on the track B of the [MDX][mdx] challenge.
  • mdx_q, mdx_extra_q: quantized version of the previous models. Smaller download and storage but quality can be slightly worse.
  • SIG: where SIG is a single model from the model zoo.

I know that the upcoming version will allow their use, anyway I believe that some conversions is needed to.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions