소스 분리

Open-Unmix HQ 는 스테레오 음악 트랙을 4 개의 독립 스템 — 보컬, 드럼, 베이스, 기타 로 분리합니다. 각 스템마다 독립된 BiLSTM 모델이 혼합 STFT 에 대해 크기 마스크를 생성하며, 선택적 Wiener 후처리로 이들을 조정합니다. Apple Silicon 에서 MLX로 동작합니다.

두 가지 엔진을 사용할 수 있습니다: Open-Unmix HQ(경량, 기본값)와 HTDemucs (Demucs v4) — --engine htdemucs 로 선택하는 더 높은 품질의 Hybrid Transformer 모델입니다. 둘 다 MLX 를 통해 Apple Silicon 에서 동작하며 동일한 4 개의 스템을 44.1 kHz 로 출력합니다.

개요

• 4 stems per track — vocals, drums, bass, other. Each is a 2-channel 44.1 kHz stem file.
• Magnitude-mask model — each stem model predicts a non-negative mask applied to the mixture spectrogram; phase is taken from the mixture.
• Wiener post-filter (optional) — soft-mask refinement across all 4 stems so they sum coherently back to the mixture. Adds ~0.5 dB SDR.
• Small footprint — 8.9M params per stem, ~136 MB total for all 4 stems.
• Apache-2.0 — upstream weights under MIT, our CoreML/MLX conversion under Apache-2.0.

아키텍처

Four independent stems, each a copy of the same network:

모델

HTDemucs (Demucs v4)

For higher separation quality — especially on bass and drums — the package also ships HTDemucs, Meta's Hybrid Transformer Demucs. It merges a spectrogram branch and a waveform branch through a cross-domain transformer; the shipped htdemucs_ft variant is a bag of four fine-tuned sub-models, one per stem. Weights download from HuggingFace on first use. On a directional MUSDB-sample benchmark (museval / BSSEval v4) it averages +3.01 dB SDR over UMX-HQ, with the biggest gains on bass (+5.75 dB).

빠른 시작 — Swift

import SourceSeparation
import AudioCommon

let separator = try await SourceSeparator.fromPretrained()

let stereo = try AudioFileLoader.loadStereo(
    url: URL(fileURLWithPath: "song.wav"),
    targetSampleRate: 44100
)

let stems = separator.separate(audio: stereo, sampleRate: 44100)
// stems[.vocals], stems[.drums], stems[.bass], stems[.other]
// Each is [[Float]] — left channel, right channel.

try WAVWriter.writeStereo(
    left: stems[.vocals]![0],
    right: stems[.vocals]![1],
    sampleRate: 44100,
    to: URL(fileURLWithPath: "vocals.wav")
)

Pass wiener: true (default) for best quality. Pass targets: [.vocals] to extract only a subset of stems and skip the other models.

커맨드라인

speech separate song.wav                              # all 4 stems into song_stems/ (Open-Unmix)
speech separate song.wav --engine htdemucs            # Demucs v4 — higher quality
speech separate song.wav --engine htdemucs --htdemucs-precision int8  # smaller int8 bundle
speech separate song.wav --stems vocals               # vocals only
speech separate song.wav --stems vocals,drums         # subset
speech separate song.wav --output-dir /tmp/stems/     # custom output dir
speech separate song.wav --verbose                    # show timing

언제 사용하는가