Singer Creation 创建歌手

A singer is a voice profile built from a reference audio clip and its preprocessed musical data. The SVS model uses the singer's voice characteristics to synthesize new singing. This page covers the complete singer creation workflow, including audio preprocessing.

歌手 是基于参考音频片段及其预处理后的音乐数据构建的声音配置文件。SVS 模型会利用歌手的语音特征来合成新的歌声。本页涵盖完整的歌手创建流程,包括音频预处理。

Overview 概览

The Singer Creator is a dedicated window for creating new singers. It has three sections: Basic Info (name and avatar), Reference Audio (the WAV file), and Audio Preprocessing (F0 and MIDI extraction). The right panel shows a live preview of how the singer will appear.

歌手创建器(Singer Creator)是用于创建新歌手的专用窗口。它包含三个部分:基本信息(名称和头像)、参考音频(WAV 文件)和 音频预处理(F0 与 MIDI 提取)。右侧面板会实时预览歌手的最终外观。

Reference Audio Requirements 参考音频要求

The reference audio is the most important part of singer creation. It tells the model what voice to imitate. Requirements:

参考音频是歌手创建中最关键的部分。它告诉模型要模仿的声音。要求如下:

Requirement要求项 Specification规格
Format格式 .wav only仅限 .wav
Duration时长 Maximum 30 seconds (a trim dialog opens if exceeded)最长 30 秒(超出会自动弹出裁剪对话框)
Content内容 Pure vocals only — no background music, instruments, reverb, or effects仅纯人声——无背景音乐、乐器、混响或效果
Sample Rate采样率 44100 Hz recommended (other rates accepted)推荐 44100 Hz(其他采样率也可接受)
Quality质量 Clean recording with minimal background noise, clear articulation干净录音,背景噪音尽可能少,咬字清晰
⚠️

Why pure vocals matter: The model learns voice characteristics from this audio. Any non-vocal content (music, noise, effects) is treated as part of the voice and will cause artifacts in the synthesized output. If your source is a mixed song, use a vocal remover tool to isolate clean vocals first.

为何必须纯人声:模型会从参考音频中学习声音特征。任何非人声内容(音乐、噪音、效果)都会被当作声音的一部分学习,导致合成输出出现伪影。如果源文件是混音歌曲,请先使用人声分离工具提取纯净人声。

Step-by-Step: Creating a Singer 分步操作:创建歌手

1. Open the Singer Creator 1. 打开歌手创建器

  1. In the main window, click the + button in the singer panel header (left side).在主窗口中,点击歌手面板标题栏(左侧)的 + 按钮。
  2. A dialog appears with two options: Open Singer Creator (create new) or Open Existing Singer File (load a .sxssinger file).弹出对话框,包含两个选项:Open Singer Creator(新建)或 Open Existing Singer File(加载 .sxssinger 文件)。
  3. Click Open Singer Creator.点击 Open Singer Creator

2. Enter Basic Info 2. 填写基本信息

3. Upload the WAV File 3. 上传 WAV 文件

  1. Click the upload area (or drag a WAV file onto it).点击上传区域(或将 WAV 文件拖到该区域)。
  2. Select a .wav file that meets the requirements above.选择符合上述要求的 .wav 文件。
  3. After uploading, a waveform visualization appears. Click Preview to listen, or Clear to remove it.上传后会出现波形可视化。点击 Preview 试听,或点击 Clear 移除。

4. Trim if Longer Than 30 Seconds 4. 超过 30 秒则裁剪

If your WAV file exceeds 30 seconds, the WAV Trim dialog opens automatically:

如果 WAV 文件超过 30 秒,会自动弹出 WAV 裁剪对话框:

5. Start Audio Preprocessing 5. 开始音频预处理

Preprocessing extracts the musical information (pitch, notes, timing) from your reference audio. This step is required — without it, the singer cannot be used for synthesis.

预处理会从参考音频中提取音乐信息(音高、音符、时序)。此步骤必填——没有它,歌手无法用于合成。

  1. Click Start Audio Preprocessing. A new window opens showing the WAV waveform (top), MIDI editor (middle), and F0 curve (bottom).点击 Start Audio Preprocessing。新窗口打开,显示 WAV 波形(顶部)、MIDI 编辑器(中部)和 F0 曲线(底部)。

Follow the detailed preprocessing steps in the next section.

请按照下一节的详细预处理步骤操作。

6. Save the Singer File 6. 保存歌手文件

  1. After preprocessing is complete, click Create & Save (✓) in the Singer Creator.预处理完成后,在歌手创建器中点击 Create & Save(✓)。
  2. Choose a save location. The singer is saved as a .sxssinger file (JSON format with base64-encoded audio).选择保存位置。歌手以 .sxssinger 文件保存(JSON 格式,内含 base64 编码的音频)。
  3. A success message confirms creation. The singer now appears in the main window's singer panel.成功消息确认创建完成。歌手随即出现在主窗口的歌手面板中。
ℹ️

Create & Save requires a WAV file to be loaded. If preprocessing was completed, the preprocessed data is included in the saved file.

Create & Save 需要先加载 WAV 文件。如果已完成预处理,预处理数据会一并保存到文件中。

Audio Preprocessing in Detail 音频预处理详解

The Audio Preprocessing window extracts MIDI notes and F0 (fundamental frequency) data from the reference audio. The SVS model uses this data to understand the singer's vocal characteristics.

音频预处理窗口会从参考音频中提取 MIDI 音符和 F0(基频)数据。SVS 模型利用这些数据来理解歌手的语音特征。

Step 1: Extract F0 (Pitch) 第 1 步:提取 F0(音高)

Step 2: Extract MIDI Notes 第 2 步:提取 MIDI 音符

Step 3: Edit MIDI Notes (Mandatory) 第 3 步:编辑 MIDI 音符(必填)

Auto-extracted MIDI is approximate. You must verify and correct it before saving. Incorrect notes will degrade synthesis quality.

自动提取的 MIDI 是近似的。保存前必须核对并修正。错误的音符会降低合成质量。

Check each note's pitch (does the MIDI pitch match the actual sung note?), note boundaries (do starts/ends align with the singing?), and note count (are all sung notes detected? are there false detections?). Edit operations:

检查每个音符的音高(MIDI 音高是否与实际演唱一致?)、音符边界(起始/结束是否与演唱对齐?)和音符数量(是否所有演唱音符都被检测到?是否有误检?)。编辑操作如下:

Step 4: Fill in Lyrics (Mandatory) 第 4 步:填写歌词(必填)

Every note must have a lyric. The preprocessing does not detect lyrics from audio. You must manually type them:

每个音符都必须有歌词。预处理不会从音频中识别歌词,必须手动输入:

Step 5: Save Preprocessed Data 第 5 步:保存预处理数据

  1. Click Save (💾). This requires at least F0 or MIDI data to be extracted.点击 Save(💾)。此操作要求至少提取了 F0 或 MIDI 数据。
  2. All preprocessed data is sent back to the Singer Creator window via IPC.所有预处理数据通过 IPC 发送回歌手创建器窗口。
  3. The Singer Creator preview updates to show both "WAV ✓" and "Preprocess ✓" badges.歌手创建器预览会更新,显示 "WAV ✓" 和 "Preprocess ✓" 徽章。
ℹ️

The F0 curve is read-only — you cannot edit it directly. MIDI note editing affects only the note data, not the F0 curve. If you are unhappy with extraction results, you can re-extract (this overwrites previous results).

F0 曲线是只读的——无法直接编辑。MIDI 音符编辑只影响音符数据,不影响 F0 曲线。如果对提取结果不满意,可以重新提取(会覆盖之前的结果)。

Singer Preview 歌手预览

The right panel of the Singer Creator shows a live preview of how the singer will appear:

歌手创建器右侧面板会实时预览歌手的最终外观:

Tips for Good Reference Audio 优质参考音频的建议

Singer Management 歌手管理

Singer Status Indicators 歌手状态指示

Deleting a Singer 删除歌手

Right-click a singer and select Delete Singer. This removes the singer and all its fragments from the project.

右键点击歌手并选择 Delete Singer。这会从项目中移除该歌手及其所有片段。

Singer File Validation 歌手文件校验

When loading a .sxssinger file, SXSEditor validates file format/version compatibility, required fields (name, reference audio), and data integrity (MIDI notes, F0 data). Validation errors are shown in a report dialog; warnings indicate non-critical issues.

加载 .sxssinger 文件时,SXSEditor 会校验文件格式/版本兼容性、必填字段(名称、参考音频)和数据完整性(MIDI 音符、F0 数据)。校验错误会显示在报告对话框中;警告表示非关键问题。