Karaoke from any song in your music library, powered by neural networks.

Nightingale scans your music folder, Plex Media Server, Jellyfin server, Navidrome server, or self-hosted web library; separates lead vocals from instrumentals using the UVR Karaoke model (or Demucs); transcribes lyrics with word-level timestamps via WhisperX; and plays it all back with synchronized highlighting, pitch scoring, key/tempo controls, profiles, and dynamic backgrounds.

Ships as a single binary. No manual installation of Python, ffmpeg, or ML models required — everything is downloaded and bootstrapped automatically on first launch.

Features

Library & sources

📁 Folder library — point at any folder and Nightingale scans supported audio, video, and UltraStar files inside.

🟠 Plex — connect to a local, remote, or LAN-only Plex Media Server, select one or more music libraries, and import tracks, associated music video clips, covers, and read-only playlists. Hosted Plex sign-in discovers servers; an advanced PMS URL + token flow works without plex.tv during normal operation.

🎬 Jellyfin — play straight from your Jellyfin library. Songs cache locally on first play so karaoke runs the same as a folder library.

💿 Navidrome — connect to Navidrome for audio libraries. Login details are kept encrypted on disk.

🌐 Self-hosted web mode — run Nightingale on a Linux box on your home network and open it from phones, laptops, tablets, and TVs at .local. See docs/self-hosted. Also runs in Docker (CPU or CUDA/GPU).

🧭 Sidebar + library filters — browse by quick filters, metadata cleanup buckets, artists, albums, and existing playlists from Plex, Jellyfin, Navidrome, or folder-library .m3u / .m3u8 / .pls files. Analyze All and optional auto-analysis help queue your library faster, and the sidebar/song list remember scroll position when you come back.

🗂️ Flexible storage — choose the main data folder during setup, then split cache, models, videos, and vendor tools into separate folders from Settings when needed.

📦 Self-contained — ffmpeg, uv, Python, PyTorch, and ML packages are downloaded automatically during setup. Video backgrounds are pre-downloaded so the first session is ready to go.

Lyrics & audio

🎤 Stem separation — isolates lead vocals from instrumentals using the UVR Karaoke model (default) or Demucs, with adjustable guide vocal volume. The karaoke model preserves backing vocals in the instrumental for a more natural sound.

📝 Word-level lyrics — automatic transcription with alignment, or fetched from LRCLIB when available.

✏️ Lyrics editor with LRCLIB browser — edit lyrics, browse LRCLIB matches, or paste your own LRC / Enhanced LRC from a song's Actions button. Timed LRC is used as-is (optionally skipping stem separation to sing over the original mix); plain lyrics run alignment.

🈯 CJK lyric support — Japanese, Chinese, Cantonese, and Korean songs get per-character forced alignment and romanized readings (Hepburn / pinyin / Jyutping / Revised Romanization) shown above each token.

🗣️ Pluggable ASR engines — choose Whisper (default, broad language coverage) or Parakeet v3 (experimental) for ~25 European languages, with NeMo on CUDA and ONNX Runtime everywhere else.

⚡ Pluggable forced alignment — keep WhisperX's aligner (default) or switch on an experimental backend: GPU forced alignment (torchaudio forced_align) for faster word timestamps on CUDA and Apple Silicon, or the Qwen aligner (Qwen3-ForcedAligner-0.6B) which timestamps 11 languages incl. CJK in a single pass on CUDA/MPS/CPU. Both fall back to WhisperX automatically.

🎼 UltraStar Deluxe songs (experimental) — drop USDX song folders (.txt or .usdx plus sibling audio/vocals/instrumental/video) into your library; pitch and lyric data come from the file directly, no analyzer pass needed. See docs/usdx.

Playback & visuals

🎯 Pitch scoring — real-time microphone input with pitch detection, star ratings, and per-song scoreboards.

🎚️ Key & tempo shifts — adjust song key and tempo after analysis, with cached playback variants for quick retries.

🎬 Video files — drop video files (.mp4, .mkv, etc.) into your music folder; vocals are separated from the audio track and the original video plays as a synchronized background.

🌌 Audio-reactive backgrounds — 10 GPU shaders that react to your microphone in real time (Plasma, Waves, Nebula, Starfield, Sonar, Voronoi, Vortex, Metaballs, Spectrum, Oscilloscope), Pixabay video loops in 5 flavors (Nature, Underwater, Space, City, Countryside), plus source-video playback for video files.

🎙️ Mic monitoring + latency test — optionally route your live mic into playback, adjust monitor gain (0–200%), and run a beep-based latency test from Settings so scoring lines up with your room.

Quality of life

👤 Profiles — create and switch between player profiles; scores are tracked per profile.

🎮 Gamepad support — full navigation and control via gamepad (D-pad, sticks, face buttons).

📺 Adaptive + touch-friendly UI — scales from phones/tablets to 4K TVs, with on-screen playback controls on touch devices.

⬆️ In-app updates — on macOS and Windows, auto-checks for new releases at launch, badges the sidebar avatar when one is available, and downloads and installs signed updates with one click. Linux is manual: the Update entry opens GitHub Releases for you to grab the new build.

Quick start

Download the latest release for your platform from the Releases page and run it. On first launch, Nightingale shows setup steps, lets you pick a data folder, then installs the Python environment and ML models automatically.

Updates

On macOS and Windows, Nightingale checks for new releases once at launch. When one is available, the sidebar avatar grows a small green dot and the Update entry in the dropdown menu opens a dialog with the release notes. Click Install & Restart and the app downloads the signed bundle, installs it, and relaunches. On Windows the installer runs in passive mode — a small progress window flashes and the app comes back automatically once the install finishes.

Linux

Auto-update is not supported on Linux — the app ships without the updater plugin. The Update entry still appears in the sidebar menu, but it just opens a dialog explaining this with a one-click button to the Releases page so you can grab the new .deb or .rpm and install it the usual way for your distro.

macOS

macOS quarantines files downloaded from the internet. Since Nightingale isn't signed with an Apple Developer ID, Gatekeeper will block it with a message like "app is damaged and can't be opened". To fix this, remove the quarantine attribute after moving the Nightingale.app to Applications:

xattr -cr /Applications/Nightingale.app

Supported formats

Audio: .mp3, .flac, .ogg, .opus, .wav, .m4a, .aac, .wma. Video: .mp4, .mkv, .avi, .webm, .mov, .m4v. UltraStar: .usdx, plus .txt files whose contents look like USDX.

Controls

Navigation

Playback

How it works

flowchart TD
    A["Audio or video file"] --> B["UVR Karaoke / Demucs"]
    A2["USDX bundle (.txt / .usdx)"] --> E["Tauri App (Rust + React)"]
    B -->|"vocals + instrumental"| C["LRCLIB"]
    C -->|"synced lyrics if available"| D["WhisperX or Parakeet v3 (exp.)"]
    D -->|"word-level alignment, CJK reading"| E
    E --> F["Plays instrumental + synced lyrics with pitch scoring, key/tempo, mic monitoring, audio-reactive backgrounds"]

The analyzer runs as a persistent local process: Nightingale starts it once and talks to it over a token-authenticated loopback TCP socket using newline-delimited JSON, so per-song startup overhead (model load, CUDA init) is paid only once.

Analysis results are cached using blake3 file hashes. Re-analysis only happens if the source file changes, the user triggers it manually, or you choose to shift key/tempo and create playback variants. USDX songs skip stem separation entirely when #VOCALS and #INSTRUMENTAL are provided.

Hardware

The Python analyzer uses PyTorch and auto-detects the best backend:

The UVR Karaoke model uses ONNX Runtime and enables CUDA acceleration automatically on NVIDIA GPUs, or CoreML on Apple Silicon.

A song typically takes 2–5 minutes on GPU, 10–20 minutes on CPU.

Data storage

During setup, you can choose where Nightingale stores data (default: ~/.nightingale). Most runtime data is stored in that selected data folder, while config.json and nightingale.log remain in ~/.nightingale.

Typical selected data folder layout:

<selected-data-folder>/
├── cache/               # Stems, transcripts, lyrics, shifted variants, covers, playable videos
├── songs.db             # SQLite song library and analysis metadata
├── profiles.json        # Player profiles and scores
├── videos/              # Cached Pixabay video backgrounds
├── sounds/              # Sound effects (celebration)
├── vendor/
│   ├── ffmpeg           # Downloaded ffmpeg binary
│   ├── uv               # Downloaded uv binary
│   ├── python/          # Python 3.10 installed via uv
│   ├── venv/            # Virtual environment with ML packages
│   ├── analyzer/        # Extracted analyzer Python scripts
│   └── .ready           # Marker indicating setup is complete
└── models/
    ├── torch/           # Demucs model cache
    ├── huggingface/     # WhisperX model cache
    └── audio_separator/ # UVR Karaoke model cache

~/.nightingale/config.json stores app settings, including the selected data folder path.

Video backgrounds

Pixabay video backgrounds use the Pixabay API. The API key is embedded in release builds. For development, create a .env file at the project root:

PIXABAY_API_KEY=your_key_here

Building from source

Prerequisites

Development

git clone <repo-url> nightingale
cd nightingale
cargo desktop dev

Release build

cargo desktop build

Supported platforms

Releasing

Releases are cut by .github/workflows/release.yml on any v* tag push. The workflow:

1. Verifies the tag matches the version in client/src-tauri/tauri.conf.json, client/src-tauri/Cargo.toml, and client/package.json.
2. Extracts the matching ## [] section from CHANGELOG.md as the release body.
3. Creates a draft release and, in parallel, builds and uploads:
   • Linux x86_64: .deb, .rpm (on ubuntu-22.04)
   • Linux aarch64: .deb, .rpm (on ubuntu-24.04-arm)
   • macOS ARM / Intel: .dmg + .app.tar.gz (+ .sig) for the in-app updater
   • Windows x86_64: *-setup.exe (NSIS, + .sig), *_en-US.msi (+ .sig)
   • latest.json covering darwin-aarch64, darwin-x86_64, and windows-x86_64 — Linux is intentionally absent since the updater plugin isn't compiled in for Linux.
4. Leaves the release as a draft. Smoke-test the artifacts from the draft, then flip it to Published with the "Set as the latest release" checkbox in the GitHub Releases UI to make https://github.com/rzru/nightingale/releases/latest/download/latest.json (the URL hard-coded in tauri.conf.json) resolve to it and start rolling out the in-app update.

Cutting a release:

# bump versions in client/src-tauri/tauri.conf.json, client/src-tauri/Cargo.toml, client/package.json
# add a `## [<version>] - YYYY-MM-DD` section to CHANGELOG.md
git tag v<version>
git push origin v<version>

Required repository secrets:

Contributing

Contributions are welcome, but Nightingale follows a discussion-first process: before writing any code for a new feature or change, please start a discussion thread so we can agree on whether it fits the app. Only once a discussion reaches approved status will a corresponding pull request be accepted.

See CONTRIBUTING.md for the full workflow.

Support the project

Nightingale is open-source, free, and built by one person in their spare time. If it brings you joy and you want to help keep development going, you can chip in:

• Patreon — recurring monthly support.
• Ko-fi — one-off tip, no account required.

Every bit helps cover site hosting, hardware for testing, and the time spent shipping new features. Thank you.

License

GPL-3.0-or-later — see LICENSE.