Jarvis is a free, open source input & dictation project written in TypeScript and released under MIT. It has 634 GitHub stars, 108 forks and 5 open issues, and was last pushed 28 days ago. On this registry it ranks #6 of 6 tracked projects in Input & Dictation, with 5 head-to-head comparisons available. It gained 7 stars over the last 6 tracked days.

What is Jarvis?

Jarvis is a free, MIT-licensed, open-source voice dictation and voice-control assistant for the Mac, built for anyone who wants hold-a-key dictation and local, private AI processing without a subscription.

What it is

Jarvis is a TypeScript desktop application for macOS that turns speech into clean, punctuated text. The workflow is deliberately small: hold the Fn key, speak, release, and formatted text appears in whatever application has focus. It lives in the Productivity & Utilities / Input & Dictation category and covers both dictation and lightweight assistant behaviour, so the same keystroke can clean up a rambling sentence, rephrase it as a bullet list, or trigger a short action such as "open YouTube" or "set 5-min timer".

The concrete problem it solves is the paid dictation subscription. The project's README opens by noting that Wispr Flow raised $81 million to build a voice dictation app, and Jarvis exists as one developer's open-source answer to that. Where the commercial path charges roughly $10–24 per month and offers no offline mode, Jarvis is free forever, runs under the MIT licence, and can transcribe entirely on-device through local Whisper or NVIDIA Parakeet models. Speech and text never have to leave the machine, and the README states plainly that there is zero tracking and zero telemetry.

Key capabilities

  • Hold Fn to record, double-tap Fn to toggle hands-free mode, and press Escape to cancel a recording.
  • Offline transcription with local Whisper (tiny, base, or small) or NVIDIA's 600M-parameter Parakeet model via Sherpa-ONNX.
  • Local LLM post-processing through Ollama, with automatic model detection; the README shows ollama pull sam860/LFM2:1.2b and ollama pull llama3 as examples.
  • Cloud transcription and generation using Deepgram plus Gemini, with a free tier of 1M tokens per day; Deepgram requests default to mip_opt_out=true.
  • Automatic filler removal for words such as "um" and "like", plus grammar correction, rephrasing, bullet-point formatting, and text generation.
  • Full prompt engineering: every behaviour, including mail formatting, dictation cleanup, and assistant responses, is customizable through prompts and custom voice commands.
  • Distribution as signed and notarized DMGs for Apple Silicon (M1/M2/M3/M4) and Intel x64, plus an iOS build on TestFlight.

Who uses it and how

  • Mac users on Apple Silicon who download the M1/M2/M3/M4 DMG and run dictation across any application without granting a cloud service their audio.
  • Privacy-conscious users who pick the "local-only" onboarding path, enabling a local model under Settings → Transcription so no API keys are required at all.
  • Intel Mac owners who install the x64 DMG and get the same dictation workflow on older hardware.
  • Users who prioritise speed or accuracy over strict locality, pasting free Deepgram and Gemini keys and accepting a cloud round trip.
  • Developers who build from source with Node.js 18+, macOS 10.13+, and Xcode CLI tools, running npm install && npm run build && npm run dev.

Getting started

Download the signed and notarized DMG from the GitHub releases page, choosing the Apple Silicon or Intel x64 build, then enable a local model under Settings → Transcription or paste Deepgram and Gemini keys. Local LLM support additionally requires installing Ollama separately and enabling "Use Ollama" under Settings → AI Models.

How it compares

The README sets Jarvis directly against a paid dictation product priced at roughly $10–24 per month and against the broader "$700M startups" framing, contrasting them on licence (MIT versus proprietary), offline capability (local Whisper and Parakeet versus none), telemetry (none versus undisclosed), and cost model (free forever versus subscription). The most concrete difference is data ownership: with a local model enabled, audio and text stay on the machine rather than being sent to a vendor.

When to use it — and when not to

Choose Jarvis if the machine is a Mac running macOS 10.13 or later and the priority is free, auditable, offline-capable dictation. Be aware of the operating costs: local LLM post-processing adds roughly one to three seconds of latency on typical M1 and M2 chips, and faster results on standard hardware mean using Deepgram with Gemini or local Whisper with Gemini Flash instead. Windows users should look elsewhere, since a Windows version remains an unchecked roadmap item, and anyone unwilling to install Ollama or manage API keys should expect a narrower local setup.

project readme (upstream, from github) — read inline

Jarvis AI Assistant

Hold one key. Speak. Text appears — perfectly.

100% open-source • 100% local-capable • 100% free forever

https://github.com/user-attachments/assets/763ea6aa-87d5-4e0a-9f05-a2bdaa82f40f

▶ Watch full 2-min demo on YouTube


The (short) story

Wispr Flow raised $81 million to build a voice dictation app.
I got annoyed, spent 3 months of late nights building my own version, and open-sourced it.

That's it.
No funding. No team. Just one stubborn developer who hates subscriptions.

This is what open source is supposed to be.


Why people actually use it

  • Hold Fn → speak → release → clean, punctuated text appears anywhere
  • Removes "um", "like", all fillers automatically
  • Fixes grammar, can rephrase, bullet-point, or even generate text
  • Tiny actions already work ("open YouTube", "set 5-min timer")
  • Full Prompt Engineering: Every behavior is customizable. Tweak how Jarvis formats mail, cleans dictation, or behaves as an assistant.
  • Fully offline with local Whisper or NVIDIA Parakeet (via Sherpa-ONNX)
  • 100% Private, Blazingly Fast support for local LLMs via Ollama
  • Or use cloud speed with Deepgram + Gemini (1M tokens/day free) — Deepgram requests default to mip_opt_out=true

Zero tracking. Zero telemetry. Zero bullshit.


Download

Platform Link
🍎 Mac (Apple Silicon) Download DMG (M1/M2/M3/M4)
💻 Mac (Intel) Download DMG (x64)
📱 iOS (iPhone/iPad) TestFlight (NEW!)

✅ Signed & notarized by Apple → no scary warnings.


Jarvis vs $700M startups

Jarvis The $700M one
💰 Price Free forever $10–24/month
🔇 Offline / Local Yes (Whisper + Parakeet) No
🔓 Open Source Yes (MIT) No
📡 Telemetry None ???
👨‍💻 Built by 1 guy at 2am VC money

Quick setup (30 seconds)

  1. Download & open the app
  2. Go Local (Recommended for privacy):
    • Settings → Transcription → Enable Local Model
    • Choose Whisper (tiny/base/small) or Parakeet (NVIDIA's 600M param model)
    • Settings → AI Models → Enable Ollama (requires Ollama installed)
  3. Or Go Cloud (Recommended for speed/accuracy):
    • Paste free Deepgram + Gemini keys
  4. Hold Fn and talk

That's literally it.


🦙 Ollama (Local LLM) Support

Jarvis now supports running any LLM locally via Ollama. It's fast, private, and free.

  1. Install Ollama: Download here
  2. Pull a model:
    # LFM2 (optimized for speed)
    ollama pull sam860/LFM2:1.2b
    
    # Llama 3 (standard)
    ollama pull llama3
    
  3. Enable in Jarvis:
    • Settings → AI Models → Enable Use Ollama
    • Select your model from the dropdown (Jarvis auto-detects them!)

⚡ Performance Note

Running models locally depends heavily on your hardware.

  • Enabled AI Post-Processing: Adds ~1-3s latency on typical M1/M2 chips.
  • Disabled AI Post-Processing: Instant transcription.
  • High-End Hardware: M1/M2/M3 Max/Ultra chips are nearly instant.

For Lightning Fast Performance: If speed is critical, use Deepgram + Gemini (Cloud) or Local Whisper + Gemini Flash, which are significantly faster than local LLMs on standard hardware.


Keyboard shortcuts

Shortcut What it does
Fn (hold) Start/stop recording
Fn (double-tap) Toggle hands-free mode
Escape Cancel recording

Build from source

git clone https://github.com/akshayaggarwal99/jarvis-ai-assistant.git
cd jarvis-ai-assistant
npm install && npm run build && npm run dev

Requires Node.js 18+, macOS 10.13+, Xcode CLI tools.


Roadmap (help me choose!)

  • Proper "local-only" onboarding (no fake keys needed)
  • AWS Bedrock support
  • Ollama support
  • Custom voice commands & prompts
  • iOS (TestFlight available!)
  • NVIDIA Parakeet support (via Sherpa-ONNX) — blazing fast local transcription
  • Windows version
  • Clipboard magic & multi-step actions
  • Streaming transcription (real-time words as you speak)

Open issues, vote, or drop crazy ideas → github.com/.../issues


Wanna contribute?

Jarvis is a community project. If you're a developer and want to help build the future of local-first AI, check out our Contributing Guidelines.

Wanna help?

Every star pushes this higher so more people discover they don't need another subscription.

     

Or just use it and tell one friend. That's enough.


⭐ Star History


Built with caffeine and spite by Akshay

Open source isn't about beating giants.
It's about making sure no one ever has to pay them.

MIT License — do whatever you want with it.

Frequently asked questions

Is Jarvis free to use?

Jarvis is open source under the MIT licence. There is no licence fee and no seat count — you can self-host it or, where the project offers one, pay a vendor for a managed version instead.

What does Jarvis do?

Dictate faster and control your Mac with voice

What is Jarvis written in?

Jarvis is primarily written in TypeScript. Its source is publicly available at https://github.com/akshayaggarwal99/jarvis-ai-assistant, and it has 634 GitHub stars.