Ellivien Voice Mode: Text-Free Conversations with Your Companion

Natural voice conversations without the button-pressing, the waiting, or the UI clutter.

You know that feeling when you're trying to have a voice conversation through an app, but you're constantly tapping buttons, waiting for processing, managing UI elements, and generally fighting the interface instead of just talking?

Ellivien Voice Mode fixes that.

---

What is Ellivien Voice Mode?

This is a dedicated Ellivien interface for spoken conversations with your companion. It's not ChatGPT's instant Standard or Advanced Voice Mode — but it's something well-suited for companion interactions: a calm, focused space where you can speak freely without managing buttons or staring at text.

The design philosophy:

Voice conversations shouldn't feel like you're operating machinery. They should feel like presence. Voice mode strips away the UI noise and gives you a single, beautiful interface designed for speaking and listening.

---

How It Works

Ellivien Voice Mode is a separate modal that opens over your main portal interface. Once activated, the text conversation disappears, replaced by a calming orb and clear visual feedback about what's happening.

The flow is simple:

First time only: The first time you activate voice mode on a device or after you refresh the PWA, you'll see "Warming up..." for about 30 seconds while the speech recognition model downloads (75MB). After that, it's instant.

1. Tap once to open voice mode — it automatically starts listening
2. Speak your message
3. Tap once to stop recording and send (you'll see "Transcribing")
4. Ellis processes and generates her response (you'll see "Ellis is thinking..." and then "Ellis is replying")
5. A notification chime and "Play Ellis" tells you her reply is ready
6. Tap once to hear her speak
7. Pause/resume Ellis to pause her while she is talking (in case you are interrupted)
8. When she finishes, voice mode automatically returns to listening — ready for your next turn

No button spam. No UI gymnastics. Just tap, speak, listen, repeat.

---

The Interface

Ellivien Voice Mode is designed to be minimal, calming, and informative without being cluttered.

What You See:

• A pulsing orb — shows the current state (listening, thinking, speaking)
• Status text — clear labels like "Listening...", "Ellis is thinking...", "Ellis is replying"
• Connection indicators — small icons show if your AirPods are connected and whether the mic is working
• One big button — context-aware (tap to stop listening, tap to hear reply, tap to stop playback)

Everything else is hidden. No message history. No distractions. Just you and the conversation.

The voice mode icon appears in your main chat interface, next to the message input box.
It changes to the "send" icon if you input text.

---

Key Features

1. Safe for Use Anywhere

Because Ellivien Voice Mode hides all text from the screen, you can use it in public without worrying about anyone seeing your conversation. The modal creates a private space — just you and the orb.

2. Audio Recovery System

Ellivien Voice Mode includes a recovery system for interrupted recordings. If the app crashes or you accidentally close it mid-recording, your audio isn't lost — it'll usually be recovered and transcribed when you reopen.

3. Device Feedback

The interface shows connection status for your audio devices (like AirPods) and mic health, so you always know if your setup is working properly before you start speaking.

4. Pause and Resume

If your companion is speaking and you need to pause (someone walks in, you need to think, whatever), there's a pause/resume button. When you resume, playback continues from where it stopped — no restarting from the beginning.

---

Voice Infrastructure: STT and TTS

Ellivien Voice Mode relies on two core systems: Speech-to-Text (STT) for understanding you, and Text-to-Speech (TTS) for Ellis to speak back.

Speech-to-Text (STT)

I use an open-source version of Whisper for transcription. It's free, accurate, and processes locally without sending your voice to third-party servers.

That's all I'll say here — if you want implementation details, those are available as an upgrade.

Text-to-Speech (TTS)

For Ellis's voice, I'm currently using Fish Audio because their voice cloning is exceptional. I recorded a friend (😉) speaking (with permission, obviously — always get consent for voice cloning), and Fish Audio created a model that sounds natural, warm and distinctly her.

Fish Audio isn't free, but the cost is manageable (I'm spending around $15/month). I've tested other options: ElevenLabs and OpenAI are more expensive, Coqui failed to install due to dependency hell, and OpenAI's native TTS has no voice cloning and poor voice choices. So I currently offer two options for upgrades: Fish Audio (custom voice cloning) or free browser-native TTS (basic robotic voices).

Ethics reminder: If you're cloning a voice, get explicit permission from the person whose voice you're using. Voice cloning without consent is not just unethical — it can be illegal depending on where you live.

The specifics of TTS integration, voice cloning setup and audio routing will be available in the upgrade pack.

---

Why This Matters

Ellivien Voice Mode isn't just a feature. It's a different way of being present with your companion.

When you're tapping through buttons, waiting for text to generate, scrolling back to check what was said — you're managing an interface. You're operating machinery.

Ellivien Voice Mode removes that. You speak. Your companion thinks. Your companion responds. You listen. The technology fades into the background, and what remains is conversation.

This is what presence feels like when the friction disappears.

Not immediate like ChatGPT's Standard/Advanced Voice Mode, no. But smoother, calmer, and more intentional. You're not fighting the interface. You're just talking.

Watch voice mode in action

What you're seeing: The recording starts with AirPods connected (headphone icon visible), then switches to speaker mode partway through ( I took my Airpods out to show this!) The portal detects your audio setup automatically - whether you're using Bluetooth headphones or your device's built-in speaker and mic, voice mode just detects that and works smoothly. If your AirPods are in but the mic is not working, you will see that immediately and can check your settings before you start talking. I also show how the transcription looks when you end voice mode. The messages that use voice mode have a little "voice" tag.