UX Encyclopedia

Voice Interaction Flow

A voice interaction flow maps a spoken dialogue plus the machinery around it: wake word → listening state → intent recognition → confirmation → spoken response → next turn (or earcon, timeout, reprompt). It is a conversation flow (Conversation Flow) with three constraints added: there may be no visual channel, speech is ephemeral (users can't re-read the last turn), and the context is often hands-free and eyes-busy — driving, cooking, field work. Design evidence lives in Voice & Conversational Interfaces; this file covers how to map the flow.

When to use

  • Designing a voice assistant skill, in-car voice task, or smart-speaker interaction.
  • Any hands-free or eyes-busy workflow (field checklists, kitchen, clinical, warehouse) where speech is the primary channel.
  • Auditing a voice feature where users get stuck, go silent, or bail to the phone.

What it answers

  • How does each turn begin and end — wake word, follow-up mode, timeout?
  • What does the system say, exactly, and how brief can it be?
  • Which actions confirm implicitly vs. explicitly?
  • What happens on silence, misrecognition, and repeated failure?

What it includes (the voice-specific layer)

  • Wake/invocation — wake word or push-to-talk; whether follow-up turns re-require it; a clear listening-state signal (light/earcon — a hardware norm across Alexa/Google/Siri, per Voice & Conversational Interfaces).
  • Intent recognition step — including the "recognized but wrong" branch: support "no, I meant…" corrections, not just no-match.
  • Confirmation strategy by stakes — implicit for low-risk ("OK, adding milk"), explicit readback before consequential actions ("Transfer $500 to Alex — should I go ahead?"). Mark each action in the flow with its confirmation level; never explicit-confirm everything (Voice & Conversational Interfaces; Cohen/Giangola/Balogh).
  • Response brevity — every system turn is copy, written for the ear and read aloud; ≤ ~3 options per turn, most likely option last (recency); push detail to a screen when one exists ("voice-forward, not voice-only" — Amazon's multimodal guidance).
  • Reprompt escalation — no-input and no-match ladders at every turn: hint → examples → alternative channel/human. Silence is an event in the flow, not an absence.
  • Earcons & timing — short non-speech sounds for listening, success, and failure; acknowledge fast (an earcon beats dead air — silence reads as failure).
  • End of session — an explicit wrap-up line, not an open mic.

How it differs from a general conversation flow

  • No scanning, no persistent state on screen: the flow must carry context in memory-sized pieces; summaries and readbacks replace visible confirmation screens.
  • Ephemerality: users can ask "what were the options again?" — plan a repeat/where-am-I intent at every step.
  • Interruption is physical: hands and eyes are elsewhere; turns must survive long pauses (the user is holding a drone, not a phone) — set generous no-input timeouts in task flows, and re-orient on resume ("We were on step 3, propellers.").
  • Barge-in is table stakes in the LLM era: users interrupt mid-answer and steer; the flow should treat interruption as input, not error.

Worked example: hands-free checklist stepper

Flow shape: a checklist stepper — one item per turn, binary answers, system tracks position; the classic pattern for eyes-busy procedures.

User:   "Start my drone preflight checklist."
System: "Starting. Is the battery fully charged?"     [step 1]
User:   "Yes."
System: "Confirm propellers are secure."              [step 2]
User:   "Confirmed."
System: "GPS lock acquired? Say yes, no, or wait."    [step 3]
User:   (silence — user is checking the controller)
System: (after generous timeout) "Take your time. Say 'ready'
         when you have a GPS answer."                 [no-input, kept
                                                       open, no nag]
User:   "Yes, locked."
System: "Preflight complete. 6 of 6 checks passed. Safe flight."

Branch — a check fails: "No." → "Noted: propellers not secure.
  Fix and say 'recheck', or say 'skip' to log it and continue."
Branch — "Repeat that" / "Where am I?" works at every step.
Branch — no-match ×3 → "I'll pause the checklist. Open the app to
  continue on screen, or say 'resume' anytime."   [channel handoff]

Note what the shape gives you: fixed sequence (safety order matters), one fact per turn, resumability, and a spoken summary at the end.

Common mistakes

  • Prompts written for the eye, not the ear — long, formal, unreadable aloud (violates Grice's quantity/manner; the top VUI failure).
  • More than ~3 options per turn, or the recommended option first.
  • Identical reprompt repeated verbatim on failure.
  • No listening-state signal, so users talk to a closed mic.
  • Confirmation screens' job given to nothing: consequential actions fire without readback.
  • Treating silence as error instead of a state (eyes-busy users pause).
  • Voice-only when a screen exists — no visual fallback or handoff.

Checklist

  • Wake/invocation and listening signal defined; follow-up mode set
  • Every system turn ≤ one question; copy read aloud and timed
  • ≤ 3 options per turn; most likely last
  • Confirmation level (implicit/explicit) marked on every action
  • No-input AND no-match ladders at every turn; never verbatim repeat
  • Repeat / where-am-I / go-back intents work at every step
  • Barge-in and mid-answer corrections handled
  • Earcons for listening/success/failure; fast acknowledgment
  • Handoff to screen or human defined, with context transferred
  • Session end is explicit; resumable tasks re-orient on return

Sources

  • Google — Conversation Design guidelines (developers.google.com/assistant/conversation-design) — turn-taking, error ladders; archival but sound.
  • Amazon — Alexa Design Guide / voice & multimodal design documentation (developer.amazon.com/alexa) — confirmation, brevity, voice-forward multimodal.
  • Pearl, C. (2016). Designing Voice User Interfaces. O'Reilly.
  • Cohen, M., Giangola, J. & Balogh, J. (2004). Voice User Interface Design. Addison-Wesley — confirmation strategies, reprompt design.
  • Grice, H. P. (1975). "Logic and Conversation." Syntax and Semantics 3.
  • Nielsen Norman Group — intelligent-assistant usability studies (nngroup.com).
↑↓ to navigate · Enter to open · Esc to close