Architecture

Azure AI Speech vs Google Chirp 3 vs Amazon Transcribe on 153 voice notes: why InterMIND runs speech-to-text on your organization's own cloud gateway (2026)

We measured the speech-to-text services of the three cloud gateways an InterMIND organization can choose — Azure AI Speech, Google Cloud Speech-to-Text (Chirp 3) and Amazon Transcribe — on the same 153 voice-note clips in 17 languages, one harness, one day. Word error rates per language, the method, the limits of each API, and why the recogniser follows the gateway instead of the leaderboard.

The Mind.com Team

Azure AI Speech vs Google Chirp 3 vs Amazon Transcribe on 153 voice notes: why InterMIND runs speech-to-text on your organization's own cloud gateway (2026)

Azure AI Speech vs Google Chirp 3 vs Amazon Transcribe on 153 voice notes: why InterMIND runs speech-to-text on your organization's own cloud gateway (2026)

A voice note in an InterMIND channel becomes a text message that every teammate reads in their own language. The first step of that is speech-to-text, and the question we get from IT and compliance reviewers is not "how accurate is it" but "whose service is it, and where does the audio go".

The short answer: Azure AI Speech, the speech service of the default AI gateway, in InterMIND's own Azure tenant in Sweden Central — and the speech services of the two other gateways an organization can choose, measured on the same clips so the choice is a number, not a preference. This post shows the numbers behind that choice — the same 153 clips through Azure AI Speech, Google Cloud Speech-to-Text and Amazon Transcribe on the same day — and the two facts about each API that matter more than a percentage point of accuracy.

The rule comes first: one gateway per organization

Every AI feature in InterMIND — meeting recaps, document summaries, the writing assistant, Ask AI and Mia in the meeting — runs on one language-model gateway the organization selects: Azure OpenAI in the EU Data Zone by default, Google Vertex AI on the EU multi-region endpoint or Amazon Bedrock in Frankfurt by choice, each in InterMIND's own tenant. We explained the reasoning in Meeting AI on your own cloud gateway: for most organizations that gateway is already on the approved sub-processor list, so an AI feature adds no new company to the list.

Speech-to-text for voice notes follows the same rule on the default gateway today, and each of the three gateways has a speech service next to its language models — which is what this post measures:

GatewaySpeech serviceRegion used in this testHow the API takes a recording
Azure OpenAI (Microsoft)Azure AI Speech, fast transcription APISweden CentralOne request for a file up to 5 hours and 500 MB (fast transcription docs, checked September 2026)
Google Vertex AI (Google Cloud)Cloud Speech-to-Text v2, Chirp 3 modeleu multi-regionSynchronous recognition is limited to 60 seconds and 10 MB; longer audio goes through batch or streaming recognition (sync limits, Chirp 3, checked September 2026)
Amazon Bedrock (AWS)Amazon Transcribe, streamingeu-central-1 (Frankfurt)A streaming session over HTTP/2 or WebSocket; input is PCM, FLAC or Ogg-Opus (streaming docs, checked September 2026)

The recogniser is told the speaker's own language in every case — the language a member set in their profile — because automatic language identification proved unreliable on short clips in our testing: a four-second Russian note came back as English. That is how the product calls Azure today, and the test calls the other two the same way.

What we measured

The set. 153 clips in 17 languages: 136 dialogue turns — two business dialogues (a contract negotiation and a daily stand-up) spoken by the product's two synthetic voices in ten languages — plus 17 formal passages, the FLORES-200 business sentences of our public translation benchmark read by a synthetic voice, one per language and 71 to 109 seconds long. The dialogue turns are 3 to 30 seconds, the length of a real voice note.

The metric. Word error rate (WER) against the reference text — the fraction of words substituted, inserted or deleted — after normalizing case, punctuation and whitespace; Chinese and Japanese are compared per character. Character error rate was recorded alongside and tells the same story.

The harness. One script, one machine, one hour on 2026-09-16, each engine over all 153 clips. Azure and Amazon Transcribe took each clip whole. Google's synchronous recogniser takes at most 60 seconds, so the 17 formal clips were cut at silences into pieces under 55 seconds and the transcripts joined; the 136 dialogue clips went whole. Amazon Transcribe wants audio at a real-time pace, so the harness fed it four times faster than real time; its latency figure below is therefore a floor set by the feed, not the service.

What this is not. Synthetic voices in quiet audio, not field recordings from a phone in a car. One day, one run per clip. It is a comparison on the audio our own translation pipeline is tested on, in the languages our users write in — not a leaderboard.

Results: word error rate per language

Mean WER on the clips of each language; every engine returned a transcript for all 153 clips.

LanguageClipsAzure AI SpeechGoogle Chirp 3Amazon Transcribe
Arabic1332%46%26%
Chinese133%3%8%
Czech11%2%3%
Dutch12%2%3%
English212%5%2%
French135%11%12%
German137%9%13%
Hindi1310%10%12%
Hungarian19%7%8%
Italian11%1%3%
Japanese136%5%5%
Korean19%11%11%
Polish11%1%2%
Portuguese (Brazil)135%4%6%
Russian2114%10%14%
Spanish136%5%6%
Turkish14%3%4%
All 153 clips1539%10%10%
Dialogue turns only1369%11%10%
Formal passages only174%5%5%
Processing time ÷ audio length0.100.220.41 (feed-bound)

Languages with a single clip (the formal passage only) are shown for completeness; a one-clip figure is a data point, not a rate.

What the numbers say

  • On the whole set the three services are within one point of each other: 9%, 10% and 10%. Every one of the 153 clips came back with a transcript from every engine — coverage of the 17 languages is complete on all three.
  • The differences are per language, and they go both ways. Azure had the lowest error rate on French (5% against 11% and 12%) and German (7% against 9% and 13%), and tied for lowest on English (2%, with Amazon Transcribe) and Chinese (3%, with Google). Amazon Transcribe had the lowest on Arabic (26% against 32% and 46%). Google had the lowest on Russian (10% against 14% and 14%), Portuguese, Hungarian and Turkish.
  • Arabic is hard for all three. The best result on the Arabic dialogue clips is one word in four wrong. That is consistent with what we saw on the translation side, where we withdrew Arabic from the meeting language picker in August 2026 until quality clears our bar (how many languages we support).
  • Processing time is well under real time on all three. A 30-second note takes about three seconds on Azure and about seven on Google in this harness; the Amazon figure is dominated by the paced feed.

Why Azure AI Speech stays the default

Three reasons, in the order that decided it.

1. The default gateway is Azure. An organization that has not chosen a gateway runs its AI features on Azure OpenAI in the EU Data Zone, so its voice notes are transcribed by Azure AI Speech in the same tenant. No additional sub-processor, no additional region. Microsoft states that Azure Speech does not store or process data outside the region of the Speech resource (regions page, checked September 2026); our resource is in Sweden Central, which is listed for fast transcription.

2. The API shape fits a voice note. A voice note in InterMIND can be up to ten minutes long (voice notes). Azure's fast transcription takes the whole recording in one request. Google's synchronous recognition stops at 60 seconds, so a ten-minute note needs batch recognition through a storage bucket or a streaming session; Amazon Transcribe streams, but takes PCM, FLAC or Ogg-Opus rather than the formats phones and browsers record in, so the audio is transcoded first. Both are solvable — the harness solves them — but they are more moving parts in the path of every note.

3. The numbers do not argue against it. At 9% against 10% and 10%, no engine on this set is enough better to justify moving voice notes off the default gateway. If Google or Amazon had come in at half the error rate, this post would say so.

What this means for organizations on Vertex AI or Bedrock

If your organization selected Google Vertex AI or Amazon Bedrock as its gateway, your AI features run there. Voice notes in those organizations currently arrive as a recording without a transcript: we have measured Google Cloud Speech-to-Text and Amazon Transcribe, as this post shows, but have not wired them into the product yet. The permissions and the integration code exist; this post is updated when they are in the path of every note. Until then, a voice note in a Vertex AI or Bedrock organization is a playable recording; an organization that switches its gateway to Azure gets transcripts on the notes sent from then on.

FAQ

Which speech-to-text service does InterMIND use?

For voice notes in chat, Azure AI Speech (fast transcription API) in InterMIND's own Azure tenant in Sweden Central — the speech service of the default AI gateway. Live speech in meetings is a different path: it runs on InterMIND's own media engine, the Mind API, hosted at OVH in France, and never touches a cloud speech service (where one meeting runs).

Is Azure AI Speech more accurate than Google Speech-to-Text or Amazon Transcribe?

On our set of 153 voice-note clips in 17 languages, measured on the same day with the same harness, Azure AI Speech had a mean word error rate of 9%, Google Cloud Speech-to-Text (Chirp 3) 10% and Amazon Transcribe 10%. Per language the order changes: Azure was lowest on French, English and Chinese, Amazon Transcribe on Arabic, Google on Russian. On a different set of recordings the ranking can differ; the table above is the evidence for ours.

What is word error rate, and how was it computed here?

Word error rate is the number of substituted, inserted and deleted words divided by the number of words in the reference text. We normalize case, punctuation and whitespace before comparing, and compare Chinese and Japanese per character because those scripts do not separate words with spaces. A rate of 9% means roughly one word in eleven differs from the reference.

Does a voice note's audio leave the EU?

No. The recording is stored in InterMIND's object storage in the EU, and the speech service that transcribes it runs in an EU region: Sweden Central on Azure, the eu multi-region on Google Cloud, Frankfurt on AWS. The full list of parties and regions is on the subprocessors page and the trust page.

Why not recognise speech client-side, in the app, so the audio never leaves the phone?

We measured that too, in September 2026. Chrome's built-in recogniser with local processing recognised 0 of 17 formal clips across the product languages, and the language coverage of client-side recognisers is far narrower than the 17 languages in the table above. Client-side recognition is a direction we re-measure as the platforms improve; today the gateway path is the one that works for every member in every language.

Can our organization choose which speech service transcribes its voice notes?

Not separately: the AI gateway is what an organization admin selects on the Integrations page. On the default gateway, voice notes are transcribed by Azure AI Speech. On Vertex AI and Amazon Bedrock, voice notes are not transcribed yet — see the section above.

How long can a voice note be, and does the API limit it?

Up to ten minutes. Azure's fast transcription accepts files up to 5 hours and 500 MB in one request, so a note is transcribed in a single call. Google's synchronous recognition accepts 60 seconds and 10 MB, which is why the harness cut the long clips into pieces at silences.

Why does the recogniser get told the speaker's language instead of detecting it?

Because a voice note is short. On a four-second clip, automatic language identification can return the wrong language — a Russian test note came back as English; a member's profile language is right nearly every time. The recogniser gets that language, and only when it is unknown does it get the room's languages as candidates.

Is the meeting audio transcribed by the same service?

No. Live speech in a meeting is recognised and translated on InterMIND's own engine (the Mind API) on the media server that carries the call, hosted at OVH in France — see where one meeting runs. The cloud gateway sees text, never the audio of a call (meeting AI on your own gateway).

Will you publish the results again?

The harness runs on one command, and every engine's permissions are in place, so the table can be re-measured when a vendor ships a new model. When it changes the picture, this post is updated with the date.


See it for yourself


Sources: Microsoft — Azure AI Speech fast transcription (learn.microsoft.com) and Speech regions table (learn.microsoft.com); Google Cloud — Chirp 3 model (docs.cloud.google.com), synchronous recognition limits (docs.cloud.google.com) and supported languages (docs.cloud.google.com); AWS — Amazon Transcribe streaming (docs.aws.amazon.com), endpoints and quotas (docs.aws.amazon.com) and supported languages (docs.aws.amazon.com); all checked September 2026. Measurement: InterMIND speech bench, 2026-09-16, 153 clips, 17 languages.

Get new posts and product updates by email

One email a month with new posts and product updates. Unsubscribe anytime.