Back to Bigger Picture

BIGGER PICTURE Accessibility & independence

The speech recogniser learns the speaker

When speech differs from the training data, a standard voice interface can repeatedly misunderstand its user. Project Relate reverses the burden: it builds a speech model around one person’s recordings.

AI-generated illustration: A speech recogniser adapts to an individual speaker’s patterns.
A speech recogniser adapts to an individual speaker’s patterns.AI-generated illustration of the idea, not a photograph of the actual people, equipment or event.
Personal training
500 recorded phrases in the app
Outputs
Text, spoken repetition and voice typing
Offline option
Listen works after the model is prepared

How the idea works

  1. Pair words and voice

    Known phrases provide labelled examples of personal speech.

  2. Personalise recognition

    The model learns the speaker’s recurring sound patterns.

  3. Choose an accessible output

    Recognised words become text, synthetic speech or typed input.

Being misunderstood is a system mismatch

Atypical speech can follow conditions such as cerebral palsy or stroke. A recogniser trained mainly on typical speech may perform poorly for these voices. Project Relate was introduced as a communication tool that learns individual patterns rather than expecting everyone to match the same pronunciation.

Sources: [1]

A personal set of examples

Users record phrases whose written words are known. Pairing the audio with that text gives the model examples of how this person produces speech. The current help page describes five hundred recordings, including optional custom phrases, before a personalised model is created.

Sources: [2]

One voice, several ways to be understood

The model can turn speech into readable text or repeat it through synthetic speech. Voice typing extends its use into other apps. These are practical bridges to a conversation partner or a text field. The Listen feature can operate without an internet connection once the model is available.

Sources: [2]

Personal does not mean equally successful for everyone

Underlying Google research showed large recognition improvements with personalised models, including severely impaired speech. That benchmark is not a measured outcome for every Relate user. The product itself warns that rapidly changing or very severely affected voices may remain difficult and that helpfulness varies between personal models.

Sources: [2][3]

The original sources

  1. GoogleA communication tool for people with non-standard speech
  2. Google ResearchProject Relate Help Center
  3. Google ResearchPersonalized ASR Models from a Large and Diverse Disordered Speech Dataset

What to explore next

A knock at the door becomes a vibration in your pocketForecasting a downpour without blurring it away
Explore all 99 applications