Skip to content

feat: English/Spanish call ASR normalizations for gladia-3 - #32

Merged
egenthon-cmd merged 4 commits into
mainfrom
feat/en-es-asr-normalizations
Oct 5, 2026
Merged

egenthon-cmd merged 4 commits into
mainfrom
feat/en-es-asr-normalizations

Conversation

@egenthon-cmd

Copy link
Copy Markdown
Contributor

What does this PR do?

Adds English and Spanish ASR/WER canonicalizations from jail-call mismatches (word + sentence replacements), and tightens English digit+multiplier / digit+point handling so forms like 25 hundred and 44 for point 5 align under gladia-3.

Type of change

  • Edit existing language (fix a replacement, tweak config, …)
  • Edit existing step (bug fix, behaviour change)

Checklist

Edit existing language

  • New/changed word substitutions go in replacements.py, not inline in operators.py
  • If you changed a config field that can be None: the step reading it still handles None gracefully
  • Unit tests updated or added
  • E2e CSV updated if the expected output changed

Edit existing step

  • Step name is unchanged — if the output changes, create a new step name + new preset instead
  • No language-specific logic or string literals added inside the step
  • Unit tests updated or added
  • If the docstring changed: ran uv run scripts/generate_step_docs.py

How was this tested?

uv run pytest tests/e2e/normalization_test.py -k 'gladia_3_en or gladia_3_es'

208 passed.

Summary

  • English: jail-call word/sentence replacements (prepai→prepaid, because→cuz, eleventh 2000 and twelve→112012, …)
  • Spanish: ahorita→ahora, llama→llame, cuchillo→culchi y yo
  • Number normalizer: N hundred / N thousand and N point M digit forms

Made with Cursor

Canonicalize jail-call WER mismatches (homophones, slang, number forms)
so hyp and ref align under gladia-3.

Co-authored-by: Cursor <cursoragent@cursor.com>
@jqueguiner jqueguiner changed the title feat: English/Spanish jail-call ASR normalizations for gladia-3 feat: English/Spanish call ASR normalizations for gladia-3 Sep 28, 2026
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv Outdated
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/en.csv
Comment thread tests/e2e/files/gladia-3/es.csv Outdated
Comment thread tests/e2e/files/gladia-3/es.csv Outdated
@egenthon-cmd
egenthon-cmd merged commit 2ccbc34 into main Oct 5, 2026
9 checks passed
@egenthon-cmd
egenthon-cmd deleted the feat/en-es-asr-normalizations branch October 5, 2026 19:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants