Hebrish: English–Hebrew Code-Switching
English speakers who have moved to Israel tend to talk in a hybrid: English sentences carrying everyday Hebrew words — makolet, teudat zehut, Bituach Leumi. Stock speech recognition models transcribe these phonetically, and text-to-speech reads them as English. I'm building the data and models to close that gap for immigrant speakers, starting with Hebrew and in a way that carries over to other heritage-language communities.
Hebrish is the first result: on-device English dictation that writes the Hebrew words correctly, in romanized form. It is a fine-tune of NVIDIA Parakeet TDT 0.6B v2, trained on my own recordings. It runs in the Hebrish apps: an Android voice keyboard plus tray apps for Ubuntu and Windows. There are two models in the apps: Jachnun v1.0 for code-switching, and Sabich v1.0, which adds tech vocabulary and other dictation data. Both are retrained from stock Parakeet, not stacked on each other. Their results, and the other model lines, are in the ASR fine-tunes catalogue. It is a worked example of fine-tuning a speech model on a small custom dataset and shipping it on-device.
- ASR fine-tunes catalogue Every model line (Jachnun, Sabich, Boxty and more), what each is for and how they differ
- hebrish.app Project website
- Parakeet-TDT-0.6B-v2-English-Hebrew-Codeswitching Model weights for Jachnun v1.0
- English-Hebrew-Codeswitching-Sentences Read-aloud audio with a term-disjoint test split
- English-Hebrew-Codeswitching-Parakeet-Demo Try the model in the browser
- Sabich-sherpa-onnx-int8 Sabich v1.0, the build the apps run
- Hebrish-App The Android, Ubuntu and Windows apps
- PoC-3 write-up How an earlier proof-of-concept checkpoint (published as v3) was trained and evaluated
- hebrew-latin-token-classifier Finds romanized Hebrew inside English text (span F1 0.94)
- hebrew-latin-code-switching Token-level BIO corpus the classifier is trained on
- Whisper-Hebrish Earlier Whisper Large v3 Turbo fine-tune on code-switched speech