Introduction The icefall project contains speech-related recipes for various datasets using k2-fsa and lhotse. You can use sherpa, sherpa-n…
Introduction The icefall project contains speech-related recipes for various datasets using k2-fsa and lhotse. You can use sherpa, sherpa-n…
The icefall project contains speech-related recipes for various datasets using k2-fsa and lhotse.
You can use sherpa, sherpa-ncnn or sherpa-onnx for deployment with models in icefall; these frameworks also support models not included in icefall; please refer to respective documents for more details.
You can try pre-trained models from within your browser without the need to download or install anything by visiting this huggingface space. Please refer to document for more details.
Please refer to document for installation.
Please refer to document for more details.
[yesno][yesno]
[Aidatatang_200zh][aidatatang_200zh]
[Aishell][aishell]
[Aishell2][aishell2]
[Aishell4][aishell4]
[Alimeeting][alimeeting]
[AMI][ami]
[CommonVoice][commonvoice]
[Corpus of Spontaneous Japanese][csj]
[GigaSpeech][gigaspeech]
[LibriCSS][libricss]
[LibriSpeech][librispeech]
[Libriheavy][libriheavy]
[Multi-Dialect Broadcast News Arabic Speech Recognition][mgb2]
[SPGISpeech][spgispeech]
[Switchboard][swbd]
[TIMIT][timit]
[TED-LIUM3][tedlium3]
[TAL_CSASR][tal_csasr]
[Voxpopuli][voxpopuli]
[XBMU-AMDO31][xbmu-amdo31]
[WenetSpeech][wenetspeech]
More datasets will be added in the future.
The [LibriSpeech][librispeech] recipe supports the most comprehensive set of models, you are welcome to try them out.
If you are willing to contribute to icefall, please refer to contributing for more details.
We would like to highlight the performance of some of the recipes here.
This is the simplest ASR recipe in icefall and can be run on CPU.
Training takes less than 30 seconds and gives you the following WER:
[test_set] %WER 0.42% [1 / 240, 0 ins, 1 del, 0 sub ]We provide a Colab notebook for this recipe:
Please see RESULTS.md for the latest results.
| test-clean | test-other | |
|---|---|---|
| WER | 2.42 | 5.73 |
We provide a Colab notebook to test the pre-trained model:
| test-clean | test-other | |
|---|---|---|
| WER | 6.59 | 17.69 |
We provide a Colab notebook to test the pre-trained model:
| test-clean | test-other | |
|---|---|---|
| greedy_search | 3.07 | 7.51 |
We provide a Colab notebook to test the pre-trained model:
| test-clean | test-other | |
|---|---|---|
modified_beam_search (beam_size=4) |
2.56 | 6.27 |
We provide a Colab notebook to test the pre-trained model:
WER (modified_beam_search beam_size=4 unless further stated)
| Encoder | Params | test-clean | test-other | epochs | devices |
|---|---|---|---|---|---|
| Zipformer | 65.5M | 2.21 | 4.79 | 50 | 4 32G-V100 |
| Zipformer-small | 23.2M | 2.42 | 5.73 | 50 | 2 32G-V100 |
| Zipformer-large | 148.4M | 2.06 | 4.63 | 50 | 4 32G-V100 |
| Zipformer-large | 148.4M | 2.00 | 4.38 | 174 | 8 80G-A100 |
| Encoder | Params | test-clean | test-other |
|---|---|---|---|
| Zipformer | 65.5M | 1.78 | 4.08 |
| Encoder | Params | test-clean | test-other |
|---|---|---|---|
| Zipformer | 65.5M | 1.90 | 3.98 |
| Dev | Test | |
|---|---|---|
| WER | 10.47 | 10.58 |
Conformer Encoder + Stateless Predictor + k2 Pruned RNN-T Loss
| Dev | Test | |
|---|---|---|
| greedy_search | 10.51 | 10.73 |
| fast_beam_search | 10.50 | 10.69 |
| modified_beam_search | 10.40 | 10.51 |
| Dev | Test | |
|---|---|---|
| greedy_search | 10.31 | 10.50 |
| fast_beam_search | 10.26 | 10.48 |
| modified_beam_search | 10.25 | 10.38 |
| test | |
|---|---|
| CER | 10.16 |
We provide a Colab notebook to test the pre-trained model:
| test | |
|---|---|
| CER | 4.38 |
We provide a Colab notebook to test the pre-trained model:
WER (modified_beam_search beam_size=4)
| Encoder | Params | dev | test | epochs |
|---|---|---|---|---|
| Zipformer | 73.4M | 4.13 | 4.40 | 55 |
| Zipformer-small | 30.2M | 4.40 | 4.67 | 55 |
| Zipformer-large | 157.3M | 4.03 | 4.28 | 56 |
1 Trained with all subsets:
| test | |
|---|---|
| CER | 29.08 |
We provide a Colab notebook to test the pre-trained model:
| TEST | |
|---|---|
| PER | 19.71% |
We provide a Colab notebook to test the pre-trained model:
| TEST | |
|---|---|
| PER | 17.66% |
We provide a Colab notebook to test the pre-trained model:
| dev | test | |
|---|---|---|
modified_beam_search (beam_size=4) |
6.91 | 6.33 |
We provide a Colab notebook to test the pre-trained model:
| dev | test | |
|---|---|---|
modified_beam_search (beam_size=4) |
6.77 | 6.14 |
We provide a Colab notebook to test the pre-trained model:
| Dev | Test | |
|---|---|---|
| greedy_search | 5.53 | 6.59 |
| fast_beam_search | 5.30 | 6.34 |
| modified_beam_search | 5.27 | 6.33 |
We provide a Colab notebook to test the pre-trained model:
| Dev | Test-Net | Test-Meeting | |
|---|---|---|---|
| greedy_search | 7.80 | 8.75 | 13.49 |
| fast_beam_search | 7.94 | 8.74 | 13.80 |
| modified_beam_search | 7.76 | 8.71 | 13.41 |
We provide a Colab notebook to test the pre-trained model:
| Dev | Test-Net | Test-Meeting | |
|---|---|---|---|
| greedy_search | 8.78 | 10.12 | 16.16 |
| fast_beam_search | 9.01 | 10.47 | 16.28 |
| modified_beam_search | 8.53 | 9.95 | 15.81 |
| Eval | Test-Net | |
|---|---|---|
| greedy_search | 31.77 | 34.66 |
| fast_beam_search | 31.39 | 33.02 |
| modified_beam_search | 30.38 | 34.25 |
We provide a Colab notebook to test the pre-trained model: [](https://colab.research.google.com/drive/1tK
No open issues yet, or sync has not completed.