百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
F

firefox-translations-models

> 编程语言
开源

针对 Firefox 翻译的 CPU 优化神经机器翻译模型

464 stars0 点赞0 次浏览
访问官网GitHub

工具介绍

针对 Firefox 翻译的 CPU 优化神经机器翻译模型

This repository is not maintained anymore. Evaluation was migrated to mozilla/translations. The models are stored on Google Cloud Storage.

See:

  • Final Evaluation dashboard
  • Model Registry dashboard, JSON
  • Released Firefox Models dashboard

Firefox Translations models

CPU-optimized NMT models for Firefox Translations.

The model files are hosted using Git LFS.

The models are located in the /models directory and grouped by available configuration:

  • tiny - the fastest and the smallest models but with lower translation quality
  • base - best quality but slower and larger
  • base-memory - slightly lower quality than base but also lower memory footprint

Automatic quality evaluation

BLEU scores, COMET scores

The evaluation is run as part of a pull request in CI. The evaluation will automatically run, and then commits will be added to the pull request. The evaluation uses Microsoft and Google translation APIs, Argos Translate, NLLB and Opus-MT models and pushes results back to the branch (not available for forks). It is performed using the evals tool.

Model training

Use Firefox Translations training pipeline or browsermt/students recipe to train CPU-optimized models. They should have similar size and inference speed to already submitted models.

Training data

Do not use SacreBLEU or Flores datasets as a part of training data, otherwise evaluation will not be correct.

To see SacreBLEU datasets run sacrebleu --list.

Maintainers adding models

Create a pull request to the main branch from another branch in this repo (not a fork). This pull request should include the models, and the evaluation will be added as extra commits in the CI task.

Contributors adding models

Create a pull request to the contrib branch. When it is reviewed and merged, a maintainer should create a pull request from contrib to main. This second PR will run the automatic evaluation and add the evaluation commits.

Local testing

You can run model evaluation locally by running bash scripts/update-results.sh. Make sure to set environment variables GCP_CREDS_PATH and AZURE_TRANSLATOR_KEY to use Google and Microsoft APIs. If you want to run it with bergamot only, remove mentions of those variables from bash scripts/update-results.sh and remove microsoft,google from scripts/eval.sh.

Model types

Vocabulary

Prefix of the vocabulary file:

  • vocab. - vocabulary is reused for the source and target languages
  • srcvocab. and trgvocab. - different vocabularies for the source and target languages

GEMM precision

Suffix of the model file:

  • intgemm8.bin - supports gemm-precision: int8shiftAll inference setting
  • intgemm.alphas.bin - supports gemm-precision: int8shiftAlphaAll inference setting

Add a model from Taskcluster

  1. Run python scripts/pull_models.py [TASK_ID] where [TASK_ID] is a Taskcluster ID of the exporttask such asSjPZGW9CRYeb9PQr68jCUw`.
  2. Commit the changes, which adds the files and removes any previous evaluations.
  3. Push the changes to origin and open a PR.
  4. Wait for the CI to run the evaluations and add the commits.
  5. Merge the PR.

Model deployment

Models are deployed to Remote Settings to be delivered to Firefox.

Records and attachments are uploaded via a CLI tool which lives in the remote_settings directory in this repository.

View the remote_settings README for more details on publishing models.

Currently supported Languages

Firefox Release

For a list of the released models please see the Firefox Translations Models dashboard.

Issues· 30 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Ruby

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言