#2208·OpenNMT-py

Translation outputs differ with different batch sizes

Author: anderleichCreated Sep 22, 2022Updated Feb 15, 2023
Labelstype:question

Hi,

I've recently noticed that I get slightly different translation results when translating with different batch sizes. I guess this is not expected...

For example,

Batch size 100 --> PRED SCORE: -6.0490, PRED PPL: 423.68 NB SENTENCES: 5000
Batch size 150 --> PRED SCORE: -5.2232, PRED PPL: 185.54 NB SENTENCES: 5000

I'm using the latest version of OpenNMT-py

Thanks