#1919·tensor2tensor

AttributeError: 'AdafactorOptimizer' object has no attribute 'get_gradients'

Author: shizhediaoCreated Nov 1, 2022Updated Nov 1, 2022

Hi, When I am trying to reproduce the adafactor experiments on en-de translation task, I encountered the following issue. AttributeError: 'AdafactorOptimizer' object has no attribute 'get_gradients' Could any one tell me how to use adafactor optimizer? Below is my running code:

t2t-trainer

  --data_dir=t2t_data \
  --problem=translate_ende_wmt32k \
  --model=transformer \
  --hparams_set=transformer_base \
  --hparams="batch_size=1024,optimizer=adafactor" \
  --schedule=continuous_train_and_eval \
  --output_dir=translate_ende_wmt32k_adafactor \
  --train_steps=300000 \
  --worker_gpu=10 \
  --eval_steps=100

Thanks!

Source: tensorflow/tensor2tensor

View original on GitHub View discussion on GitHub