Reproduce Lora results is close but not accurate

Getting this result

For these Hyperprams:

https://github.com/microsoft/LoRA/tree/main/examples/NLG#replicating-our-result-on-e2e

What were the hyperparameters for results in the paper: https://github.com/microsoft/LoRA/tree/main/examples/NLG#adapting-gpt-2-using-lora