SDS Loss doesn't drop using example script

I tried the example python main.py --text "a hamburger" --workspace trial -O, although the hamburger image could be generated after iterations, the loss in tensorboard didn't drop at all. May I ask is that expected? and does any one have any explanation?