Append doesn't accept a buffer

I'm trying to the append images together that are stored in buffers like so:

gm(firstBuffer).append(secondBuffer, true).write('appendedImage.jpg', function(...

This firstBuffer always works, but the secondBuffer is never recognized (it only works when append is passed a filepath).