How to get the feature map by using pretrained model.

Hi, recently I try to use the DINO and DINOv2 pre-train model to get the feature map. I use the pre-trained model to get the feature, but only got a vector. It seems like the output of the last average pooling layer. Could you give me some suggestions to get the pyramid feature maps?