mobilevit ’s structure output donot consistent with the paper

Author: wilbur-caperCreated Mar 31, 2022Updated Dec 9, 2023

thanks you for the great work; here is the paper's graph: Uploading image.png…

I print the layer input and output below: 0 fc x.shape torch.Size([1, 3, 224, 224]) 1 fc y.shape torch.Size([1, 16, 112, 112]) 2 fc y.shape torch.Size([1, 16, 112, 112]) 3 fc y.shape torch.Size([1, 24, 112, 112]) 4 fc y.shape torch.Size([1, 24, 112, 112]) 5 fc y.shape torch.Size([1, 24, 112, 112]) m_vits 1 b y.shape torch.Size([1, 48, 112, 112]) m_vits 1 b y.shape torch.Size([1, 48, 112, 112]) m_vits 2 b y.shape torch.Size([1, 64, 112, 112]) m_vits 2 b y.shape torch.Size([1, 64, 112, 112]) m_vits 3 b y.shape torch.Size([1, 80, 112, 112]) m_vits 3 b y.shape torch.Size([1, 80, 112, 112]) 2222 fc y.shape torch.Size([1, 320, 112, 112]) 3 fc y.shape torch.Size([1, 3595520])

Source: xmu-xiaoma666/External-Attention-pytorch