Clarification on Speed Improvement with `fused_window_process` and Its Necessity for Small-Scale Tasks
Author: Qingyu-FanCreated Oct 16, 2024Updated Feb 11, 2025
Hi, thank you for your excellent work!
I have a question regarding the fused_window_process. With the integration of the window process in the CUDA files, is the speed improvement significant? Could you provide some quantitative data to illustrate the performance gains?
Additionally, for tasks of a smaller scale, is it necessary to utilize the window process, or would it be better to use a default implementation of torch.roll?
Looking forward to your response!
Source: microsoft/Swin-Transformer