Fix offloading / VRAM budget bugs

After releasing online FFN offloading, we have found new issues in:

• Decoding bug: #77.
• Python module issue: #55, #78.
• Inaccuracy when offloading under a VRAM budget: #26, #38.

Some users also posted some errors per FFN offloading on social media that might need further investigate.