Intel Consumer Level AVX-VNNI Support

Author: callmegagaCreated Mar 23, 2026Updated Sep 17, 2026

Reminder

  • I have read the above rules and searched the existing issues.

System Info

I am not sure.Does kt support the intel consumer level avx-vnni instructions whitch is 256 bit, it is different with server side avx-vnni which is 512 bit.Do you assess whether doing this is worthwhile? If so, I can do this work.I'm also trying to make the NPU, iGPU, and CPU work together on Intel processors.Can you give me some advice?

Reproduction

Put your message here.

Others

No response

Source: kvcache-ai/ktransformers