Quantization Error unsupported safetensor dtype F8_E4M3

Author: AlpineVibrationsCreated Apr 10, 2025Updated Aug 24, 2026

Using tensor-tools to quantize a flux finetine at little-lake-studios/demoncore-flux on hf hub https://huggingface.co/little-lake-studios/demoncore-flux/

tensor-tools quantize demonCORESFWNSFW_fluxV13.safetensors --out-file Q8_0.gguf --quantization q8_0

gets an error

Error: unsupported safetensor dtype F8_E4M3

Source: huggingface/candle