It would be interesting to operate with new 4-bit datatypes such as FP4, NVFP4, MXFP4 ant utilize them during quantization
It would be interesting to operate with new 4-bit datatypes such as FP4, NVFP4, MXFP4 ant utilize them during quantization