Data Types#
Quark ONNX Quantization Data Type Classes
- class quark.onnx.quantization.config.data_type.DataType[source]#
Base class for representing a quantization data type.
- class quark.onnx.quantization.config.data_type.Int4[source]#
Signed 4-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.UInt4[source]#
Unsigned 4-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.Int8[source]#
Signed 8-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.UInt8[source]#
Unsigned 8-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.Int16[source]#
Signed 16-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.UInt16[source]#
Unsigned 16-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.Int32[source]#
Signed 32-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.UInt32[source]#
Unsigned 32-bit integer quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.Float16[source]#
16-bit floating point quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.BFloat16[source]#
16-bit Brain Floating Point quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.BFP16[source]#
Block Floating Point quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.MXFP4E2M1[source]#
MXFP4E2M1 quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.MXFP6E3M2[source]#
MXFP6E3M2 quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.MXFP6E2M3[source]#
MXFP6E2M3 quark onnx quantization data type.
- class quark.onnx.quantization.config.data_type.MXFP8E5M2[source]#
MXFP8E5M2 quark onnx quantization data type.