Data Types#

Quark ONNX Quantization Data Type Classes

class quark.onnx.quantization.config.data_type.DataType[source]#

Base class for representing a quantization data type.

class quark.onnx.quantization.config.data_type.Int4[source]#

Signed 4-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.UInt4[source]#

Unsigned 4-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.Int8[source]#

Signed 8-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.UInt8[source]#

Unsigned 8-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.Int16[source]#

Signed 16-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.UInt16[source]#

Unsigned 16-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.Int32[source]#

Signed 32-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.UInt32[source]#

Unsigned 32-bit integer quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.Float16[source]#

16-bit floating point quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.BFloat16[source]#

16-bit Brain Floating Point quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.BFP16[source]#

Block Floating Point quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MX4[source]#

MX4 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MX6[source]#

MX6 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MX9[source]#

MX9 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXFP4E2M1[source]#

MXFP4E2M1 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXFP6E3M2[source]#

MXFP6E3M2 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXFP6E2M3[source]#

MXFP6E2M3 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXFP8E5M2[source]#

MXFP8E5M2 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXFP8E4M3[source]#

MXFP8E4M3 quark onnx quantization data type.

class quark.onnx.quantization.config.data_type.MXInt8[source]#

MXInt8 quark onnx quantization data type.