Uncommon Quantization Types

Uncommon Quantization Types

There are a few other obscure types of quantization, which live happy and meaningful lives on the creaking shelves of university libraries, buried deep inside musty volumes of research journals.

• Stochastic quantization. This is a method of intentionally introducing some non-determinacy and randomness into quantization algorithms with the goal of increased inference accuracy.
• Dyadic quantization: This is an uncommon quantization method using dyadic numbers, which are a mathematical representation of numbers as rational quotients where the numerator is an integer, but the denominator is always a power-of-two (allowing bitshifts).
• Fixed-point quantization: Uses fixed-point number formats rather than floating-point.

• Next: • Up: Table of Contents • Buy: Generative AI in C++: Coding Transformers and LLMs

The new AI programming book by Aussie AI co-founders: AI coding in C++ Transformer engine speedups LLM models Phone and desktop AI Code examples Research citations Get your copy from Amazon: Generative AI in C++