Aussie AI

Hybrid Number Systems

  • Book Excerpt from "Generative AI in C++"
  • by David Spuler, Ph.D.

Hybrid Number Systems

As if the DBNS/MBNS systems were not enough, there are various “hybrid” number systems that combine features from two or more different number systems. Another idea is a “dynamic number system” which is a hybrid system, where the model changes aspects or parameters of its number systems on the fly during inference or training.

Research papers on hybrid number systems:

  1. G Alsuhli, V Sakellariou, H Saleh, M Al-Qutayri, 2023, Number Systems for Deep Neural Network Architectures: A Survey, https://arxiv.org/abs/2307.05035 (This survey paper has a section on hybrid number systems and dynamic number systems.)

For more research papers on hybrid number systems, see also https://www.aussieai.com/research/advanced-ai-mathematics#hybrid.

 

• Next:

• Up: Table of Contents

• Buy: Generative AI in C++: Coding Transformers and LLMs

Generative AI in C++ The new AI programming book by Aussie AI co-founders:
  • AI coding in C++
  • Transformer engine speedups
  • LLM models
  • Phone and desktop AI
  • Code examples
  • Research citations

Get your copy from Amazon: Generative AI in C++