Aussie AI

Smarter AI Research

  • Book Excerpt from "Generative AI in C++"
  • by David Spuler, Ph.D.

Smarter AI Research

The goal of smarter AI is to make the models more capable, so as to offer more benefits to individuals and business. Some of the newer focus areas for increasing the intelligence of AI engines include extensions to capabilities and addressing some of the weaknesses:

  • Long document understanding.
  • Data source usage (i.e. beyond RAG)
  • Tool usage
  • Mathematical reasoning capabilities
  • Artificial General Intelligence (AGI)

Some of the main architectures getting research attention towards achieving these types of breakthroughs include:

  • Mixture-of-experts
  • Ensemble architectures (many types)
  • Multimodal models
  • Intelligent agent architectures

Some of the specific algorithms being researched for increased silicon braininess include:

  • Temporal reasoning
  • Spatial reasoning (e.g. 3D scene understanding)
  • Tool interfaces
  • Informational retrieval integrations
  • Length generalization
  • Prompt augmentation
  • Chain-of-thought reasoning
  • Long context window optimizations
  • Forecasting and predictive algorithms

These are just some of the research areas and there is so much happening that the totality defies categorization. For example, the above list is missing vertical-specific research areas (e.g. medical diagnosis), inputs (e.g. computer vision, video), and fundamental human-computer interfaces, such as voice interactions, gesture interfaces, and extensions to natural language.

 

• Next:

• Up: Table of Contents

• Buy: Generative AI in C++: Coding Transformers and LLMs

Generative AI in C++ The new AI programming book by Aussie AI co-founders:
  • AI coding in C++
  • Transformer engine speedups
  • LLM models
  • Phone and desktop AI
  • Code examples
  • Research citations

Get your copy from Amazon: Generative AI in C++