Aussie AI

Planning and Requirements

  • Book Excerpt from "Generative AI in C++"
  • by David Spuler, Ph.D.

Planning and Requirements

Making a plan might not be a bad idea, considering the potential cost outlay involved in an AI project. You're probably familiar with the general issues of project planning in regards to staffing and resourcing a project, so I'll focus mainly on the AI-specific issues.

Researching your AI project will involve issues such as:

  • What is the specific AI use case?
  • What in-house proprietary data could be used for training?
  • Existing staff AI expertise levels.
  • Capacity of existing hardware viz training or inference workloads.
  • Vendors and costs of AI-specific hosting versus in-house capabilities.

Some of the specific decisions in moving ahead with a project plan include:

  • Use case specific requirements
  • Proprietary training data cleansing
  • Choice of foundational model
  • Commercial versus open source models
  • Training or fine-tuning versus RAG

It's not all about AI. General tech project requirements also apply:

  • User interface platform
  • Backend hosting and deployment issues
  • Development processes
  • Security risk mitigations
  • Backup and recovery procedures

In addition to technology issues, there are also broader legal and regulatory issues to consider such as:

  • Responsible AI (safety issues)
  • Governmental AI regulatory compliance
  • Internet regulatory compliance (non-AI)
  • Organizational legal compliance (e.g. HIPAA, SOC)
  • Copyright law
  • Privacy law

 

• Next:

• Up: Table of Contents

• Buy: Generative AI in C++: Coding Transformers and LLMs

Generative AI in C++ The new AI programming book by Aussie AI co-founders:
  • AI coding in C++
  • Transformer engine speedups
  • LLM models
  • Phone and desktop AI
  • Code examples
  • Research citations

Get your copy from Amazon: Generative AI in C++