Aussie AI Blog

Deciding on Your AI Business Project

  • September 23, 2024
  • by David Spuler, Ph.D.

Decisions, Decisions

Come on, you don't need to decide! It's AI, and it's already been decided for you. But there are a few other decisions:

  • What AI projects to build?
  • External versus internal projects?
  • How soon do we need it?
  • How many users to support?

And then there are some meta-decisions:

  • Who decides?
  • Who's going to research the technology?
  • Whose responsibility is building it?
  • Who's tracking the project?
  • Who's paying for it?

Assumiing you decide to do something, there's the decision set on how to get there:

  • Build versus buy?
  • Outsource versus in-house development?
  • Cloud versus on-premises versus on-device?
  • What front-end devices for the user interface?

Project Priorities and Goals

Why are you doing a generative AI project? When you're trying to put out an AI project, whether to the general public or internally to your staff, there are two main competing priorities:

  • Fear Of Missing Out (FOMO)
  • Fear Of Fouling Up (FOFU)

Both are very valid concerns! Take too long and your competitors will be ahead of you. Even worse, there'll be someone in a hoodie you've never heard of with a multi-billion dollar startup.

But there are also many examples of public failures and the consequent PR embarassment from newly-released AI projects. Things like telling people to use glue on their pizza, or it's fine to pick mushrooms without any concerns, or insensitively-written obituaries.

Goals. The goals of your project might be:

  • Company reputation
  • Market positioning
  • Growth (of revenues, users, market share, etc.)
  • Productivity
  • Cost-reduction
  • User empowerment (adding capabilities)
  • Customer requests

And there may also be defensive goals:

  • Not falling behind in tech
  • Fighting the disruptors
  • Staff morale

These are all laudable goals, but some of them are tough to achieve. Cost reduction and productivity improvement is a tactical goal, whereas protection against disruptors is a long-term strategic goal.

Choosing Your AI Project

What's the project? Here are some examples of common projects for business usage of AI:

  • Writer copilot for marketing or other departments.
  • Coding copilots for software developers.
  • Support chatbot for your website, that directly answers customer questions about your products.
  • Q&A internal service for support staff to help answer questions and offer “scripts” to follow.
  • In-house Q&A service to answer sales staff questions about your products (with more in-depth answers possible than a public chatbot)
  • In-house HR chatbot to answer staff questions about HR policies and internal company matters.

Pro tip: you can choose more than one!

A common type of first AI project is to get certain groups of staff trained up with AI tools to improve their productivity. These are the various “copilot” types of AI tools, and they can be used by various different company teams, even programmers. An important distinction here is that such copilot tools may not require the LLM to have any training with specific in-house data, which is another reason they can be launched faster.

What are Other Companies Doing?

What's everyone else doing in AI? On the one hand, there's a firehose of press articles about generative AI. On the other hand, many of the major players are startups that are still private, with opaque financials. Nevertheless, I've tried to accumulate some useful data points.

Follow the money. Who's making money from generative AI? So far, some of the major winners where the information is available include:

  • NVIDIA — H100 chips.
  • OpenAI — over $3 billion in revenue.
  • Microsoft — Azure and also various copilots.
  • Accenture — over $2 billion in AI project bookings, versus $300m a year ago.
  • Scale AI — approaching $1 billion in revenue.

OpenAI revenue. It is unclear whether OpenAI is making coin from individuals or busineses. However, they just made the consumer version free to use without a login (i.e. they just "ungated" access), and I doubt they'd do that if consumers were their main revenue. Some estimates are that the OpenAI API is the greatest source of revenue, which means business customers and other AI-first startups.

Scale AI business revenue. Scale AI, which is a startup that specializes in data cleanup and data labeling for AI, provided some insightful public information when they raised some more funding. Recently, they announced a massive increase in revenue, and also the change in that 90% of recurring revenue is now driven by corporate customers. Previously, their main customers were the big AI startups building foundation models.

General market status. My analysis of the above points and from reading many, many articles is that generally, the situation is this:

  • Lots of companies buying or renting H100 chips (and now B100s)
  • Lots of spending on consultancy services (unclear to what extent it's advice or build-it-for-me projects).
  • Lots of "buy" rather than "build" for internal staff productivity (e.g. writing copilot products, coding copilots, Microsoft Copilot, etc.)
  • On-device AI for phones (Apple and Android) is just starting.
  • AI PC on-device applications just starting (e.g. Microsoft and Copilot+ PCs)

Business project status. In terms of business-specific AI development projects, my conclusions from this:

  • Lots of businesses are doing AI projects (or at least "experimentation").
  • About 2 years into a 3-5 year deployment cycle of specialized business AI applications.
  • Many projects are stuck in POC and pre-production (but this is changing).
  • Employees aren't waiting for their company to catch up, and are using consumer AI products in their work on a massive scale (and leaking lots of your proprietary data!).
  • Building AI apps is a struggle because nobody knows what to do — too many complicated issues, and too many vendors.
  • Safety issues and regulatory compliance are another pain point slowing adoption.
  • Dirty data from inside the company is a major bottleneck for many business AI projects.
  • Public-facing external AI applications are much less common than internal usage.
  • Business-specific AI "platforms" based on internal competencies are rare.

This all sounds great, but there's really only one big problem.

Confusion Reigns

Well, at least the consultants are doing well. Presumably, that's because nobody else really knows what to do. And just between you and me, I'm not sure that the consultants know all the answers either.

In order to help you out, here's my list of the areas of confusion in building an AI application:

  • What to build
  • What data to use
  • What platform to use
  • What model to use
  • How to build it
  • How to test it
  • Whether it's legal

Maybe it's better just to stay in bed. But at least you're not alone. Everyone's confused!

The Easier Options

In order to take it easier on yourself, consider the simpler projects first. Here are some thoughts on easier ways to go into AI. Note that I didn't say that they are the cheapest ways, or the most beneficial. All I said was "easier" and I definitely did not say "easy."

Here are the easier types of projects to choose:

  • Buy is easier than build.
  • Internal usage is easier than customer-facing.
  • Text is easier than images, which is easier than video.
  • Human-in-the-loop is easier than unattended or automated (i.e., a real person reviewing AI's outputs makes it easier to avoid pitfalls).
  • Read before you write (i.e., choose projects that just answer questions, but don't "change" anything).
  • Web-based browser interfaces to cloud backends are easier than on-device AI.
  • AI agents are hard and very new.
  • Building your own AI platform is the worst.

To the last point, the hardest project is buiding your own "platform" that allows you to extend easily into multiple business-specific AI applications. Although it's tough to do, this idea has the greatest long-term strategic benefit.

Internal Business AI Platforms

There are a lot of short-term wins in staff productivity and addressing common customer pain points. A lot of these are "buy" rather than "build" and the tendency will be to de-prioritize the more complex AI projects. However, these short-term projects are not the big strategic wins that realize the promise of AI. That can be summed up as: a business-specific AI platform.

What's a business AI "platform"? Well, in the same ways that the internet is widely used internally by business staff and externally to communicate with customers, an AI platform will generalize that idea. The major capabilities include:

  • Internal business processes (simplified, automated, extended)
  • Customer communication (personalized, automated, integrated)
  • Data analysis (deeper patterns, timeframe planning, niche segmentation)

Making AI into a core competency within your organization is a long-term strategic advantage. Every business is different, and business-specific requirements can go well beyond the generic capabilities of writing copilots, customer support chatbots, and other off-the-shelf AI systems.

In assessing your long-term strategy for AI, consider what makes your company unique. What are your strategic advantages against competitors? Then consider how generative AI could enhance and extend those capabilities, looking at both inside and outside the company.

AI Core Competency Levels

It's very complicated at the moment, but there seems to be a natural progression occurring. The distinction can be mapped as:

  • Tactical AI projects
  • Strategic use of AI

Here are my thoughts on a hierarchy of AI core competency levels inside a business.

Tactical AI. For short-term AI projects, the levels are:

  • Buy for internal staff — e.g., writer copilots, coding copilots, or other turnkey AI applications.
  • Buy for external customers — e.g., a "custom" customer support chatbot based on RAG or fine-tining from auto-ingesting your website.
  • Build for internal staff — e.g., automate some of the more annoying internal repetitive business processes for improved staff productivity.
  • Build for external customers — e.g., clean up internal proprietary data and use this for better fine-tuning of specific customer-facing apps.

The goals of tactical AI projects are likely to be specific and measurable. Examples include:

  • Cost reduction
  • Productivity improvement (e.g. words written, SLOC, etc.)
  • Customer satisfaction metric improvement (e.g., average time to resolve customer questions).
  • Conversion rates (e.g. personalized sales content in customer outreach).

Strategic AI. Well, the tactical AI projects have been going on for a while. If you really want to get ahead in the longer term, think strategy. The strategic competency levels are much more difficult:

  • Internal business-specific AI platform — extend your capabilities to allow easy creation of many "mini-apps" for business process automation.
  • External business-specific AI platform — control the touch points with your customers in a way that you can easily leverage and extend.

At the strategic level, the goals will be less quantitative, and longer-term:

  • Repeatability — quickly bringing new capabilities online using the same process and underlying framework.
  • Scalability — being able to scale onboarding quickly, whether it's staff or customers.
  • Specialization — use of your organization's core competencies.

Running your own AI platform is the biggest long-term win. I'm not sure that you need to run your own H100s, and you might simply build out your own platform by customizing and extending an existing AI infrastructure platform. But I think it's important to control the ability to add higher-level functionality in your core business areas. By owning the innovation level, you get to drive it forward with specialized capabilities that your competitors will struggle to match. It takes time and money, but this will be the long-term battleground in generative AI.

More AI Research Topics

Read more about: