CiteMind Academy
Back to Academy

MODULE 02 / AUDITING & DIAGNOSIS

Auditing & diagnosis

Turn AI answers into a clear diagnosis.

Learn to run an AI visibility audit, read the scores and compare a client against competitors. The goal is a diagnosis simple enough for a client to understand and specific enough for your team to act on.

02.01Lesson

Run an AI visibility audit

An AI visibility audit measures how a brand appears in AI answers across a fixed set of realistic questions and a chosen group of assistants. The steps: define the client and competitors, build a balanced question set, pick the assistants, run the baseline, capture sources and summarize the findings. Keep the question set stable so you can compare results over time.

What an audit covers

A complete audit answers four questions:

  1. Visibility. Does the brand appear in answers, and how often compared with competitors?
  2. Brand Knowledge. How confident are assistants when answering questions about the brand?
  3. Sentiment. How do assistants describe the brand, and on which topics?
  4. Sources. Which sites do assistants rely on, and does the brand appear there?

In CiteMind, onboarding a client URL runs this baseline for visibility, Brand Knowledge, sentiment and revenue leakage.

How many questions and assistants

There is no single right number. A focused set is easier to review and explain. As a starting point, many agencies begin with a set that covers each question type and the two or three most relevant assistants, then expand once the baseline is clear.

Cost scales with volume. In CiteMind, one monitoring run is executed each day for every tracked question and selected assistant, and you pay for the runs you schedule. A quick way to estimate monthly volume:

Monthly runs = questions x assistants x days

Example: 20 questions x 3 assistants x 30 days = 1,800 monthly runs.

Configure each client independently, so a small client does not carry the cost of a large one.

Common mistakes

  • Keyword-style questions. Assistants respond to natural questions, so write them as buyers would.
  • Only branded questions. They tell you little about discovery. Include category and comparison questions.
  • Too many questions at once. A large set is hard to interpret. Start focused.
  • Changing the set every month. You lose the trend. Change questions deliberately and note the date.
  • Ignoring sources. Without them you cannot explain why results look the way they do.

The audit process

  1. 1Define the client and the market. Write down the client's products or services, target audience, markets and languages. Note the three to five competitors that matter most. This keeps the questions relevant.
  2. 2Build the question set. Write the questions buyers would actually ask. Cover category, comparison, problem, brand, pricing and decision questions, plus local or market-specific questions where relevant. Balance them across visibility, Brand Knowledge and sentiment.
  3. 3Choose the assistants. Pick the assistants your client's buyers use. CiteMind supports ChatGPT, Gemini, Claude, Perplexity, Google AI Overviews, Microsoft Copilot, Grok and DeepSeek. Start with the ones most relevant to the audience, and add more later.
  4. 4Run the baseline. Add the client URL in CiteMind, set the number of questions and the assistants per question, and run the analysis. Save the baseline date. Do not edit the question set mid-audit.
  5. 5Capture the sources. For each answer, note which sources were cited and whether the client appears among them. Use Reasoning Chain Transparency to see why an assistant cited specific sources.
  6. 6Review for quality. Check that the questions reflect real buyer language, that the competitor set is right and that results are not dominated by one odd question. Remove or rewrite weak questions before the next run.
  7. 7Summarize the findings. Write a one-page summary: overall visibility, strongest and weakest areas, sentiment issues, competitor comparison, the most important sources and the top three actions.

FAQ

How long does an audit take?+

Setting up the client and question set is the main effort. Once the question set is ready, running the baseline in CiteMind is quick. Plan time for reviewing results and writing the summary.

Should I write the questions myself or generate them?+

Use any method, but review every question for realism. The best sets mix client input, sales calls, search data and common customer questions.

Do I need to audit in more than one language?+

If your client sells in more than one language or market, yes. Answers and sources can differ by language, so treat each as its own question set.

How often should I rerun the audit?+

Treat the baseline as the first run of ongoing monitoring. In CiteMind, runs execute daily for the tracked questions, so you view trends over time rather than repeating a one-off audit.

Audit your first client

Add a client URL and run the baseline. Free analysis for one week. No credit card required.

Run a free AI audit
02.02Lesson

Read the LLM scoring

CiteMind reports three core scores for each client. AI Visibility shows how present the brand is in AI answers. Brand Knowledge shows how confident assistants are when answering questions about the brand. AI Sentiment shows how assistants describe the brand. Read them together, by assistant and by category, and focus on trends over time rather than a single value.

The three scores

AI Visibility. How present the client is in AI answers across the tracked questions, including its share of voice compared with competitors. Use it to answer: are we showing up?

Brand Knowledge. How confident assistants are when answering user questions about the client, segmented by category. Low confidence in a category points to a weak area to improve. Use it to answer: do assistants know us well enough to answer correctly?

AI Sentiment. How assistants describe the client, shown by category such as Product Quality, Customer Support, Trust, Performance, Delivery, Value, Reliability and Pricing. Use it to answer: what do assistants say about us?

Together they separate three different problems: not being present, not being known and being described poorly.

Read by category

Overall scores hide the useful detail. Look at categories.

  • A client may have strong Product Quality sentiment but weak Pricing sentiment. That tells you to work on pricing information and perception.
  • Brand Knowledge may be strong in one product line and weak in another. That tells you where to improve content and sources.
  • Visibility may be high on branded questions and low on category questions. That tells you the brand is known but not discovered.

Always ask: which category is weakest, and which one matters most to revenue?

Read by assistant

Assistants behave differently, so scores can differ between them. A client may be visible in one assistant and nearly absent in another.

  • Compare assistants to find where the gap is largest.
  • Prioritize the assistants your client's audience uses most.
  • Do not average away differences. A strong score in one assistant can hide a weak one that matters.

Trends matter more than points

Answers vary, so a single score on a single day is a weak signal.

  • Compare the same question set across weeks.
  • Look for sustained direction rather than daily swings.
  • Note events that can move results: model updates, site changes, new content, competitor launches.
  • Set expectations early that small movements are normal.

What to show the client first

Do not show every number. Lead with:

  1. One headline. For example: "Assistants recommend two competitors more often than you on comparison questions."
  2. The category gap that most affects revenue.
  3. One sentiment issue with a clear cause.
  4. The top three actions you recommend, ranked by impact and effort.

Keep the full data available for questions.

Limits to keep in mind

  • Scores describe a defined question set. They are not a measure of every possible question.
  • Assistants change, so comparisons are most reliable within the same period and setup.
  • A score is a signal to investigate, not proof of cause. Check sources and answers to understand why.

FAQ

What is a good score?+

It depends on the category, the competitors and the question set. Compare against competitors and against the client's own baseline, and look for improvement over time.

Why is my client visible in one assistant and not in another?+

Assistants use different models and sources. Differences are normal. Compare the sources each assistant cites to find what the weaker one is missing.

What is the difference between visibility and Brand Knowledge?+

Visibility is about appearing in answers. Brand Knowledge is about how well assistants can answer questions about the brand. A client can be well known and still rarely recommended, or the reverse.

How should I explain a score drop?+

Check for a model change, a competitor change, a source change or a site change. Present the finding with the likely cause and the action you propose. See "What to do when visibility drops."

See the scores on a live dashboard

Explore a live demo of CiteMind dashboards, including visibility, Brand Knowledge and sentiment by category.

View a live demo
02.03Lesson

Benchmark against competitors

A competitor benchmark shows who assistants recommend instead of your client, how often, and on which questions. Choose a realistic competitor set, compare share of voice by question type and assistant, then look at the sources behind the competitors' presence. The result is a gap you can explain and a plan to close it.

Why benchmark

A score on its own is hard to judge. A benchmark gives it meaning. Clients respond to competition, and it helps you:

  • Show where the client is behind and where it leads.
  • Choose which questions deserve the first actions.
  • Learn what the leading competitors have that your client lacks.
  • Frame the work as an opportunity to gain share, not as a failure.

Choose the competitor set

Use three to five competitors, a mix of:

  • Direct competitors the client already knows.
  • Competitors assistants recommend that the client may not have listed. Add any that appear often in answers.
  • An aspirational leader in the category, if useful for comparison.

Ask the client for their list, then add what the assistants show. Surprises make good discussion points.

What to compare

  • Share of voice. How often each brand appears across the tracked questions, shown as a share of all mentions.
  • By question type. Category, comparison, problem and decision questions often tell different stories.
  • By assistant. A competitor may dominate one assistant and not another.
  • By category of sentiment. Compare how assistants describe pricing, support, trust and reliability for each brand.
  • Position in the answer. Whether a brand appears early or late in the response.

Look at the sources

The most useful part of a benchmark is the reason behind the gap. For each question where a competitor beats your client:

  1. Note the sources the assistant cites.
  2. Check whether the competitor appears on those sources.
  3. Check whether your client appears there, and how.
  4. Identify the type of source: a comparison page, a review site, a community thread, a video, a media article or the competitor's own site.

CiteMind's Reasoning Chain Transparency shows why an LLM cited specific sources, which helps you defend your recommendations.

From gap to opportunity

Translate each major gap into a concrete opportunity.

  • Missing from a comparison question -> create or improve a comparison page, and check third-party comparisons.
  • Weak on a sentiment category -> clarify the information assistants use on that topic, such as pricing, support or reliability.
  • Competitor present on a source your client is absent from -> plan presence on that source.
  • Strong competitor in one assistant only -> check what that assistant relies on and whether crawlers can access your client's pages.

Rank the opportunities by impact and effort, and pick a short list for the first month.

Presenting the benchmark

  1. 1Start with one headline: where your client stands against the top competitor.
  2. 2Show share of voice by question type.
  3. 3Show one example answer where a competitor is recommended and your client is not.
  4. 4Show the sources behind that answer.
  5. 5Present three actions, ranked by impact and effort.
  6. 6Agree how you will track the gap each month.

FAQ

Should I show the client's competitors by name?+

Yes, in client-facing reports about their own market. Keep comparisons factual and based on the tracked questions.

What if the client is already the leader?+

Present the benchmark as a defense. Show where competitors are gaining and which topics or assistants are most exposed, and plan to protect the lead.

How often should I refresh the benchmark?+

Review it monthly alongside your report, and reassess the competitor set every quarter or when a new competitor starts appearing in answers.

Can I benchmark a prospect before they are a client?+

Yes. A light benchmark in a prospecting report is one of the most persuasive parts of an audit. See "The free AI visibility audit."

Benchmark your next client against competitors

Run a free AI audit and see how a brand compares with its competitors in AI answers. Free analysis for one week. No credit card required.

Run a free AI audit