MEIKAISource influence: measuring which pages shape AI answers
A search ranking shows where a page appears in a search result. It does not show whether a generative system used that page, cited it or carried one of its claims into an answer. Source-influence analysis starts from those observable events.
The word influence needs care. A citation establishes association, not causation. To say that a page changed an answer requires a stronger design: a controlled content change, a stable prompt set, repeated measurements and, where possible, a comparison group.
Four events that should not be blended
| Event | What it establishes | What it leaves open |
|---|---|---|
| Page available | The source can be reached under the tested conditions. | Whether a platform retrieved or indexed it. |
| Page cited | The response contains a reference to the page. | Whether the page supplied the nearby claim. |
| Claim aligned | The answer repeats or closely matches information on the page. | Whether that page, rather than another source, caused the wording. |
| Answer changed after an edit | The timing is consistent with an effect. | Whether the edit caused it without controls for other changes. |
Keeping those stages separate prevents a citation count from being presented as proof that content “shaped” an answer.
Begin with a versioned measurement set
Source analysis is only interpretable when the demand sample is documented. Define the prompts, markets, languages, platforms and run schedule before examining which sources perform best. Preserve prompt versions so a shift in customer questions does not masquerade as a source effect.
For each response, retain the answer, cited URL, resolved URL, timestamp and the claim the citation appears to support. Domain-level totals are useful for orientation, but page-level evidence is needed to decide what to change.
Diagnose the gap before changing content
A missing or inaccurate answer can have several causes:
- the prompt asks for information the brand does not publish;
- the official page exists but cannot be retrieved or parsed reliably;
- official sources contradict one another;
- an independent source contains clearer or more current evidence;
- the platform cites a page but interprets the claim incorrectly; or
- the product is not a legitimate fit for the prompt.
The last possibility matters. Optimization should not turn every absence into a publishing task. Sometimes the measured answer is reasonable and no content change is warranted.
Test one hypothesis at a time
Meikai's workflow records a gap, proposes a change and reruns the same measurement. The sequence is straightforward:
- Observe: capture the answer, citations and factual error or omission.
- Diagnose: identify the smallest source-level explanation supported by the evidence.
- Change: update an owned page or correct an earned source where there is an editorial basis to do so.
- Measure again: rerun the same prompts and compare response-level outcomes.
A comparison page, market or prompt cohort makes the result more credible. Without one, report the outcome as a change observed after the edit, not as lift caused by the edit.
Owned and earned sources play different roles
Owned pages are the canonical place for specifications, policies, availability and approved claims. They should be current, internally consistent and technically accessible.
Independent sources can add comparison, testing or editorial context that a brand cannot credibly provide about itself. The objective is not to place the same talking point across as many domains as possible. It is to make accurate evidence available in the sources appropriate to the question.
Metrics worth keeping
- Prompt-level citation rate: the share of reviewed responses citing a page or domain.
- Claim accuracy: the share of checked factual claims that match approved evidence.
- Source diversity: whether an answer depends on one source or draws from several relevant sources.
- Change persistence: whether an observed movement survives repeated runs and later measurement windows.
- Coverage: the prompts, platforms and markets for which data was actually collected.
Repeated brand mentions inside one answer are not a reliable authority metric. They can be produced by prompt wording and answer structure without indicating preference or trust.
Limits
Generative systems and their retrieval layers change. A measured association can weaken without any change to the page, and two platforms can react differently to the same source. Results should retain their date, platform and prompt scope.
The practical aim is narrower than “engineering the answer”: publish accurate evidence, make it retrievable, measure how it is represented and state clearly what the measurement can and cannot prove.