/methodology
OverviewAuditsSpeedShares

How the panel scores a page

An audit is a customer survey. Five personas, each standing for a real segment of the brand’s buyers, read the page as that shopper and answer the same short questionnaire. The engine holds the questionnaire and does the arithmetic; the answers come from the panel.

The instrument

One questionnaire, fixed across every run

Every panel answers the wording below, exactly as it is written here. That is what makes two runs comparable: a run against a reworded statement still produces a number, and the number silently means something else. The statements are handed to the panel by the engine and rendered on this page from the same source, so the two cannot drift apart.

Six agreement statements

Nothing loaded

The LP Studio API did not answer, so this page has nothing to show. It is not a statement about the data.

http://localhost:3210/lp_studio/console/graphql
fetch failed

A five-point scale, every point labelled

Nothing loaded

The LP Studio API did not answer, so this page has nothing to show. It is not a statement about the data.

http://localhost:3210/lp_studio/console/graphql
fetch failed

The psychometric literature converges on five to seven points. Below five, reliability and information measurably fall away; above seven, and especially at eleven, the extra points add noise without adding reliability. Five is the most widely used, and labelling every point rather than only the two ends keeps respondents interpreting the scale the same way, which is what holds measurement error down.

A 0–100 score would claim a precision a single shopper cannot supply. Nobody can tell 61 from 64. A labelled ordinal scale is the finest grain the answer actually has.

One verdict

Nothing loaded

The LP Studio API did not answer, so this page has nothing to show. It is not a statement about the data.

http://localhost:3210/lp_studio/console/graphql
fetch failed

Each persona also says where it landed, in shopper’s words. The three counts across the panel are what the report prints beside the means, because a panel of three ready and two bouncing is a different page from a panel of five warming to the same average.

The headline number

The Persona Purchase Index

Each persona answers one purchase-intent question, 0–10:

Nothing loaded

The LP Studio API did not answer, so this page has nothing to show. It is not a statement about the data.

http://localhost:3210/lp_studio/console/graphql
fetch failed

The PPI is the panel’s plain mean of those answers, to one decimal.

Why a plain mean
The first version used NPS-style net-of-extremes arithmetic — the share of personas answering 9–10 minus the share answering 0–6. With a five-persona panel and a question about buying right now, almost nobody answers 9 or 10 on a first visit, so the index floored at −100 on every run while the page it was measuring converted at 3.5%. A mean never floors, moves smoothly as a page improves, and is usable as a version-to-version signal.

Juster’s eleven-point probability scale predicts real purchase better, but only once it has been calibrated against actual purchase data, which a synthetic persona cannot supply. The PPI is a directional index, and it is reported as one. It is not a conversion forecast.

Reporting

Agreement is a count, never a percentage

The report prints each statement’s mean on the 1–5 scale it was answered on, and beside it the number of panel members who agreed — the standard top-two-box definition, Agree plus Completely agree.

Why a count
A percentage over five respondents can only ever take six values, and printing 60% implies a resolution the panel does not have. “3 of 5 agreed” carries the same information and keeps the panel size next to every figure that depends on it, so a reader can see how much weight the number can hold.

Nothing is rescaled to 100. A mean of 4.4 sits at 4.4 on a five-point axis, and the label the scale gives that point is the vocabulary used to describe it.

Guardrails

What the model deliberately avoids

  • False precision. No 0–100 certainty score from a single simulated shopper, and no percentage over a panel of five.
  • Expert-judge framing. Personas answer as the shoppers they represent. None of them is asked to review the page as a marketer.
  • An average that hides the split. The per-statement means, the agreement counts and the ready / warming / not-yet breakdown are all reported, because the distribution is where the finding is.
  • A first run pretending to be a comparison. A delta against nothing does not exist, and the report leaves it blank rather than printing a zero.
Sources

Where the choices come from