Methodology

A directional shortlist, not a promise of revenue.

Kettio ranks a comparable creative batch for a specific buyer and conversion goal. The output helps decide what deserves a live test; Meta, Shopify, or another outcome system provides the final behavioral proof.

83.45%

Pairwise creative agreement

Share of within-product creative pairs (701 of 840) on the CreativeRanking development cohort where the outcome-trained comparator agreed with the observed CTR ordering. The earlier prompt-only panel scored 55.24% and 56.43% on the same cohort, and a historical config of that panel is the source of the 70.3% figure quoted elsewhere.

Boundary: A retrospective result on a development cohort, not a fresh holdout. The ranking cleared all three control banks; click-capture cleared one of three, so the frozen success gate is not fully passed. It is not a conversion-rate, CPA, ROAS, or exact-winner guarantee.

ρ = 0.775

Survey-panel rank correlation

Spearman rank correlation with human ad-perception survey responses on a separate academic benchmark.

Boundary: Measures agreement with survey judgments, not purchases or media-platform outcomes.

84%

Historical shortlist containment

In a retrospective research cohort, the realized winner appeared inside Kettio’s two-ad shortlist at this rate.

Boundary: Research-only retrospective evidence. It is not exact-winner accuracy and is not yet a prospective production claim.

How to use a Kettio ranking

  1. Hold audience, offer, landing page, platform, and objective constant.
  2. Rank the creative as one matched batch.
  3. Use the shortlist to reduce the number of ads entering live spend.
  4. Reconcile the frozen ranking against real CPA, ROAS, purchases, or another predefined outcome.

Apply for a blind creative back-test →