Skip to content

GEO: Generative Engine Optimization (Aggarwal et al. 2024)

Quick facts

Authors
Pranjal Aggarwal, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, Karthik Narasimhan, Ameet Deshpande
Venue
KDD 2024 (Proc. 30th ACM SIGKDD)
Year
2024
DOI
10.1145/3637528.3671900
URL
https://arxiv.org/abs/2311.09735
Reproducibility
Code + data public
Evidence base
GEO-bench includes 10,000 queries across 25 domains and 9 source datasets
Tested on
An internal GPT-3.5 test harness using the top five Google results, plus the live Perplexity.ai engine
Headline finding
Visibility increased by up to 40% for specific methods and domains, and by about 22% on the live engine

Plain-English summary

Aggarwal et al. asked a new question: if an AI search engine writes an answer instead of listing links, how can a publisher make its content more visible in that answer? They formalized the problem as Generative Engine Optimization, built GEO-bench with 10,000 queries across 25 domains, and tested nine ways to rewrite content. In their setup, citations, statistics, and quotations reliably increased a page's prominence in synthesized answers, with gains of up to 40%. Keyword stuffing did not help.

Key findings

  • Adding citations, statistics, or quotations increased visibility by up to about 40% on the paper's Position-Adjusted Word Count metric.
  • The 'up to 40%' result is an upper bound for particular methods and domains, not an average effect. Practitioner coverage often overgeneralizes it.
  • Results varied by domain and engine. Cite Sources performed best on factual queries, Authoritative on debate and history, and Statistics Addition on law and opinion.
  • Keyword Stuffing did not help and could reduce visibility, providing early evidence that GEO is not simply traditional SEO under a new name.
  • Lower-ranked pages gained the most. Cite Sources increased visibility for pages ranked fifth by 115.1%, suggesting that GEO can partly offset an incumbent's search advantage.
  • The effect also appeared on Perplexity.ai, but the gain of up to about 22% was considerably smaller than the result from the internal engine. This limits the paper's external validity.

1. What this paper established

GEO: Generative Engine Optimization (Aggarwal et al., KDD 2024) introduced the academic term GEO.

The paper turned the previously informal goal of getting content into an AI-generated answer into a measurable optimization problem supported by a public benchmark.

The paper uses GEO in a narrow, benchmark-specific sense: content rewrites evaluated in a fixed test harness. Practitioners later expanded the term to describe a broader discipline. As a result, many claims made about GEO in 2026 concern practices that this paper did not test.

2. The problem the paper formalizes

The paper begins by describing a structural change in search. A conventional results page presents a ranked list of links, while a generative engine produces a synthesized answer. In that setting, visibility and ranking are no longer equivalent.

The paper reduces the problem to three elements:

  • The generative engine is a black box. Content creators cannot change the model; they can change only the web content supplied to it.
  • The goal is to maximize a source’s visibility within the synthesized answer, rather than its position in a list of links.
  • Success depends on how the answer uses the source text. The paper therefore introduces a visibility metric rather than reusing search rank.

The answer loop and Gao et al.’s 2023 survey explain the retrieval and grounding processes that determine which sources an engine selects and uses. Aggarwal et al. assume those processes are already in place and focus on how changes to source content affect visibility.

3. Methodology: the GEO framework and GEO-bench

The researchers applied nine content-optimization methods to candidate web sources:

#MethodPurpose
1AuthoritativeUse a more authoritative tone
2Statistics AdditionAdd relevant quantitative data
3Keyword StuffingAdd more keywords from the query
4Cite SourcesAdd citations to credible sources
5Quotation AdditionAdd relevant quotations
6Easy-to-UnderstandSimplify the language
7Fluency OptimizationMake the text more fluent
8Unique WordsAdd uncommon or distinctive vocabulary
9Technical TermsAdd terminology specific to the domain

GEO-bench contains:

  • 10,000 queries are divided into 8,000 training, 1,000 validation, and 1,000 test queries.
  • The queries come from 9 datasets: MS MARCO, ORCAS-I, Natural Questions, AllSouls, LIMA, Davinci-Debate, Perplexity.ai Discover, ELI5, and a GPT-4-generated set.
  • They span 25 domains, including Arts, Health, and Games, organized into seven categories.
  • For each query, the top five Google results form the candidate source set.

The researchers tested two engines. Their internal generative engine prompted GPT-3.5-turbo with the top five Google results. They also used the live Perplexity.ai service to check whether the findings transferred to a deployed engine.

4. The paper’s impression metrics

The paper’s most widely reused contribution is its approach to measuring visibility. Rather than treating citation and mention as binary outcomes, the metrics account for how much of a source appears in an answer and where that material appears.

The paper proposes two measures:

Position-Adjusted Word Count (Imp_pwc):
  sum over cited sentences s of  |s| · e^(-pos(s)/|S|)
  divided by total response word count

= cited-sentence word count, exponentially discounted
  according to how late each sentence appears in the answer.
Subjective Impression:
  a composite score from GPT-3.5 across 7 subdimensions:
  relevance · influence · uniqueness · subjective position ·
  subjective count · click-likelihood · diversity

A yes-or-no citation count cannot distinguish a passing reference from a source that shapes much of an answer. These metrics capture that difference in prominence, an important aspect of citability. Many later vendor metrics and GEO measurement frameworks use the same position-weighted approach.

5. Detailed results

The main results and their limits are:

FindingDetail
Maximum reported gainGEO methods increased visibility by up to ~40% as measured by Position-Adjusted Word Count
Best methodsQuotation Addition produced a 41% PAWC gain, Statistics Addition a 37% Subjective Impression gain, and Cite Sources a 30% PAWC gain
Interpretation”Up to 40%” is a per-method, per-domain upper bound, not the expected gain for every case
Domain-dependentCite Sources performed best on factual queries, Authoritative on debate and history, and Statistics Addition on law and opinion
Keyword stuffing failedKeyword Stuffing did not help and could reduce visibility
Lower-ranked pages benefited mostCite Sources increased visibility for pages ranked fifth by 115.1%
Perplexity.ai resultThe gain reached about 22% on Perplexity.ai, less than it did on the internal engine

Taken together, the failed keyword-stuffing test and the smaller result on Perplexity.ai support two practical conclusions. Substantive additions performed better than keyword manipulation, and the reported percentages should be treated as upper bounds rather than expected gains.

6. Critical assessment

Three contributions remain important:

  1. Naming and framing. The paper defined visibility in an AI-generated answer as a black-box optimization problem and gave the field a shared term for that problem.
  2. The impression metrics. Position-adjusted, continuous measures of visibility provide more information than a binary citation count and have influenced later measurement systems.
  3. A public benchmark. GEO-bench made the paper’s claims testable and opened them to independent criticism.

The conclusions also have four important limits:

  1. External validity. The study tested an internal GPT-3.5 harness and the 2023–24 version of Perplexity.ai. ChatGPT Search, Gemini, and AI Overviews use different retrieval and synthesis systems, so the paper does not establish that the same effects apply to them.
  2. Benchmark drift. Both GEO-bench’s corpus and the tested engines age. The 40% result belongs to a 2024 snapshot and should not be treated as a constant across time.
  3. Later evidence is less optimistic. Puerto et al.’s C-SEO Bench, published in the NeurIPS 2025 Datasets and Benchmarks Track, found that many conversational SEO rewrites became ineffective or counterproductive when several parties optimized for the same engine. The single-actor gain in the GEO paper is an upper bound, not a competitive equilibrium.
  4. The headline is easy to misread. Practitioner coverage often turns “up to 40%” into “about 40%.” The paper reports a per-method, per-domain maximum that fell to about 22% on a live engine and may decline further under competition and trust filtering, including E-E-A-T pressures.

Assessment. The paper supports adding source citations, statistics, and quotations instead of manipulating keywords. Its specific percentages are not reliable planning assumptions.

7. Reproducibility

The following resources were verified as of May 17, 2026:

ArtifactStatus
Source codePublic at github.com/GEO-optim/GEO (run_geo.py, geo_functions.py)
Benchmark dataPublic on Hugging Face at GEO-optim/geo-bench
LicenseApache-2.0
Project pagegenerative-engines.com/GEO/

The reproducibility rating is code-and-data. Both the method implementation and GEO-bench are public, so researchers can reproduce the main experiments independently. That level of access is uncommon among papers in this field.

8. Practical implications

For practitioners, the findings suggest four guidelines:

  • Make substantive changes. Add credible citations, concrete statistics, and relevant quotations instead of relying on keyword manipulation.
  • Measure prominence, not citation alone. A source can play a minor or substantial role in an answer even when both cases count as one citation. Include that distinction in AI citation tracking.
  • Do not reuse the reported percentages across engines or domains. The same rewrite can perform differently on ChatGPT Search and Perplexity.ai.
  • Expect competition to reduce gains for any one publisher. A method that helps one publisher may lose its advantage when competitors adopt it, as C-SEO Bench found.

9. Further reading

Frequently asked questions

What is the 'GEO paper' and why does it matter?
It is Aggarwal et al.'s GEO: Generative Engine Optimization, published at KDD 2024. The paper introduced the academic term GEO and was the first to formalize content optimization for AI-synthesized answers using a public benchmark, GEO-bench, and visibility metrics.
What impression or visibility metrics did the paper introduce?
The paper introduced two metrics. Position-Adjusted Word Count measures the words in cited sentences and discounts them according to where they appear in the answer. Subjective Impression uses GPT-3.5 to score seven dimensions, including relevance, influence, and uniqueness.
Does the 'up to 40%' figure still hold today?
Treat it as a bounded upper estimate, not a guarantee. It is the maximum for particular methods and domains on engines tested in 2023–24. The gain was up to about 22% on Perplexity.ai, and later work from C-SEO Bench found that many such rewrites fail under competition.
What does the paper say about GEO versus SEO?
Keyword Stuffing did not improve visibility and could reduce it, while substantive changes such as citing sources and adding statistics did help. This is early evidence that GEO is not simply a new label for traditional SEO tactics.
Is the code and benchmark available?
Yes. The code is available at github.com/GEO-optim/GEO, and GEO-bench is hosted on Hugging Face at GEO-optim/geo-bench. Both use the Apache-2.0 license, so the main experiments can be reproduced independently.

Related work

Sources

Primary

  1. GEO: Generative Engine Optimization (Aggarwal et al., KDD 2024) · arXiv / KDD '24 · 2024-08-25
  2. GEO: Generative Engine Optimization (KDD '24 Proceedings) · ACM SIGKDD · 2024-08-25
  3. GEO — official code & experiments repository · GEO-optim
  4. GEO-bench dataset (HuggingFace) · HuggingFace
  5. GEO project page · GEO-optim
  6. Retrieval-Augmented Generation for LLMs: A Survey (Gao et al. 2023) · arXiv · 2023-12-18

Secondary

  1. C-SEO Bench: Does Conversational SEO Work? (Puerto et al. 2025) · arXiv / NeurIPS '25 D&B
  2. Evaluating Verifiability in Generative Search Engines (Liu et al. 2023) · arXiv / EMNLP '23 Findings
Last updated: 2026-05-17 Authors: Ray Yang Topic: Ecosystem