Training data
The large body of text an AI model learned from before it was released.
Why it matters: What the model learned in training shapes its default view of your category, which is why consistent public information about you matters over time.
Knowledge cutoff
The date after which an AI model's training data stops. Events after the cutoff are unknown to the model unless it searches the web.
Why it matters: Recent launches, prices or rebrands may be missing from answers that rely on training data alone.
Web search in AI answers
Also called: Grounding, retrieval
When an AI assistant searches the web while answering and uses the pages it finds. Often called grounding or retrieval.
Why it matters: When an assistant searches, your current pages and the sites that mention you can shape today's answer, not just what it learned in the past.
How buyers use AI to shortlist vendors →AI crawler
Also called: AI bot
A program an AI company uses to read web pages, either to train its models or to fetch pages when answering a question.
Why it matters: If your website blocks the crawlers that fetch pages for answers, assistants may not be able to read your site when buyers ask.
Which AI crawlers to allow →robots.txt
A small file on your site, at yourdomain.com/robots.txt, that tells crawlers where they may and may not go.
Why it matters: It is the main switch for allowing or blocking AI crawlers. One wrong line can hide your whole site from an assistant.
How to check your robots.txt →llms.txt
A suggested file, found at yourdomain.com/llms.txt, that offers AI tools a brief overview of a site and points to its most useful pages. It is a community idea, not an official standard.
Why it matters: Adding one costs little. So far, the big AI companies have not confirmed they read it when choosing which companies to name.
Does llms.txt help? →Entity
A clearly identifiable thing, such as a company, product or person, that search engines and AI models can recognise and connect to facts about it.
Why it matters: When your company is a clear entity, with the same name, description and links everywhere, AI is less likely to confuse you with someone else.
Knowledge graph
A database of entities and the facts that connect them, such as which company makes which product. Google runs the best-known one.
Why it matters: Facts in knowledge graphs feed many answers. Consistent, structured information about your company helps it be represented correctly.
Third-party mentions
Also called: Off-site mentions
What other websites say about your company: reviews, lists, comparisons, news and directories.
Why it matters: AI assistants often lean on what independent sites say. Being described well on the sites that rank for your category can matter as much as your own pages.
Why rivals get named instead →