There's a new file that belongs on your website, and most business owners have never heard of it. It's called llms.txt, and it might be one of the simplest things you can do to help AI search engines find and recommend your business.
If you're familiar with robots.txt—the file that tells search engine crawlers what they can and can't access on your site—think of llms.txt as its companion for AI. While robots.txt controls access, llms.txt provides context. It gives AI systems a clear, organized summary of your business that's specifically designed for machine consumption.
What Is llms.txt?
The llms.txt file is a plain text file placed at the root of your website (yoursite.com/llms.txt) that provides a structured, human-readable but machine-optimized overview of your business or website. It was proposed as a standard way for website owners to communicate directly with AI language models and their crawlers.
Think of it this way: when an AI crawler like GPTBot (ChatGPT), ClaudeBot, or PerplexityBot visits your website, it has to read through all your pages and try to piece together what your business is about. That process is imperfect—the AI might miss important details, misunderstand your services, or skip pages entirely. An llms.txt file solves this by giving the AI a concise, accurate summary upfront.
Peak Performance PT in Boulder, CO saw firsthand what a difference this can make. As a physical therapy practice with multiple specialties—sports rehab, post-surgical recovery, and dry needling—AI crawlers were struggling to categorize them accurately. After adding an llms.txt file that clearly listed their specialties, service area, accepted insurance networks, and key credentialing details, they started appearing in ChatGPT and Perplexity recommendations for queries like "best sports physical therapist in Boulder." A single text file turned them from invisible to cited.
See where your business stands right now. Run a free Sigma Score scan →
Simple analogy: Imagine a new employee starting at your company. You could let them wander around and figure things out on their own, or you could hand them a one-page summary of the business, key departments, and where to find important information. The llms.txt file is that one-page summary, but for AI systems.
How llms.txt Works
When an AI crawler visits your website, it looks for the llms.txt file at the root of your domain. If it finds one, it reads the file first to get a quick understanding of your business before crawling the rest of your site. This helps the AI:
- Understand your business context before processing individual pages
- Prioritize the most important pages on your site
- Correctly categorize your business by type, industry, and location
- Know which services you offer and what areas you serve
- Generate more accurate recommendations when users ask about businesses like yours
The Format and Structure of llms.txt
The llms.txt file uses a simple, structured format based on Markdown. It's designed to be easy for both humans and machines to read. Here's the general structure:
The Header Section
The file starts with a title (your business name) followed by a brief description of what your business does. This is the most important part—it's the first thing AI systems read.
Key Information Sections
Below the header, you organize information into sections. For a local business, typical sections include:
- About: A paragraph describing your business, specialties, and what makes you different
- Services: A list of your services with brief descriptions and links to relevant pages
- Location and Service Area: Where you're located and the areas you serve
- Important Pages: Links to your most important pages with descriptions of what each one covers
Links and Resources
Each section can include links to relevant pages on your site. These links use a simple format with a description followed by the URL. This helps AI crawlers quickly navigate to the most important content on your site.
How to Create an llms.txt File for Your Business
Creating an llms.txt file is straightforward. Here's the step-by-step process:
Step 1: Gather Your Information
Before you start writing, collect the following information: your business name, a one-line description, a more detailed paragraph about your business, a list of your services, your location and service area, and the URLs of your most important pages.
Step 2: Write the File
Create a plain text file and organize your information using the structure outlined above. Start with your business name as the title, add a brief description, then list your services, location, and important pages. Keep it concise—the file should be thorough but not excessively long.
Step 3: Upload to Your Website Root
Save the file as “llms.txt” and upload it to the root directory of your website. It should be accessible at yoursite.com/llms.txt. This is similar to where your robots.txt file lives.
Step 4: Verify It's Accessible
After uploading, visit yoursite.com/llms.txt in your browser to make sure it loads correctly. If it returns a 404 error, the file may be in the wrong directory or named incorrectly.
Why AI Crawlers Need llms.txt
AI crawlers face a unique challenge that traditional search engine crawlers don't. Traditional crawlers are primarily indexing keywords and links. AI crawlers need to understand the meaning, context, and relationships in your content. Here's why llms.txt helps:
- Reduces misinterpretation: Without llms.txt, an AI crawler reading a plumbing website might not correctly distinguish between a plumber who does residential work and one who does commercial work. The llms.txt file makes this explicit.
- Saves processing time: AI crawlers have limited resources. An llms.txt file lets them quickly understand your business without crawling every single page, making them more likely to include your business in their knowledge base.
- Provides authoritative self-description: Your llms.txt file is your opportunity to tell AI exactly how you want your business to be understood and described. It's like writing your own introduction rather than letting others define you.
- Highlights key content: By pointing AI crawlers to your most important pages, you ensure they don't spend time on less relevant content or miss the pages that best represent your business.
Common Mistakes to Avoid
If you're creating an llms.txt file, avoid these common pitfalls:
- Making it too long. The file should be a concise summary, not a copy of your entire website. Keep it focused on the most important information.
- Using marketing fluff. AI systems don't respond to sales language. Be factual and specific: “Licensed and insured plumbing company serving the greater Dallas area since 2005” is better than “The best plumber you'll ever call!”
- Forgetting to update it. If you add new services, change your location, or update your website structure, update your llms.txt file accordingly.
- Putting it in the wrong location. The file must be at the root of your domain (yoursite.com/llms.txt), not in a subdirectory.
Need help creating your llms.txt file? Our team at Sigma Agents creates custom llms.txt files for local businesses as part of our AI visibility optimization service. Start with a free AI visibility scan to see where you stand, then book a free strategy call to discuss how we can help.
How Sigma Agents Applies This
At Sigma Agents, llms.txt creation is a core part of our AI visibility methodology. We do not treat it as a standalone file—we build it in tandem with your schema markup, robots.txt configuration, and overall content strategy so that every AI touchpoint delivers a consistent, accurate picture of your business.
Our process starts with a Sigma Score audit that evaluates how AI crawlers currently perceive your site. We identify what information is missing, misunderstood, or buried, then craft an llms.txt file that surfaces the details AI systems need: your services, specialties, service area, credentials, and the pages that best represent your authority. The result is a structured self-description that dramatically increases your chances of being cited in AI-generated answers.
We also monitor how AI platforms reference your business over time and update your llms.txt as your services, locations, or competitive landscape evolve. For local businesses just getting started with AI visibility, adding an llms.txt file is one of the fastest wins available—and it is included in every Sigma Agents engagement.
Ready to put this into action?
Book a free strategy call →Frequently Asked Questions
Is llms.txt an official standard?
The llms.txt format is a proposed standard that has gained significant traction in the AI and web development community. While it's not mandated by any specific organization, AI companies are increasingly looking for and using llms.txt files when their crawlers visit websites. Early adoption gives you an advantage.
Do I need llms.txt if I already have robots.txt?
Yes, they serve different purposes. Robots.txt controls access—telling crawlers what they can and can't visit. The llms.txt file provides context—helping AI systems understand your business. You need both for comprehensive AI visibility.
Will llms.txt help my Google rankings?
The llms.txt file isn't a traditional Google ranking factor. However, it helps AI systems—including Google's AI—better understand your business, which can improve your visibility in AI Overviews and other AI-powered search features. It's specifically designed for the new generation of AI-powered discovery.
How long should my llms.txt file be?
For most local businesses, the llms.txt file should be roughly one to two pages of text. It should be comprehensive enough to give AI systems a complete picture of your business, but concise enough that it doesn't overwhelm with unnecessary detail. Focus on what matters: who you are, what you do, where you serve, and your most important pages.