As AI-powered search tools become more common, some website owners have begun creating separate versions of their content in Markdown format to make it easier for AI models to process. However, Google has indicated that this may not be the best approach.
Responding to a discussion on Bluesky, Google’s Search Advocate John Mueller encouraged website owners to prioritise improving their main websites for people rather than creating AI-specific versions that could become difficult to maintain.
Growing interest in AI-friendly content
The rapid growth of large language models (LLMs) has led some SEO professionals to experiment with new optimisation techniques aimed specifically at AI systems.
One recent trend involves creating Markdown versions of webpages or implementing LLMs.txt files, with the goal of making content easier for AI tools to crawl and interpret.
Some of this interest followed announcements from Cloudflare, which introduced features capable of automatically generating Markdown versions of webpages. The company explained that these files could reduce the number of tokens AI models need when processing content, making them more efficient for developers.
OpenAI does not require Markdown pages
Although AI crawlers are capable of reading Markdown files, there is no indication that website owners need to create them specifically for search visibility.
For example, OpenAI states that its OAI-SearchBot is designed to crawl websites so they can appear in ChatGPT Search results. Its published guidance recommends allowing the crawler through a website’s robots.txt file but does not advise publishers to create separate Markdown versions of their pages.
While the crawler can process Markdown content if it is available, it is not a requirement for being indexed or surfaced in AI-powered search.
Accessibility should come first
The discussion began after web accessibility specialist Stephanie Walter argued that too much attention is being given to making websites accessible for AI systems rather than improving accessibility for people.
She pointed out that some websites now provide simplified AI-friendly versions while still overlooking essential accessibility features such as logical heading structures and navigation landmarks that help users relying on screen readers.
Google advises fixing the main website
John Mueller agreed that creating separate AI-specific versions of websites is unlikely to be the best long-term solution.
He explained that a properly structured website should already work effectively for search engines, AI systems and, most importantly, human visitors.
Rather than maintaining separate versions for different technologies, Google recommends improving the primary website itself. Doing so avoids creating unnecessary technical complexity and reduces the need for repeated maintenance as AI technologies continue to evolve.
Well-structured HTML remains the standard
Google’s comments also reinforce the importance of using clean, well-organised HTML.
Search engines have successfully crawled and understood HTML webpages for decades, and modern AI systems are equally capable of processing properly structured content without requiring an alternative format.
A website with clear headings, logical page structure, descriptive links and accessible navigation benefits not only search engines but also users across a wide range of devices and assistive technologies.
Good accessibility also supports SEO
Improving website accessibility has long been recognised as good practice for search engine optimisation.
Clear page structures, descriptive content and positive user experiences help visitors find information more easily while also making webpages easier for search engines to understand.
Although new AI-focused optimisation techniques continue to emerge, Google’s latest comments suggest that the most effective long-term strategy remains unchanged: build websites primarily for people, ensure they are accessible to everyone and maintain high technical standards.
As AI search continues to develop, focusing on strong website foundations rather than short-term trends is likely to provide more sustainable results for both users and search visibility.
More Digital Marketing BLOGS here:
Local SEO 2024 – How To Get More Local Business Calls
3 Strategies To Grow Your Business
Is Google Effective for Lead Generation?
How To Get More Customers On Facebook Without Spending Money
How Do I Get Clients Fast On Facebook?
How Do You Use Retargeting In Marketing?
How To Get Clients From Facebook Groups