Most llms.txt files came from templates, and many contain no links. Some sites write crawler restrictions into llms.txt. A block written only in llms.txt does nothing. Common Crawl analyzed 584,107 ...