Accept-md
One command to make Next.js sites LLM-scraping friendly. I recently saw a post from the Vercel CEO pointing out that LLMs understand websites much better when they can request: `Accept: text/markdown` Most websites today are built for humans.
Reactions (1)
Similar products
by description similarity
LLM Scraper
github.comturn any webpage into structured data
Provide LLMs hosted, clean markdown documentation of libraries and frameworks
I built a free LLMs.txt generator
veerhost.comYou just enter the main website URL, and it tries to detect the sitemap, collect important pages, extract titles and descriptions, and generate a structured llms.txt file that you can preview and download.
DOM to Semantic-Markdown for use with LLMs
LLMFeeder
github.comBrowser extension to extract clean content for LLM context