POST
/llmstxt
Firecrawl APIGenerate LLMs.txt for a website
- Base URL
- https://api.firecrawl.dev/v1
- Auth
- Authorization: Bearer <FIRECRAWL_API_KEY>
- Last verified
- 2026-09-03 · upstream hash matched
Actions
Agents: curl -H "Accept: text/markdown" this URL
→ 223 tokens · Vary: Accept
→ 223 tokens · Vary: Accept
Critical gotchas
The formats field controls the output shape and defaults to ["markdown"]. Omitting it does not return HTML — request ["markdown","html"] explicitly.
/crawl is asynchronous: it returns a job id, and results are collected by polling /crawl/{id} until status is completed.
cURL
curl -X POST 'https://api.firecrawl.dev/v1/llmstxt' \ -H "Authorization: Bearer $FIRECRAWL_API_KEY" \ -H 'Content-Type: application/json' \ -d '{ "url": "https://example.com", "maxUrls": 2, "showFullText": false}'Get a free Firecrawl API key → sponsored
Parameters
| Name | In | Type | Required | Description |
|---|---|---|---|---|
| url | body | string | Yes | The URL to generate LLMs.txt from |
| maxUrls | body | integer | No | Maximum number of URLs to analyze |
| showFullText | body | boolean | No | Include full text content in the response |
Response 200 OK
{
"success": true,
"id": "00000000-0000-4000-8000-000000000000"
}