> ## Documentation Index > Fetch the complete documentation index at: https://docs.cloudhumans.com/llms.txt > Use this file to discover all available pages before exploring further. # List content sources > The sites configured to be crawled into this knowledge base. Each source says where the crawl starts, what it may follow, and when it runs. The content a crawl produces is read through listEntries like any other. ## OpenAPI ````yaml /api-reference/specs/claudia/v1.json get /v1/knowledge-bases/{kbId}/scraper-config openapi: 3.0.1 info: title: Claudia API version: 1.0.0 servers: - url: https://api.cloudhumans.com/claudia description: Production - url: https://api.cloudhumans.com/claudia/staging description: Staging security: - bearerAuth: [] tags: - name: MCP Servers description: >- The MCP servers your agents can call tools on. Registering one here is what makes its tools selectable in an agent; the credentials it needs are stored encrypted and never read back. - name: Knowledge Base Content description: Read, search and edit the content that answers your customers. - name: Content Quality description: Rewrites proposed for content that is answering your customers badly. - name: Playground description: >- Talk to one of your agents as if you were a customer, without touching a real conversation. - name: Project Settings description: >- Read and change how a ClaudIA project behaves — the settings screens of the ClaudIA app, as an API. - name: Content Improvements description: Answers Claudia proposes for questions your content does not cover yet. - name: Knowledge Bases description: The knowledge bases your account can manage. - name: Content Sources description: The sites Claudia crawls to keep a knowledge base in sync. paths: /v1/knowledge-bases/{kbId}/scraper-config: get: tags: - Content Sources summary: List content sources description: >- The sites configured to be crawled into this knowledge base. Each source says where the crawl starts, what it may follow, and when it runs. The content a crawl produces is read through listEntries like any other. operationId: listContentSources parameters: - name: kbId in: path description: Knowledge base to operate on. Get the ids from listMyKnowledgeBases. required: true schema: type: string responses: '200': description: The sources this knowledge base crawls. content: application/json: schema: type: array items: $ref: '#/components/schemas/ContentSource' '400': description: The request could not be answered as written. content: application/json: schema: $ref: '#/components/schemas/Error' '401': description: Missing, expired or invalid credentials. '403': description: The credentials hold no account allowed to manage this content. content: application/json: schema: $ref: '#/components/schemas/Error' '404': description: >- No such resource, or none these credentials can reach — the two are deliberately indistinguishable. content: application/json: schema: $ref: '#/components/schemas/Error' '429': description: Rate limit applied by the API gateway. Back off and retry. components: schemas: ContentSource: required: - allowedDomains - createdAt - cron - defaultScraperTag - excludePathFilter - pathFilter - startUrl - type type: object properties: configId: type: string description: Use this id to update or delete this source. example: 6683f1c2a4b19e0012ab34cd enabled: type: boolean description: A disabled source stays configured but is not crawled. example: true startUrl: type: string description: Where the crawl starts. example: https://ajuda.acme.com cron: type: string description: >- When the crawl runs, as a cron expression. Empty means it only runs on demand. example: 0 0 3 * * * allowedDomains: type: string description: Hosts the crawl may follow links into. Comma-separated. example: ajuda.acme.com pathFilter: type: string description: Only paths matching this are crawled. Empty means the whole site. example: /artigos excludePathFilter: type: string description: Paths never crawled, even when they match pathFilter. example: /artigos/rascunhos defaultScraperTag: type: string description: Tag applied to every entry this source imports. example: ajuda defaultScraperTopic: type: string description: Topic every entry this source imports is grouped under. example: Autoatendimento type: type: string description: Crawler this source runs on. enum: - SCRAPY - FIRECRAWL - CLOUDCHAT maxAgeMs: type: integer description: >- How old a previously fetched page may be before it is fetched again, in milliseconds. Absent means the crawler's own default. format: int64 example: 86400000 locales: type: array description: Languages to keep when the site publishes several. example: - pt-BR items: type: string description: Languages to keep when the site publishes several. example: '["pt-BR"]' createdAt: type: string description: When the source was configured (ISO-8601). example: '2026-08-10T14:32:05' updatedAt: type: string description: When it last changed (ISO-8601). Absent until the first change. example: '2026-08-10T18:20:41' description: A site Claudia crawls to keep this knowledge base in sync. Error: required: - error type: object properties: error: type: string description: What went wrong. example: 'Forbidden: token holds no claim for the requested account' description: Something the caller needs to fix. securitySchemes: bearerAuth: type: http scheme: bearer bearerFormat: JWT ````