Skip to content

History of polite-crawler

io.github.mark1russell7/polite-crawler · Registry status: active

Report data on this entry

Every published change to this entry, most recent first.

Changes
2026-10-14Declared version: – → 0.1.0
2026-10-14Field of use, derived from the vendor description: – → Web scraping
2026-10-14Repository URL listed: – → yes
2026-10-14Path argument present: – → yes
2026-10-14Execution location: – → local
2026-10-14Required secrets declared: – → no
2026-10-14Description (raw): – → A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
2026-10-14Last changed in the registry (raw): – → 2026-10-13
2026-10-14First listed in the registry (raw): – → 2026-10-13
2026-10-14Registry status message (raw): – → –
2026-10-14Schema version of the raw record (raw): – → https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json
2026-10-14Icon formats (raw): – → –
2026-10-14Environment variable descriptions (raw): – → POLITE_CRAWLER_ALLOW_PRIVATE=Set it to 1 to let the crawler fetch loopback, private and link-local addresses. The default refuses them. · POLITE_CRAWLER_ALLOW_USER_PROVIDED=Set it to 1 to let user_provided read a page that refuses AI input when the client cannot ask the user to confirm. · POLITE_CRAWLER_CONTACT=An email address or URL for the From header of each request. · POLITE_CRAWLER_DIR=The folder of the store. The default is ~/.polite-crawler.
2026-10-14Environment variable formats (raw): – → boolean, filepath
2026-10-14Delivery form (raw): – → package
2026-10-14Remote hosts (raw): – → –
2026-10-14Connection paths (source structure): – → {"packages":[{"registryType":"npm","identifier":"polite-crawler","version":"0.1.0","runtimeHint":"npx","transport":"stdio","environment":[{"name":"POLITE_CRAWLER_DIR","description":"The folder of the store. The default is ~/.polite-crawler.","format":"filepath","required":false,"secret":false},{"name":"POLITE_CRAWLER_CONTACT","description":"An email address or URL for the From header of each request.","required":false,"secret":false},{"name":"POLITE_CRAWLER_ALLOW_PRIVATE","description":"Set it to 1 to let the crawler fetch loopback, private and link-local addresses. The default refuses them.","format":"boolean","required":false,"secret":false},{"name":"POLITE_CRAWLER_ALLOW_USER_PROVIDED","description":"Set it to 1 to let user_provided read a page that refuses AI input when the client cannot ask the user to confirm.","format":"boolean","required":false,"secret":false}],"additional_arguments_declared":true}],"remotes":[]}
2026-10-14Remote URLs (raw): – → –
2026-10-14Runtime hints (raw): – → npx
2026-10-14Package versions (raw): – → 0.1.0
2026-10-14Package identifiers (raw): – → polite-crawler
2026-10-14Package registries (raw): – → npm
2026-10-14Repository subfolder (raw): – → packages/polite-crawler
2026-10-14Repository platform (raw): – → github
2026-10-14Repository (raw): – → https://github.com/mark1russell7/crawler
2026-10-14Path environment variables (raw): – → POLITE_CRAWLER_DIR
2026-10-14Path arguments (raw): – → –
2026-10-14Transports (raw): – → stdio
2026-10-14Required secret headers (raw): – → –
2026-10-14Required secret variables (raw): – → –
2026-10-14Environment variables (raw): – → POLITE_CRAWLER_DIR, POLITE_CRAWLER_CONTACT, POLITE_CRAWLER_ALLOW_PRIVATE, POLITE_CRAWLER_ALLOW_USER_PROVIDED

tracevero · https://tracevero.com/mcp/io-github-mark1russell7-polite-crawler/aenderungen