Raw values for polite-crawler
io.github.mark1russell7/polite-crawler · Registry status: active
What the source declared verbatim, unchanged and uninterpreted. The derived values on the overview page are computed from these.
Evidence for this page · Source: MCP-Register · collected on 2026-10-14
Every value below comes from it. Where one differs, its origin is stated on its row.
| Description (raw) | A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes. |
|---|---|
| Environment variables (raw) | POLITE_CRAWLER_DIR, POLITE_CRAWLER_CONTACT, POLITE_CRAWLER_ALLOW_PRIVATE, POLITE_CRAWLER_ALLOW_USER_PROVIDED |
| Required secret variables (raw) | confirmed absent |
| Transports (raw) | stdio |
| Path arguments (raw) | confirmed absent |
| Repository (raw) | https://github.com/mark1russell7/crawler |
| Package registries (raw) | npm |
| Required secret headers (raw) | confirmed absent |
| Path environment variables (raw) | POLITE_CRAWLER_DIR |
| Remote URLs (raw) | confirmed absent |
| Remote hosts (raw) | confirmed absent |
| Registry status message (raw) | confirmed absent |
| First listed in the registry (raw) | 2026-10-13 |
| Last changed in the registry (raw) | 2026-10-13 |
| Schema version of the raw record (raw) | https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json |
| Delivery form (raw) | package |
| Repository platform (raw) | github |
| Repository subfolder (raw) | packages/polite-crawler |
| Package identifiers (raw) | polite-crawler |
| Package versions (raw) | 0.1.0 |
| Runtime hints (raw) | npx |
| Environment variable formats (raw) | boolean, filepath |
| Environment variable descriptions (raw) | POLITE_CRAWLER_ALLOW_PRIVATE=Set it to 1 to let the crawler fetch loopback, private and link-local addresses. The default refuses them. · POLITE_CRAWLER_ALLOW_USER_PROVIDED=Set it to 1 to let user_provided read a page that refuses AI input when the client cannot ask the user to confirm. · POLITE_CRAWLER_CONTACT=An email address or URL for the From header of each request. · POLITE_CRAWLER_DIR=The folder of the store. The default is ~/.polite-crawler. |
| Icon formats (raw) | confirmed absent |
| Connection paths (source structure) | {"packages":[{"registryType":"npm","identifier":"polite-crawler","version":"0.1.0","runtimeHint":"npx","transport":"stdio","environment":[{"name":"POLITE_CRAWLER_DIR","description":"The folder of the store. The default is ~/.polite-crawler.","format":"filepath","required":false,"secret":false},{"name":"POLITE_CRAWLER_CONTACT","description":"An email address or URL for the From header of each request.","required":false,"secret":false},{"name":"POLITE_CRAWLER_ALLOW_PRIVATE","description":"Set it to 1 to let the crawler fetch loopback, private and link-local addresses. The default refuses them.","format":"boolean","required":false,"secret":false},{"name":"POLITE_CRAWLER_ALLOW_USER_PROVIDED","description":"Set it to 1 to let user_provided read a page that refuses AI input when the client cannot ask the user to confirm.","format":"boolean","required":false,"secret":false}],"additional_arguments_declared":true}],"remotes":[]} |
Position within the directory
How many of the 44,302 published entries carry the same measured value. A reference figure, not an assessment.
- Required secrets declaredno37,949 of 44,302 carry this value (86 %)View these entries
- Execution locationlocal17,666 of 44,302 carry this value (40 %)View these entries
- Path argument presentyes539 of 44,302 carry this value (1.2 %)View these entries
- Repository URL listedyes31,303 of 44,302 carry this value (71 %)View these entries
- Field of use, derived from the vendor descriptionWeb scraping504 of 44,302 carry this value (1.1 %)View these entries
All 5 values together are carried by 2 of 44,302 entries.
tracevero · https://tracevero.com/mcp/io-github-mark1russell7-polite-crawler/rohangaben