Lisäosan avainsana: crawler
-
Zicy AI Access Monitor
(0 arvosanat yhteensä)Monitor known AI crawlers and AI assistant fetches, with daily rollups, CSV exports, weekly summaries, and page briefs.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
(0 arvosanat yhteensä)Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
GoBookMart Robots Editor
(1 arvosanat yhteensä)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Virtual LLMS.TXT Generator
(0 arvosanat yhteensä)Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.
-
URLs Most Wanted for LiteSpeed LScache
(0 arvosanat yhteensä)A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.
-
AI Crawler Guard
(0 arvosanat yhteensä)Detect and control AI crawler access with local logging and history.
-
Whizz MD — Markdown Endpoints for AI Crawlers
(0 arvosanat yhteensä)Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
(0 arvosanat yhteensä)Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
Pixellize Site Issue Scanner
(2 arvosanat yhteensä)Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.
-
Cleotic AI Traffic
(0 arvosanat yhteensä)See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.