vipnytt/useragentparser
User-Agent parser for robot rule sets
时间：2026-01-04 18:07
eliashaeussler/typo3-sitemap-locator
Sitemap Locator - Looks up XML sitemaps as part of a configured site. Supports various sitemap providers, e.g. by configured page type or robots.txt, and allows to implement custom providers.
时间：2026-01-04 17:16
webignition/robots-txt-file
Models a robots.txt file
时间：2026-01-04 15:36
spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
时间：2026-01-04 10:12
anomaly/robots-extension
A simple robots.txt generator.
时间：2026-01-04 06:40
tomverran/robots-txt-checker
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
时间：2026-01-04 06:07
t1gor/robots-txt-parser
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
时间：2026-01-04 04:33
fuelviews/laravel-robots-txt
Laravel robots txt package
时间：2026-01-04 04:32
marcortola/behat-seo-contexts
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
时间：2026-01-04 02:56
daikazu/robotstxt
Dynamically generate robots.txt content based on the current Laravel environment.
时间：2025-11-21 12:06
hadronix/robots-txt-disallow
Force robots.txt to disallow all
时间：2025-11-19 10:27
leopoletto/robots-txt-parser
A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers
时间：2025-11-07 21:51
iprodev/sitemap-generator-pro
A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.
时间：2025-10-08 13:56