spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
时间：2026-01-04 10:12
daikazu/robotstxt
Dynamically generate robots.txt content based on the current Laravel environment.
时间：2025-11-21 12:06
hadronix/robots-txt-disallow
Force robots.txt to disallow all
时间：2025-11-19 10:27
leopoletto/robots-txt-parser
A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers
时间：2025-11-07 21:51
iprodev/sitemap-generator-pro
A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.
时间：2025-10-08 13:56
bertugfahriozer/ci4seopro
Professional SEO/AI indexing + Sitemap (index) + RSS + News/Image/Video sitemaps for CodeIgniter 4
时间：2025-10-01 23:27
wizardcompass/robots-txt-parser
A PHP library to parse and analyze robots.txt files with validation and URL fetching capabilities
时间：2025-09-22 19:57
fkrzski/robots-txt
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
时间：2024-12-16 20:41
eliashaeussler/typo3-sitemap-robots
Extension for TYPO3 CMS to enhance robots.txt with sitemap configurations
时间：2023-11-10 11:16
eliashaeussler/typo3-sitemap-locator
Sitemap Locator - Looks up XML sitemaps as part of a configured site. Supports various sitemap providers, e.g. by configured page type or robots.txt, and allows to implement custom providers.
时间：2023-11-03 08:29
fifty-deg/sylius-robots-plugin
Channel defined robots.txt plugin for Sylius.
时间：2023-05-16 15:54
webvpf/wn-robots-plugin
Robots - plugin for Winter CMS. Adds robots.txt for your site.
时间：2022-07-06 23:40
crwlr/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
时间：2021-11-07 21:46