spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
时间：2026-01-04 10:12
hadronix/robots-txt-disallow
Force robots.txt to disallow all
时间：2025-11-19 10:27
iprodev/sitemap-generator-pro
A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.
时间：2025-10-08 13:56
bertugfahriozer/ci4seopro
Professional SEO/AI indexing + Sitemap (index) + RSS + News/Image/Video sitemaps for CodeIgniter 4
时间：2025-10-01 23:27
wizardcompass/robots-txt-parser
A PHP library to parse and analyze robots.txt files with validation and URL fetching capabilities
时间：2025-09-22 19:57
fkrzski/robots-txt
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
时间：2024-12-16 20:41
eliashaeussler/typo3-sitemap-robots
Extension for TYPO3 CMS to enhance robots.txt with sitemap configurations
时间：2023-11-10 11:16
eliashaeussler/typo3-sitemap-locator
Sitemap Locator - Looks up XML sitemaps as part of a configured site. Supports various sitemap providers, e.g. by configured page type or robots.txt, and allows to implement custom providers.
时间：2023-11-03 08:29
fifty-deg/sylius-robots-plugin
Channel defined robots.txt plugin for Sylius.
时间：2023-05-16 15:54
webvpf/wn-robots-plugin
Robots - plugin for Winter CMS. Adds robots.txt for your site.
时间：2022-07-06 23:40
crwlr/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
时间：2021-11-07 21:46
merkandi/laravel-5-robots
Robots.txt Generator for Laravel 5
时间：2020-09-02 11:23
marcortola/behat-seo-contexts
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
时间：2020-01-10 18:43