spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
时间：2026-01-04 10:12
hadronix/robots-txt-disallow
Force robots.txt to disallow all
时间：2025-11-19 10:27
iprodev/sitemap-generator-pro
A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.
时间：2025-10-08 13:56
wizardcompass/robots-txt-parser
A PHP library to parse and analyze robots.txt files with validation and URL fetching capabilities
时间：2025-09-22 19:57
fkrzski/robots-txt
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
时间：2024-12-16 20:41
monsieurbiz/sylius-robots-txt-plugin
Manage your robot.txt from your Sylius admin pannel
时间：2024-07-29 11:24
fuelviews/laravel-robots-txt
Laravel robots txt package
时间：2024-03-05 23:37
crwlr/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
时间：2021-11-07 21:46
bopoda/robots-txt-parser
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
时间：2019-01-02 12:29
bnomei/kirby3-robots-txt
Manage a virtual robots.txt from the Kirby config file
时间：2018-10-05 15:56
execut/yii2-robots-txt
Module for generate robots.txt file by url rules
时间：2016-07-13 13:23
hofff/contao-robots-txt-editor
Editor for auto creation and modification of robots.txt.
时间：2015-10-26 21:42
t1gor/robots-txt-parser
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
时间：2014-10-29 12:08
tomverran/robots-txt-checker
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
时间：2014-04-15 20:20