cgoit/contao-robots-txt-bundle
Gives you the option to use a centralized robots.txt configuration for multiple contao installations.
时间：2025-03-15 21:58
fkrzski/robots-txt
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
时间：2024-12-16 20:41
svc/sitemap-bundle
Bundle to create easy XML sitemaps and robots.txt files
时间：2024-11-29 21:07
loveduckie/silverstripe-robots
A Silverstripe module for managing the robots.txt file from the CMS.
时间：2024-11-17 11:08
mauricerenck/darkvisitors
Kirby robots.txt plugin for blocking AI Crawlers and Bots
时间：2024-04-18 17:22
presprog/kirby-seo-plugin
Opinionated SEO plugin for Kirby 4. With meta description, open graph, sitemap and robots.txt
时间：2024-02-28 08:41
taketool/sysinfo
Migration support, maintenance and security: Provides a backend module for showing which plugins / templates included where and some security related topics. Check configured sitemap.xml and robots.txt
时间：2024-01-11 17:09
fifty-deg/sylius-robots-plugin
Channel defined robots.txt plugin for Sylius.
时间：2023-05-16 15:54
twentytwo-labs/behat-seo-extension
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
时间：2023-04-19 10:32
nickdekruijk/laravel-robots
Dynamic robots.txt files for Laravel projects
时间：2023-04-05 15:54
jamesshaver/phpcrawl
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
时间：2023-01-23 08:08
dr4g0nsr/sitemap-crawler
Crawler for any type of site using robots.txt and sitemap.xml as the source of URL. Useful for cache regenerating.
时间：2022-11-07 21:13
oxyagency/laravel-5-robots
Robots.txt Generator for Laravel 5
时间：2022-07-14 12:41