angeo/module-robots-txt-aeo
Magento 2 module for AI Engine Optimization (AEO). Injects AI crawler rules (OAI-SearchBot, GPTBot, PerplexityBot, Google-Extended, ClaudeBot and more) into robots.txt — without overwriting your existing configuration. Fixes the robots.txt signal in angeo/module-aeo-audit.
时间：2026-04-25 20:58
mage2kishan/module-robots-seo
Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directi
时间：2026-04-20 11:13
bopoda/robots-txt-parser
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
时间：2026-01-04 18:45
vipnytt/robotstxtparser
Robots.txt parsing library, with full support for every directive and specification.
时间：2026-01-04 18:23
t1gor/robots-txt-parser
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
时间：2026-01-04 04:33
loveduckie/silverstripe-robots
A Silverstripe module for managing the robots.txt file from the CMS.
时间：2024-11-17 11:08
evheniy/robots-txt-bundle
The RobotsTxtBundle adds the ability to generate robots.txt file to your application.
时间：2015-11-03 19:53
fourlabs/robots-bundle
Symfony2 bundle to control X-Robots-Tag HTTP header via annotations
时间：2015-08-27 16:52