sleeping-owl/apist
Package to provide api-like access to foreign sites based on html parsing
时间：2014-10-22 13:22
opensearchserver/opensearchserver
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), REST APIs, .... This library uses OpenSearchServer's V2 API.
时间：2014-07-03 09:38
crossjoin/browscap
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP f
时间：2014-06-01 14:16
tomverran/robots-txt-checker
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
时间：2014-04-15 20:20
codeguy/arachnid
A crawler to find all unique internal pages on a given website
时间：2014-01-06 17:37
vdb/php-spider
A configurable and extensible PHP web spider
时间：2013-03-05 22:24
pagemunch/pagemunch
A PHP wrapper for the PageMunch link unfurling API
时间：2013-02-13 07:50
jyggen/curl
A simple and lightweight cURL library with support for asynchronous requests.
时间：2012-12-18 10:46
blanchonvincent/simple-page-crawler
ZF2 module v0.3.0 - Provide a crawler to get web page informations : title, meta, heading tags and images
时间：2012-12-15 22:01
blanchonvincent/search-engine-crawler
ZF2 module v0.4.3 - SearchEngineCrawler is a SEO/SEA/SMO crawler.
时间：2012-12-07 20:52
wa72/htmlpagedom
jQuery-inspired DOM manipulation extension for Symfony's Crawler
时间：2012-11-16 22:27