387 B
387 B
Crawl Blocklist
Contains tools for blocking links from crawling.
Central Classes
- GeoIpBlocklist - country blocking
- IpBlocklist - CIDR-based blocking
- UrlBlocklist - URL pattern blocking