91dd45cf64
This commit also fixes a bug in the loader where the IP field wouldn't always populate as intended, and refactors the DomainInformationService to use significantly fewer SQL queries. |
||
---|---|---|
.. | ||
src | ||
build.gradle | ||
readme.md |
Crawl Blocklist
Contains tools for blocking links from crawling.
Central Classes
- GeoIpBlocklist - country blocking
- IpBlocklist - CIDR-based blocking
- UrlBlocklist - URL pattern blocking