CatgirlIntelligenceAgency/code/features-crawl/crawl-blocklist/readme.md

9 lines
387 B
Markdown
Raw Normal View History

# Crawl Blocklist
Contains tools for blocking links from crawling.
## Central Classes
* [GeoIpBlocklist](src/main/java/nu/marginalia/ip_blocklist/GeoIpBlocklist.java) - country blocking
* [IpBlocklist](src/main/java/nu/marginalia/ip_blocklist/IpBlockList.java) - CIDR-based blocking
* [UrlBlocklist](src/main/java/nu/marginalia/ip_blocklist/UrlBlocklist.java) - URL pattern blocking