This website requires JavaScript.
Explore
Help
Sign In
161sh
/
CatgirlIntelligenceAgency
Watch
1
Star
0
Fork
0
You've already forked CatgirlIntelligenceAgency
Code
Issues
Pull Requests
Packages
Projects
Releases
Wiki
Activity
a5bc29245b
CatgirlIntelligenceAgency
/
code
/
process-models
/
crawling-model
History
Viktor Lofgren
a5bc29245b
(cleanup) Remove vestigial support for WARC crawl data streams
2023-12-20 15:46:21 +01:00
..
src
(cleanup) Remove vestigial support for WARC crawl data streams
2023-12-20 15:46:21 +01:00
build.gradle
(warc) Filter WarcResponses based on X-Robots-Tags
2023-12-16 15:58:27 +01:00
readme.md
(refactor) Remove features-search and update documentation
2023-10-09 15:12:30 +02:00
readme.md
Crawling Models
Contains models shared by the
crawling-process
and
converting-process
.
Central Classes
CrawledDocument
CrawledDomain
Serialization
CrawledDomainReader
CrawledDomainWriter