CatgirlIntelligenceAgency/code/process-models/crawling-model/readme.md

14 lines
651 B
Markdown

# Crawling Models
Contains models shared by the [crawling-process](../../processes/crawling-process/) and
[converting-process](../../processes/converting-process/).
## Central Classes
* [CrawledDocument](src/main/java/nu/marginalia/crawling/model/CrawledDocument.java)
* [CrawledDomain](src/main/java/nu/marginalia/crawling/model/CrawledDomain.java)
* [CrawlingSpecification](src/main/java/nu/marginalia/crawling/model/spec/CrawlingSpecification.java)
### Marshalling
* [CrawledDomainReader](src/main/java/nu/marginalia/crawling/io/CrawledDomainReader.java)
* [CrawledDomainWriter](src/main/java/nu/marginalia/crawling/io/CrawledDomainWriter.java)