2023-03-06 18:32:13 +01:00
|
|
|
# Crawling Models
|
|
|
|
|
|
2023-03-13 17:39:53 +01:00
|
|
|
Contains models shared by the [crawling-process](../../processes/crawling-process/) and
|
|
|
|
|
[converting-process](../../processes/converting-process/).
|
2023-03-06 19:01:36 +01:00
|
|
|
|
|
|
|
|
## Central Classes
|
|
|
|
|
|
|
|
|
|
* [CrawledDocument](src/main/java/nu/marginalia/crawling/model/CrawledDocument.java)
|
|
|
|
|
* [CrawledDomain](src/main/java/nu/marginalia/crawling/model/CrawledDomain.java)
|
2023-03-17 16:03:11 +01:00
|
|
|
* [CrawlingSpecification](src/main/java/nu/marginalia/crawling/model/spec/CrawlingSpecification.java)
|
2023-03-06 19:01:36 +01:00
|
|
|
|
|
|
|
|
### Marshalling
|
|
|
|
|
* [CrawledDomainReader](src/main/java/nu/marginalia/crawling/io/CrawledDomainReader.java)
|
|
|
|
|
* [CrawledDomainWriter](src/main/java/nu/marginalia/crawling/io/CrawledDomainWriter.java)
|
