c41e68aaab
This commit also refactors the executor a bit, and introduces a new converter-feature called data-extractors for this class of jobs. |
||
---|---|---|
.. | ||
src/main/java/nu/marginalia/extractor | ||
build.gradle | ||
readme.md |
Contains converter-like extraction jobs that operate on crawled data to produce export files.
Important classes
- AtagExporter - extracts anchor texts from the crawled data.
- FeedExporter - tries to find RSS/Atom feeds within the crawled data.
- TermFrequencyExporter - exports the 'TF' part of TF-IDF.