161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
acc2b4e10f
CatgirlIntelligenceAgency/code/features-convert/data-extractors
History
Viktor Lofgren 1b8b97b8ec (sample-exporter) Add some limits on sizes and lengths 
Tar files will reject entries with filenames over 100b, so we need a limit there.  Also added a maximum size limit to keep the file sizes reasonable.
2024-01-25 11:51:53 +01:00
..
src/main/java/nu/marginalia/extractor (sample-exporter) Add some limits on sizes and lengths 2024-01-25 11:51:53 +01:00
build.gradle (control) New GUI for exporting crawl data samples 2024-01-23 17:08:21 +01:00
readme.md (control) New export actions for RSS/Atom feeds and term frequency data 2024-01-15 14:54:26 +01:00

readme.md

Contains converter-like extraction jobs that operate on crawled data to produce export files.

Important classes