CatgirlIntelligenceAgency/code/features-crawl/content-type
Viktor Lofgren 0889b6d247 (warc) Clean up parquet conversion
This commit further cleans up the warc->parquet conversion. It fixes issues with redirect handling in WarcRecorder, adds support information about redirects and errors due to probe failure.

It also refactors the fetch result, body extraction and content type abstractions.
2023-12-14 20:39:40 +01:00
..
src (warc) Clean up parquet conversion 2023-12-14 20:39:40 +01:00
build.gradle (warc) Clean up parquet conversion 2023-12-14 20:39:40 +01:00