5c040f7a46
* Crawl-specs are now parquet files * Deprecate the crawl-job-extractor tool |
||
---|---|---|
.. | ||
src/main/java/nu/marginalia/tools | ||
build.gradle | ||
readme.md |
Experiment Runner
This tool is a means of launching crawl data processing experiments, for interacting with crawl data.
It's launched with run/experiment.sh
. New experiments need to be added to
ExperimentRunnerMain
in order for the script to be able to run them.