CatgirlIntelligenceAgency/code/tools/experiment-runner
Viktor Lofgren 5c040f7a46 (crawl-spec) Parquetify crawl spec
* Crawl-specs are now parquet files
* Deprecate the crawl-job-extractor tool
2023-09-17 09:41:34 +02:00
..
src/main/java/nu/marginalia/tools (crawl-spec) Parquetify crawl spec 2023-09-17 09:41:34 +02:00
build.gradle (refactor) Remove converting-model package completely 2023-09-14 11:21:44 +02:00
readme.md Add experiment runner tool and got rid of experiments module in processes. 2023-03-28 16:58:46 +02:00

Experiment Runner

This tool is a means of launching crawl data processing experiments, for interacting with crawl data.

It's launched with run/experiment.sh. New experiments need to be added to ExperimentRunnerMain in order for the script to be able to run them.