91c7960800
This commit extracts several previously hardcoded configuration properties, and makes then available through system.properties. The documentation is updated to reflect the change. Dead code was also removed in the process. CrawlSpecGenerator is left feeling a bit over-engineered still, since it's built for a more general case, where all other implementations but the current one are removed, but we'll leave it like this for now as it's fairly readable still. |
||
|---|---|---|
| .. | ||
| crawl-spec | ||
| crawling-model | ||
| processed-data | ||
| work-log | ||