6 lines
199 B
Markdown
6 lines
199 B
Markdown
# Crawl Job Extractor
|
|
|
|
The crawl job extractor creates a file containing a list of domains
|
|
along with known URLs.
|
|
|
|
This is consumed by [processes/crawling-process](../../processes/crawling-process). |