6 lines
199 B
Markdown
6 lines
199 B
Markdown
|
# Crawl Job Extractor
|
||
|
|
|
||
|
|
The crawl job extractor creates a file containing a list of domains
|
||
|
|
along with known URLs.
|
||
|
|
|
||
|
|
This is consumed by [processes/crawling-process](../../processes/crawling-process).
|