161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
d82532b7f1
CatgirlIntelligenceAgency/code/processes/crawl-job-extractor-process
History
Viktor Lofgren d82532b7f1 More restructuring, big bug fixes in keyword extraction.
2023-03-13 17:39:53 +01:00
..
src More restructuring, big bug fixes in keyword extraction. 2023-03-13 17:39:53 +01:00
build.gradle More restructuring, big bug fixes in keyword extraction. 2023-03-13 17:39:53 +01:00
readme.md More restructuring, big bug fixes in keyword extraction. 2023-03-13 17:39:53 +01:00

readme.md

Crawl Job Extractor

The crawl job extractor creates a file containing a list of domains along with known URLs. This is consumed by the crawling-process.