4 Commits

Author	SHA1	Message	Date
Viktor Lofgren	4fc0ddbc45	Improved crawl-job-extractor. ... Let crawl-job-extractor run offline and allow it to read domains from file. Improved docs.	2023-06-20 11:37:52 +02:00
Viktor Lofgren	2afbdc2269	Adjust the logic for the crawl job extractor to set a relatively low visit limit for websites that are new in the index or has not yielded many good documents previously.	2023-06-07 22:01:35 +02:00
Viktor	ac1ac3ea57	Move database to a separate module ... * Move database to a separate project, break apart sql file into separate entities. * Fix front page news listing.	2023-03-25 15:26:17 +01:00
Viktor Lofgren	2eb972dea1	Remove unrelated code, break tools into their own directory.	2023-03-17 16:03:11 +01:00