CatgirlIntelligenceAgency/code/features-crawl
Viktor Lofgren c41e68aaab (control) New export actions for RSS/Atom feeds and term frequency data
This commit also refactors the executor a bit, and introduces a new converter-feature called data-extractors for this class of jobs.
2024-01-15 14:54:26 +01:00
..
content-type (converter) Fix NPEs in converter due to the new data format 2023-12-28 22:54:53 +01:00
crawl-blocklist (*) Overhaul settings and properties 2024-01-13 17:12:18 +01:00
link-parser (control) New export actions for RSS/Atom feeds and term frequency data 2024-01-15 14:54:26 +01:00
readme.md Yet more restructuring. Improved search result ranking. 2023-03-16 21:35:54 +01:00

Crawl Features

These are bits of search-engine related code that are relatively isolated pieces of business logic, that benefit from the clarity of being kept separate from the rest of the crawling code.