4 Commits

Author	SHA1	Message	Date
Viktor Lofgren	42375f0e53	Specialization for javadocs	2023-07-01 20:16:56 +02:00
Viktor Lofgren	a000256223	Add generator fingerprint for xenforo. ... Also clean up the specializations logic a bit, and add a barebones specialization for phpbb that cleans out paths we aren't interested in but doesn't touch pruning or summarizing logic for now.	2023-07-01 14:43:49 +02:00
Viktor Lofgren	f8f9f04158	Specialized logic for processing Lemmy-based websites.	2023-06-27 10:57:54 +02:00
Viktor Lofgren	e7af77e151	Tests for crawler specialization + testdata	2023-06-27 10:57:54 +02:00