Commit Graph

526 Commits

Author SHA1 Message Date
Viktor Lofgren
c6abbc12f6 fix serialization issue (#121)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/121
2022-10-22 15:01:41 +02:00
vlofgren
7a9490dbc4 fixing phantom merge conflicts 2022-10-22 15:00:32 +02:00
vlofgren
8f8e6e147f Fix JSON serialization error 2022-10-22 14:42:37 +02:00
vlofgren
e6da7c1a29 Tweaks for new release. 2022-10-21 17:44:29 +02:00
Viktor Lofgren
0a35a7c1d0 master (#119)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/119
2022-10-20 21:57:08 +02:00
Viktor Lofgren
f91a3b6491 Merge branch 'release' into master 2022-10-20 21:56:57 +02:00
vlofgren
5393167bf8 Fixes in sorting logic, and optimized update domain statistics to not take 4+ hours. 2022-10-20 21:55:51 +02:00
vlofgren
05762fe200 Index update. 2022-10-19 16:35:50 +02:00
Viktor Lofgren
df49ccbe59 October Release (#118)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/118
2022-10-19 15:00:04 +02:00
vlofgren
9a7d052c43 Adjustments to anchor tag extraction. 2022-09-18 10:59:16 +02:00
vlofgren
179d54d50a Processor fixes: Excluding phpinfo()-pages, mastodon feeds. 2022-09-16 18:05:54 +02:00
vlofgren
13c8305dc2 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:12:07 +02:00
vlofgren
324c05fc42 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:01:06 +02:00
vlofgren
123603b0a3 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:59:06 +02:00
vlofgren
5e67391829 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:52:33 +02:00
Viktor Lofgren
9f106e61ad Merge pull request 'Better index metrics, fix bug where domain result show up with advisory search terms.' (#117) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/117
2022-09-15 17:04:49 +02:00
Viktor Lofgren
debcd3857a Merge branch 'release' into master 2022-09-15 17:04:40 +02:00
vlofgren
23a7d91d5b Better index metrics, fix bug where domain result show up with advisory search terms. 2022-09-15 17:04:15 +02:00
Viktor Lofgren
ac7c1772de Merge pull request 'UX improvements for "show more results".' (#116) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/116
2022-09-15 15:57:15 +02:00
Viktor Lofgren
b69fddb9f0 Merge branch 'release' into master 2022-09-15 15:57:06 +02:00
vlofgren
9558077808 UX improvements for "show more results". 2022-09-15 15:56:20 +02:00
Viktor Lofgren
ba6519ef1d Merge pull request 'Advisory search terms' (#115) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/115
2022-09-14 16:32:06 +02:00
vlofgren
2e740bb7bd Add advisory search terms that do not affect ranking. 2022-09-14 16:31:37 +02:00
Viktor Lofgren
d8c98274f5 Merge branch 'release' into master 2022-09-14 16:31:01 +02:00
Viktor Lofgren
8e5806a85e Merge pull request 'Fix old broken domain search.' (#113) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/113
2022-09-13 20:58:19 +02:00
vlofgren
680693b6db Fix old broken domain search. 2022-09-13 20:57:04 +02:00
Viktor Lofgren
d81a0ad22c Merge pull request 'Tune query timeouts and fetch window to speed up queries a bit.' (#112) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/112
2022-09-13 18:50:46 +02:00
Viktor Lofgren
3d6285f824 Merge branch 'release' into master 2022-09-13 18:50:35 +02:00
vlofgren
8d15ddbab0 Tune query timeouts and fetch window to speed up queries a bit. 2022-09-13 18:50:04 +02:00
vlofgren
6df02f7528 HyperLogLog-tool for figuring out how big the index is. 2022-09-13 18:27:36 +02:00
Viktor Lofgren
8dc03f6b55 Merge pull request 'Fix a query variant creation bug that caused the search engine to sometimes drop important words from a query.' (#111) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/111
2022-09-12 23:33:57 +02:00
Viktor Lofgren
17226bc4fd Merge branch 'release' into master 2022-09-12 23:33:26 +02:00
vlofgren
10d1307dd6 Fix a query variant creation bug that caused the search engine to sometimes drop important words from a query. 2022-09-12 23:32:49 +02:00
Viktor Lofgren
4f3dcd037f Merge pull request 'Fixing a bug where search terms would sometimes be ignored, tweaking timeouts, adding debug feature for the search service.' (#110) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/110
2022-09-12 21:09:52 +02:00
Viktor Lofgren
8c24ac761a Merge branch 'release' into master 2022-09-12 21:09:41 +02:00
vlofgren
297f8e4cd7 Fixing a bug where search terms would sometimes be ignored, tweaking timeouts, adding debug feature for the search service. 2022-09-12 21:08:53 +02:00
Viktor Lofgren
afb0c78e4d Merge pull request 'Merge changes from experimental-22-08 into master' (#109) from master into release
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/109
2022-09-12 10:55:36 +02:00
Viktor Lofgren
73a5906c12 Merge branch 'release' into master 2022-09-12 10:55:24 +02:00
Viktor Lofgren
8dca582080 Merge pull request 'Merge experimental branch into master' (#108) from experimental-22-08 into master
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/108
2022-09-12 10:54:21 +02:00
Viktor Lofgren
0008c8b273 Merge branch 'master' into experimental-22-08 2022-09-12 10:54:11 +02:00
vlofgren
7749ce645a Further more cleaning 2022-09-12 10:39:02 +02:00
vlofgren
971089bad3 Cleaning up. 2022-09-11 11:58:39 +02:00
vlofgren
eaef93f4ae Cleaning up and adding better error messages. 2022-09-11 11:31:22 +02:00
vlofgren
fbe17b62ed Giga-refactor of the index query logic 2022-09-10 20:28:45 +02:00
vlofgren
c6976acdfc WIP Loading 2022-09-05 17:51:49 +02:00
vlofgren
c912d3127d Better hints. 2022-09-03 18:35:04 +02:00
vlofgren
2e3d95bcb1 Refactoring and cleanup 2022-09-03 17:32:53 +02:00
vlofgren
5a4d41d414 Refactoring and cleanup, WIP 2022-09-03 15:20:26 +02:00
vlofgren
26e0cfec3a Preparation for conversion 2022-09-02 17:45:03 +02:00
vlofgren
ccf79f47b0 Preparation for conversion 2022-09-02 14:51:11 +02:00