161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
734 Commits 19 Branches 14 Tags 14 MiB
6fae51a8ef
Commit Graph

734 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Viktor Lofgren
c19ebe71ee Merge branch 'release' into master 2022-10-30 10:08:10 +01:00
vlofgren
61a80b417b Fix for explore2.marginalia.nu where it wouldn't find some websites that were flagged as redirects. 2022-10-30 10:05:52 +01:00
vlofgren
cc5b425661 Add another w3m-helper bar to make the UI cleaner on terminal. 2022-10-30 09:56:37 +01:00
vlofgren
217584126c Improved publishing date heuristics 2022-10-29 11:20:01 +02:00
vlofgren
68cde1c3d8 contributing file 2022-10-27 19:16:35 +02:00
vlofgren
68ec3304a3 Update index 2022-10-27 19:16:35 +02:00
vlofgren
af8001d41e Less janky summary extraction 2022-10-27 19:16:35 +02:00
vlofgren
94c157c5c3 Publish-date guesser 2022-10-27 19:16:35 +02:00
Viktor Lofgren
c6abbc12f6 fix serialization issue (#121) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/121
 2022-10-22 15:01:41 +02:00
vlofgren
7a9490dbc4 fixing phantom merge conflicts 2022-10-22 15:00:32 +02:00
vlofgren
8f8e6e147f Fix JSON serialization error 2022-10-22 14:42:37 +02:00
vlofgren
e6da7c1a29 Tweaks for new release. 2022-10-21 17:44:29 +02:00
Viktor Lofgren
0a35a7c1d0 master (#119) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/119
 2022-10-20 21:57:08 +02:00
Viktor Lofgren
f91a3b6491 Merge branch 'release' into master 2022-10-20 21:56:57 +02:00
vlofgren
5393167bf8 Fixes in sorting logic, and optimized update domain statistics to not take 4+ hours. 2022-10-20 21:55:51 +02:00
vlofgren
05762fe200 Index update. 2022-10-19 16:35:50 +02:00
Viktor Lofgren
df49ccbe59 October Release (#118) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/118
 2022-10-19 15:00:04 +02:00
vlofgren
9a7d052c43 Adjustments to anchor tag extraction. 2022-09-18 10:59:16 +02:00
vlofgren
179d54d50a Processor fixes: Excluding phpinfo()-pages, mastodon feeds. 2022-09-16 18:05:54 +02:00
vlofgren
13c8305dc2 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:12:07 +02:00
vlofgren
324c05fc42 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:01:06 +02:00
vlofgren
123603b0a3 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:59:06 +02:00
vlofgren
5e67391829 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:52:33 +02:00
Viktor Lofgren
9f106e61ad Merge pull request 'Better index metrics, fix bug where domain result show up with advisory search terms.' (#117) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/117
 2022-09-15 17:04:49 +02:00
Viktor Lofgren
debcd3857a Merge branch 'release' into master 2022-09-15 17:04:40 +02:00
vlofgren
23a7d91d5b Better index metrics, fix bug where domain result show up with advisory search terms. 2022-09-15 17:04:15 +02:00
Viktor Lofgren
ac7c1772de Merge pull request 'UX improvements for "show more results".' (#116) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/116
 2022-09-15 15:57:15 +02:00
Viktor Lofgren
b69fddb9f0 Merge branch 'release' into master 2022-09-15 15:57:06 +02:00
vlofgren
9558077808 UX improvements for "show more results". 2022-09-15 15:56:20 +02:00
Viktor Lofgren
ba6519ef1d Merge pull request 'Advisory search terms' (#115) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/115
 2022-09-14 16:32:06 +02:00
vlofgren
2e740bb7bd Add advisory search terms that do not affect ranking. 2022-09-14 16:31:37 +02:00
Viktor Lofgren
d8c98274f5 Merge branch 'release' into master 2022-09-14 16:31:01 +02:00
Viktor Lofgren
8e5806a85e Merge pull request 'Fix old broken domain search.' (#113) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/113
 2022-09-13 20:58:19 +02:00
vlofgren
680693b6db Fix old broken domain search. 2022-09-13 20:57:04 +02:00
Viktor Lofgren
d81a0ad22c Merge pull request 'Tune query timeouts and fetch window to speed up queries a bit.' (#112) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/112
 2022-09-13 18:50:46 +02:00
Viktor Lofgren
3d6285f824 Merge branch 'release' into master 2022-09-13 18:50:35 +02:00
vlofgren
8d15ddbab0 Tune query timeouts and fetch window to speed up queries a bit. 2022-09-13 18:50:04 +02:00
vlofgren
6df02f7528 HyperLogLog-tool for figuring out how big the index is. 2022-09-13 18:27:36 +02:00
Viktor Lofgren
8dc03f6b55 Merge pull request 'Fix a query variant creation bug that caused the search engine to sometimes drop important words from a query.' (#111) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/111
 2022-09-12 23:33:57 +02:00
Viktor Lofgren
17226bc4fd Merge branch 'release' into master 2022-09-12 23:33:26 +02:00
vlofgren
10d1307dd6 Fix a query variant creation bug that caused the search engine to sometimes drop important words from a query. 2022-09-12 23:32:49 +02:00
Viktor Lofgren
4f3dcd037f Merge pull request 'Fixing a bug where search terms would sometimes be ignored, tweaking timeouts, adding debug feature for the search service.' (#110) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/110
 2022-09-12 21:09:52 +02:00
Viktor Lofgren
8c24ac761a Merge branch 'release' into master 2022-09-12 21:09:41 +02:00
vlofgren
297f8e4cd7 Fixing a bug where search terms would sometimes be ignored, tweaking timeouts, adding debug feature for the search service. 2022-09-12 21:08:53 +02:00
Viktor Lofgren
afb0c78e4d Merge pull request 'Merge changes from experimental-22-08 into master' (#109) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/109
 2022-09-12 10:55:36 +02:00
Viktor Lofgren
73a5906c12 Merge branch 'release' into master 2022-09-12 10:55:24 +02:00
Viktor Lofgren
8dca582080 Merge pull request 'Merge experimental branch into master' (#108) from experimental-22-08 into master 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/108
 2022-09-12 10:54:21 +02:00
Viktor Lofgren
0008c8b273 Merge branch 'master' into experimental-22-08 2022-09-12 10:54:11 +02:00
vlofgren
7749ce645a Further more cleaning 2022-09-12 10:39:02 +02:00
vlofgren
971089bad3 Cleaning up. 2022-09-11 11:58:39 +02:00