161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,145 Commits 19 Branches 14 Tags 14 MiB
13ee31770a
Commit Graph

1145 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Viktor Lofgren
655504c1f0 Hotfix for NaN-serialization bug in API service. 2022-11-06 12:12:10 +01:00
Viktor Lofgren
fd18240ec7 Fetch more browse:domain-results. (#126) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/126
 2022-10-30 11:33:45 +01:00
vlofgren
27893b414b Merge branch 'release' 
# Conflicts:
#	marginalia_nu/src/main/java/nu/marginalia/wmsa/edge/search/command/commands/BrowseCommand.java
 2022-10-30 11:33:06 +01:00
vlofgren
e7623010db Fetch more browse:domain-results. 2022-10-30 11:30:11 +01:00
Viktor Lofgren
395da07abe Sort browse:-results by relatedness if possible (#125) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/125
 2022-10-30 10:56:01 +01:00
vlofgren
d329106450 Merge remote-tracking branch 'origin/release' 2022-10-30 10:54:17 +01:00
vlofgren
b97f425f7e Sort results by relatedness where possible. 2022-10-30 10:49:41 +01:00
Viktor Lofgren
c559611185 Prefer cosine similarity relatedness for browse:-queries. (#123) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/123
 2022-10-30 10:32:33 +01:00
Viktor Lofgren
4a296f70e1 Merge branch 'release' into master 2022-10-30 10:32:24 +01:00
vlofgren
6231f525fd Prefer cosine similarity relatedness for browse:-queries. 2022-10-30 10:31:37 +01:00
Viktor Lofgren
e676d8729e GUI fixes and cleanups (#122) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/122
 2022-10-30 10:08:19 +01:00
Viktor Lofgren
c19ebe71ee Merge branch 'release' into master 2022-10-30 10:08:10 +01:00
vlofgren
61a80b417b Fix for explore2.marginalia.nu where it wouldn't find some websites that were flagged as redirects. 2022-10-30 10:05:52 +01:00
vlofgren
cc5b425661 Add another w3m-helper bar to make the UI cleaner on terminal. 2022-10-30 09:56:37 +01:00
vlofgren
217584126c Improved publishing date heuristics 2022-10-29 11:20:01 +02:00
vlofgren
68cde1c3d8 contributing file 2022-10-27 19:16:35 +02:00
vlofgren
68ec3304a3 Update index 2022-10-27 19:16:35 +02:00
vlofgren
af8001d41e Less janky summary extraction 2022-10-27 19:16:35 +02:00
vlofgren
94c157c5c3 Publish-date guesser 2022-10-27 19:16:35 +02:00
Viktor Lofgren
c6abbc12f6 fix serialization issue (#121) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/121
 2022-10-22 15:01:41 +02:00
vlofgren
7a9490dbc4 fixing phantom merge conflicts 2022-10-22 15:00:32 +02:00
vlofgren
8f8e6e147f Fix JSON serialization error 2022-10-22 14:42:37 +02:00
vlofgren
e6da7c1a29 Tweaks for new release. 2022-10-21 17:44:29 +02:00
Viktor Lofgren
0a35a7c1d0 master (#119) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/119
 2022-10-20 21:57:08 +02:00
Viktor Lofgren
f91a3b6491 Merge branch 'release' into master 2022-10-20 21:56:57 +02:00
vlofgren
5393167bf8 Fixes in sorting logic, and optimized update domain statistics to not take 4+ hours. 2022-10-20 21:55:51 +02:00
vlofgren
05762fe200 Index update. 2022-10-19 16:35:50 +02:00
Viktor Lofgren
df49ccbe59 October Release (#118) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Co-authored-by: vlofgren <vlofgren@marginalia.nu>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/118
 2022-10-19 15:00:04 +02:00
vlofgren
9a7d052c43 Adjustments to anchor tag extraction. 2022-09-18 10:59:16 +02:00
vlofgren
179d54d50a Processor fixes: Excluding phpinfo()-pages, mastodon feeds. 2022-09-16 18:05:54 +02:00
vlofgren
13c8305dc2 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:12:07 +02:00
vlofgren
324c05fc42 Exclude some guaranteed-to-be-noncanonical forum URLs. 2022-09-16 17:01:06 +02:00
vlofgren
123603b0a3 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:59:06 +02:00
vlofgren
5e67391829 Some small crawler tweaks, plus a test for examining crawler behavior through a simulated server. 2022-09-16 16:52:33 +02:00
Viktor Lofgren
9f106e61ad Merge pull request 'Better index metrics, fix bug where domain result show up with advisory search terms.' (#117) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/117
 2022-09-15 17:04:49 +02:00
Viktor Lofgren
debcd3857a Merge branch 'release' into master 2022-09-15 17:04:40 +02:00
vlofgren
23a7d91d5b Better index metrics, fix bug where domain result show up with advisory search terms. 2022-09-15 17:04:15 +02:00
Viktor Lofgren
ac7c1772de Merge pull request 'UX improvements for "show more results".' (#116) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/116
 2022-09-15 15:57:15 +02:00
Viktor Lofgren
b69fddb9f0 Merge branch 'release' into master 2022-09-15 15:57:06 +02:00
vlofgren
9558077808 UX improvements for "show more results". 2022-09-15 15:56:20 +02:00
Viktor Lofgren
ba6519ef1d Merge pull request 'Advisory search terms' (#115) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/115
 2022-09-14 16:32:06 +02:00
vlofgren
2e740bb7bd Add advisory search terms that do not affect ranking. 2022-09-14 16:31:37 +02:00
Viktor Lofgren
d8c98274f5 Merge branch 'release' into master 2022-09-14 16:31:01 +02:00
Viktor Lofgren
8e5806a85e Merge pull request 'Fix old broken domain search.' (#113) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/113
 2022-09-13 20:58:19 +02:00
vlofgren
680693b6db Fix old broken domain search. 2022-09-13 20:57:04 +02:00
Viktor Lofgren
d81a0ad22c Merge pull request 'Tune query timeouts and fetch window to speed up queries a bit.' (#112) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/112
 2022-09-13 18:50:46 +02:00
Viktor Lofgren
3d6285f824 Merge branch 'release' into master 2022-09-13 18:50:35 +02:00
vlofgren
8d15ddbab0 Tune query timeouts and fetch window to speed up queries a bit. 2022-09-13 18:50:04 +02:00
vlofgren
6df02f7528 HyperLogLog-tool for figuring out how big the index is. 2022-09-13 18:27:36 +02:00
Viktor Lofgren
8dc03f6b55 Merge pull request 'Fix a query variant creation bug that caused the search engine to sometimes drop important words from a query.' (#111) from master into release 
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/111
 2022-09-12 23:33:57 +02:00