Commit Graph

151 Commits

Author SHA1 Message Date
vlofgren
5ef953ae3d Fixing typo on front page. 2022-06-16 14:01:49 +02:00
vlofgren
81c77e7fcb Revert "Merge branch 'experimental' into master"
This reverts commit c3a432fdd4, reversing
changes made to 1de63f225d.
2022-06-15 16:49:18 +02:00
vlofgren
88908c203d Refactoring conversion 2022-06-15 16:34:03 +02:00
vlofgren
8ba80931a9 Restructuring index code: Move dictionary 2022-06-15 12:59:56 +02:00
vlofgren
89f894eae2 Merge branch 'master' into experimental 2022-06-14 17:55:36 +02:00
vlofgren
1de63f225d Added support for <base href>-style tags. 2022-06-14 17:55:14 +02:00
vlofgren
3e64003252 Re-add quality property to URLs 2022-06-09 22:19:29 +02:00
vlofgren
1ee0c2b572 Merge branch 'master' into experimental 2022-06-09 21:48:19 +02:00
vlofgren
389818c6c3 Make website url configurable for search engine redirects 2022-06-09 21:47:59 +02:00
vlofgren
65aee9419d Tidy up 2022-06-09 21:25:31 +02:00
vlofgren
495e6a1639 Use 64 bit path hash for EC_URL 2022-06-08 16:52:46 +02:00
vlofgren
2faaed3393 Fixed conversion bug SQL->EdgeDomainIndexingState 2022-06-08 16:52:33 +02:00
vlofgren
5e472fe121 WIP: Refactored ranking algorithms to separate database code from ranking code 2022-06-08 16:18:00 +02:00
vlofgren
026ba714b5 WIP: Database refactoring 2022-06-08 15:32:03 +02:00
vlofgren
c915664fcc WIP: Database refactoring 2022-06-07 22:34:53 +02:00
vlofgren
0e65384781 Make WMSA_HOME configurable through an environment variable. 2022-06-03 13:32:08 +02:00
vlofgren
d8d0c0e5b2 Make User-agent configurable. 2022-06-01 14:46:51 +02:00
vlofgren
80dad31753 Merge branch 'release'
# Conflicts:
#	marginalia_nu/src/main/java/nu/marginalia/wmsa/edge/index/service/query/IndexSearchBudget.java
2022-05-31 14:37:49 +02:00
vlofgren
c0e0579c8e Updated index.html for search engine to reflect changes in project status. 2022-05-31 14:35:05 +02:00
vlofgren
046b92e0bb Cleaning up index code 2022-05-31 14:35:05 +02:00
vlofgren
ab97044302 Fix deprecation warning for Bucket4J 2022-05-31 13:40:21 +02:00
Viktor Lofgren
9474f39225 Add time-based timeout to queries (#24)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/24
2022-05-31 13:38:26 +02:00
vlofgren
ec87c0689f Added timeout to queries 2022-05-31 13:37:24 +02:00
Viktor Lofgren
fcd2708fe3 Memory alignment tweaks for better performance (#22)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/22
2022-05-30 23:42:40 +02:00
vlofgren
fc070f2e0e Fixed memory alignment for MMFL 2022-05-30 23:41:16 +02:00
Viktor Lofgren
c7a095e497 Madvise tweaks (#21)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/21
2022-05-30 23:22:05 +02:00
vlofgren
6894121859 Tweaked madvise for index to be faster 2022-05-30 23:19:55 +02:00
Viktor Lofgren
44bee371e6 Actually add the commit with the previously mentioned instrumetation (#18)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/18
2022-05-30 21:12:15 +02:00
vlofgren
dc963d3e44 Added instrumentation for search queries 2022-05-30 21:11:19 +02:00
Viktor Lofgren
c201201c2d Instrumentation for search + index madvise tweaks (#17)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/17
2022-05-30 21:02:53 +02:00
vlofgren
730e964475 Tweaked madvise for index to be faster 2022-05-30 21:01:58 +02:00
vlofgren
275e42197c Added rudimentary !bang-support 2022-05-30 17:26:51 +02:00
vlofgren
25776a9718 Refactored EdgeSearchService and broke functions like define:, browse:, site: etc. into separate classes. 2022-05-30 16:40:59 +02:00
vlofgren
41b686955f API-service was accidentally moved into a subdirectory of Auth 2022-05-30 12:46:30 +02:00
vlofgren
5a1ec53a84 WIP: Encyclopedia service 2022-05-28 14:35:32 +02:00
vlofgren
0acdd5b660 Switch to beefier docker image to fix 'Could not initialize class sun.awt.X11FontManager' for math rendering in Encyclopedia test. 2022-05-28 13:59:50 +02:00
vlofgren
ac9064096d Rewrote Encyclopedia loader, added functioning E2E test for new encyclopedia service 2022-05-28 13:51:29 +02:00
vlofgren
ad4521da9e WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant. 2022-05-28 00:16:31 +02:00
vlofgren
e7b4ac0d34 WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant. 2022-05-27 23:45:29 +02:00
vlofgren
61ef2b06b0 Move IP Location database out of classpath and into WMSA_HOME/data 2022-05-27 14:27:44 +02:00
vlofgren
056dec5506 Fixings 2022-05-27 13:50:06 +02:00
vlofgren
014a4c8076 Deleted old JMH benchmarks that weren't used for anything useful, fixed tests 2022-05-25 20:43:30 +02:00
vlofgren
ee6471dcaf Retired the Data-Store, Director and Crawler services 2022-05-25 20:38:57 +02:00
Viktor Lofgren
cd3cae0ad5 Create first E2E-test with TestContainers 2022-05-25 18:02:19 +02:00
vlofgren
b45f68fedd Fix build problems on jdk-18 machines 2022-05-21 15:14:47 +02:00
vlofgren
c4017c23ed Fixing some compiler warnings + a rotten test 2022-05-19 22:02:01 +02:00
vlofgren
ccc5a07081 Extracted ranking algorithms to separate directory and made them configurable 2022-05-19 19:13:41 +02:00
vlofgren
1012de3135 Moving tool class to tools dir 2022-05-19 18:30:57 +02:00
vlofgren
5c04c0843b Removing unnecessary files 2022-05-19 18:30:41 +02:00
vlofgren
74ae97f8f4 Added test util for the tests to remove hard coding of LanguageModels. 2022-05-19 18:05:10 +02:00
vlofgren
c24b978c51 first commit 2022-05-19 17:45:26 +02:00