161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
459 Commits 19 Branches 14 Tags 14 MiB
58cae7d963
Commit Graph

257 Commits

Author SHA1 Message Date
vlofgren
8139ab0d1d Refactoring BTreeReader and binary search code 2022-06-20 12:28:15 +02:00
vlofgren
b1eff0107c Refactoring BTreeReader and binary search code 2022-06-20 12:25:34 +02:00
vlofgren
c324c80efc Refactoring BTreeReader and binary search code 2022-06-20 12:04:06 +02:00
vlofgren
420b9bb7e0 Refactoring BTreeReader and binary search code 2022-06-20 12:02:01 +02:00
vlofgren
f76af4ca79 Refactoring conversion 2022-06-18 15:54:58 +02:00
vlofgren
2e55599850 Revert "Revert "Merge branch 'experimental' into master"" 
This reverts commit 81c77e7fcb.
 2022-06-16 14:09:57 +02:00
vlofgren
5ef953ae3d Fixing typo on front page. 2022-06-16 14:01:49 +02:00
vlofgren
81c77e7fcb Revert "Merge branch 'experimental' into master" 
This reverts commit c3a432fdd4, reversing
changes made to 1de63f225d.
 2022-06-15 16:49:18 +02:00
vlofgren
88908c203d Refactoring conversion 2022-06-15 16:34:03 +02:00
vlofgren
8ba80931a9 Restructuring index code: Move dictionary 2022-06-15 12:59:56 +02:00
vlofgren
89f894eae2 Merge branch 'master' into experimental 2022-06-14 17:55:36 +02:00
vlofgren
1de63f225d Added support for <base href>-style tags. 2022-06-14 17:55:14 +02:00
vlofgren
3e64003252 Re-add quality property to URLs 2022-06-09 22:19:29 +02:00
vlofgren
1ee0c2b572 Merge branch 'master' into experimental 2022-06-09 21:48:19 +02:00
vlofgren
389818c6c3 Make website url configurable for search engine redirects 2022-06-09 21:47:59 +02:00
vlofgren
65aee9419d Tidy up 2022-06-09 21:25:31 +02:00
vlofgren
495e6a1639 Use 64 bit path hash for EC_URL 2022-06-08 16:52:46 +02:00
vlofgren
2faaed3393 Fixed conversion bug SQL->EdgeDomainIndexingState 2022-06-08 16:52:33 +02:00
vlofgren
5e472fe121 WIP: Refactored ranking algorithms to separate database code from ranking code 2022-06-08 16:18:00 +02:00
vlofgren
026ba714b5 WIP: Database refactoring 2022-06-08 15:32:03 +02:00
vlofgren
c915664fcc WIP: Database refactoring 2022-06-07 22:34:53 +02:00
vlofgren
0e65384781 Make WMSA_HOME configurable through an environment variable. 2022-06-03 13:32:08 +02:00
vlofgren
d8d0c0e5b2 Make User-agent configurable. 2022-06-01 14:46:51 +02:00
vlofgren
80dad31753 Merge branch 'release' 
# Conflicts:
#	marginalia_nu/src/main/java/nu/marginalia/wmsa/edge/index/service/query/IndexSearchBudget.java
 2022-05-31 14:37:49 +02:00
vlofgren
c0e0579c8e Updated index.html for search engine to reflect changes in project status. 2022-05-31 14:35:05 +02:00
vlofgren
046b92e0bb Cleaning up index code 2022-05-31 14:35:05 +02:00
vlofgren
ab97044302 Fix deprecation warning for Bucket4J 2022-05-31 13:40:21 +02:00
Viktor Lofgren
9474f39225 Add time-based timeout to queries (#24) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/24
 2022-05-31 13:38:26 +02:00
vlofgren
ec87c0689f Added timeout to queries 2022-05-31 13:37:24 +02:00
Viktor Lofgren
fcd2708fe3 Memory alignment tweaks for better performance (#22) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/22
 2022-05-30 23:42:40 +02:00
vlofgren
fc070f2e0e Fixed memory alignment for MMFL 2022-05-30 23:41:16 +02:00
Viktor Lofgren
c7a095e497 Madvise tweaks (#21) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/21
 2022-05-30 23:22:05 +02:00
vlofgren
6894121859 Tweaked madvise for index to be faster 2022-05-30 23:19:55 +02:00
Viktor Lofgren
44bee371e6 Actually add the commit with the previously mentioned instrumetation (#18) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/18
 2022-05-30 21:12:15 +02:00
vlofgren
dc963d3e44 Added instrumentation for search queries 2022-05-30 21:11:19 +02:00
Viktor Lofgren
c201201c2d Instrumentation for search + index madvise tweaks (#17) 
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/17
 2022-05-30 21:02:53 +02:00
vlofgren
730e964475 Tweaked madvise for index to be faster 2022-05-30 21:01:58 +02:00
vlofgren
275e42197c Added rudimentary !bang-support 2022-05-30 17:26:51 +02:00
vlofgren
25776a9718 Refactored EdgeSearchService and broke functions like define:, browse:, site: etc. into separate classes. 2022-05-30 16:40:59 +02:00
vlofgren
41b686955f API-service was accidentally moved into a subdirectory of Auth 2022-05-30 12:46:30 +02:00
vlofgren
5a1ec53a84 WIP: Encyclopedia service 2022-05-28 14:35:32 +02:00
vlofgren
0acdd5b660 Switch to beefier docker image to fix 'Could not initialize class sun.awt.X11FontManager' for math rendering in Encyclopedia test. 2022-05-28 13:59:50 +02:00
vlofgren
ac9064096d Rewrote Encyclopedia loader, added functioning E2E test for new encyclopedia service 2022-05-28 13:51:29 +02:00
vlofgren
ad4521da9e WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant. 2022-05-28 00:16:31 +02:00
vlofgren
e7b4ac0d34 WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant. 2022-05-27 23:45:29 +02:00
vlofgren
61ef2b06b0 Move IP Location database out of classpath and into WMSA_HOME/data 2022-05-27 14:27:44 +02:00
vlofgren
056dec5506 Fixings 2022-05-27 13:50:06 +02:00
vlofgren
014a4c8076 Deleted old JMH benchmarks that weren't used for anything useful, fixed tests 2022-05-25 20:43:30 +02:00
vlofgren
ee6471dcaf Retired the Data-Store, Director and Crawler services 2022-05-25 20:38:57 +02:00
Viktor Lofgren
cd3cae0ad5 Create first E2E-test with TestContainers 2022-05-25 18:02:19 +02:00
vlofgren
b45f68fedd Fix build problems on jdk-18 machines 2022-05-21 15:14:47 +02:00
vlofgren
c4017c23ed Fixing some compiler warnings + a rotten test 2022-05-19 22:02:01 +02:00
vlofgren
ccc5a07081 Extracted ranking algorithms to separate directory and made them configurable 2022-05-19 19:13:41 +02:00
vlofgren
1012de3135 Moving tool class to tools dir 2022-05-19 18:30:57 +02:00
vlofgren
5c04c0843b Removing unnecessary files 2022-05-19 18:30:41 +02:00
vlofgren
74ae97f8f4 Added test util for the tests to remove hard coding of LanguageModels. 2022-05-19 18:05:10 +02:00
vlofgren
c24b978c51 first commit 2022-05-19 17:45:26 +02:00