vlofgren
|
f3be865293
|
Allow query params for *some* path,param combinations, targeted at allowing the crawl of forums.
|
2022-07-08 16:36:09 +02:00 |
|
vlofgren
|
93c274f1d4
|
E2E-test for memex
|
2022-07-08 12:34:31 +02:00 |
|
vlofgren
|
853108028e
|
WIP: Selective URL param strings
|
2022-07-04 14:47:16 +02:00 |
|
vlofgren
|
ee07c4d94a
|
Refactored s/DictionaryWriter/KeywordLexicon/g to use significantly less memory and (potentially) support UTF-8.
|
2022-06-26 16:44:08 +02:00 |
|
vlofgren
|
e1b3477115
|
Experiments in keyword extraction
|
2022-06-23 17:02:28 +02:00 |
|
vlofgren
|
4516b23f90
|
Also grab alt text for images in a-tags in anchor text extractor
|
2022-06-22 13:12:44 +02:00 |
|
vlofgren
|
48e4aa3ee8
|
Clean up old junk from the WordPatterns class
|
2022-06-22 13:01:46 +02:00 |
|
vlofgren
|
35878c5102
|
Anchor text capture work-in-progress
|
2022-06-22 12:57:58 +02:00 |
|
vlofgren
|
1068694db6
|
Refactoring BTreeReader and binary search code
|
2022-06-20 12:35:58 +02:00 |
|
vlofgren
|
8139ab0d1d
|
Refactoring BTreeReader and binary search code
|
2022-06-20 12:28:15 +02:00 |
|
vlofgren
|
b1eff0107c
|
Refactoring BTreeReader and binary search code
|
2022-06-20 12:25:34 +02:00 |
|
vlofgren
|
c324c80efc
|
Refactoring BTreeReader and binary search code
|
2022-06-20 12:04:06 +02:00 |
|
vlofgren
|
420b9bb7e0
|
Refactoring BTreeReader and binary search code
|
2022-06-20 12:02:01 +02:00 |
|
vlofgren
|
f76af4ca79
|
Refactoring conversion
|
2022-06-18 15:54:58 +02:00 |
|
vlofgren
|
2e55599850
|
Revert "Revert "Merge branch 'experimental' into master""
This reverts commit 81c77e7fcb.
|
2022-06-16 14:09:57 +02:00 |
|
vlofgren
|
5ef953ae3d
|
Fixing typo on front page.
|
2022-06-16 14:01:49 +02:00 |
|
vlofgren
|
81c77e7fcb
|
Revert "Merge branch 'experimental' into master"
This reverts commit c3a432fdd4, reversing
changes made to 1de63f225d.
|
2022-06-15 16:49:18 +02:00 |
|
vlofgren
|
88908c203d
|
Refactoring conversion
|
2022-06-15 16:34:03 +02:00 |
|
vlofgren
|
8ba80931a9
|
Restructuring index code: Move dictionary
|
2022-06-15 12:59:56 +02:00 |
|
vlofgren
|
89f894eae2
|
Merge branch 'master' into experimental
|
2022-06-14 17:55:36 +02:00 |
|
vlofgren
|
1de63f225d
|
Added support for <base href>-style tags.
|
2022-06-14 17:55:14 +02:00 |
|
vlofgren
|
3e64003252
|
Re-add quality property to URLs
|
2022-06-09 22:19:29 +02:00 |
|
vlofgren
|
1ee0c2b572
|
Merge branch 'master' into experimental
|
2022-06-09 21:48:19 +02:00 |
|
vlofgren
|
389818c6c3
|
Make website url configurable for search engine redirects
|
2022-06-09 21:47:59 +02:00 |
|
vlofgren
|
65aee9419d
|
Tidy up
|
2022-06-09 21:25:31 +02:00 |
|
vlofgren
|
495e6a1639
|
Use 64 bit path hash for EC_URL
|
2022-06-08 16:52:46 +02:00 |
|
vlofgren
|
2faaed3393
|
Fixed conversion bug SQL->EdgeDomainIndexingState
|
2022-06-08 16:52:33 +02:00 |
|
vlofgren
|
5e472fe121
|
WIP: Refactored ranking algorithms to separate database code from ranking code
|
2022-06-08 16:18:00 +02:00 |
|
vlofgren
|
026ba714b5
|
WIP: Database refactoring
|
2022-06-08 15:32:03 +02:00 |
|
vlofgren
|
c915664fcc
|
WIP: Database refactoring
|
2022-06-07 22:34:53 +02:00 |
|
vlofgren
|
0e65384781
|
Make WMSA_HOME configurable through an environment variable.
|
2022-06-03 13:32:08 +02:00 |
|
vlofgren
|
d8d0c0e5b2
|
Make User-agent configurable.
|
2022-06-01 14:46:51 +02:00 |
|
vlofgren
|
80dad31753
|
Merge branch 'release'
# Conflicts:
# marginalia_nu/src/main/java/nu/marginalia/wmsa/edge/index/service/query/IndexSearchBudget.java
|
2022-05-31 14:37:49 +02:00 |
|
vlofgren
|
c0e0579c8e
|
Updated index.html for search engine to reflect changes in project status.
|
2022-05-31 14:35:05 +02:00 |
|
vlofgren
|
046b92e0bb
|
Cleaning up index code
|
2022-05-31 14:35:05 +02:00 |
|
vlofgren
|
ab97044302
|
Fix deprecation warning for Bucket4J
|
2022-05-31 13:40:21 +02:00 |
|
Viktor Lofgren
|
9474f39225
|
Add time-based timeout to queries (#24)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/24
|
2022-05-31 13:38:26 +02:00 |
|
vlofgren
|
ec87c0689f
|
Added timeout to queries
|
2022-05-31 13:37:24 +02:00 |
|
Viktor Lofgren
|
fcd2708fe3
|
Memory alignment tweaks for better performance (#22)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/22
|
2022-05-30 23:42:40 +02:00 |
|
vlofgren
|
fc070f2e0e
|
Fixed memory alignment for MMFL
|
2022-05-30 23:41:16 +02:00 |
|
Viktor Lofgren
|
c7a095e497
|
Madvise tweaks (#21)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/21
|
2022-05-30 23:22:05 +02:00 |
|
vlofgren
|
6894121859
|
Tweaked madvise for index to be faster
|
2022-05-30 23:19:55 +02:00 |
|
Viktor Lofgren
|
44bee371e6
|
Actually add the commit with the previously mentioned instrumetation (#18)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/18
|
2022-05-30 21:12:15 +02:00 |
|
vlofgren
|
dc963d3e44
|
Added instrumentation for search queries
|
2022-05-30 21:11:19 +02:00 |
|
Viktor Lofgren
|
c201201c2d
|
Instrumentation for search + index madvise tweaks (#17)
Co-authored-by: vlofgren <vlofgren@gmail.com>
Reviewed-on: https://git.marginalia.nu/marginalia/marginalia.nu/pulls/17
|
2022-05-30 21:02:53 +02:00 |
|
vlofgren
|
730e964475
|
Tweaked madvise for index to be faster
|
2022-05-30 21:01:58 +02:00 |
|
vlofgren
|
275e42197c
|
Added rudimentary !bang-support
|
2022-05-30 17:26:51 +02:00 |
|
vlofgren
|
25776a9718
|
Refactored EdgeSearchService and broke functions like define:, browse:, site: etc. into separate classes.
|
2022-05-30 16:40:59 +02:00 |
|
vlofgren
|
41b686955f
|
API-service was accidentally moved into a subdirectory of Auth
|
2022-05-30 12:46:30 +02:00 |
|
vlofgren
|
5a1ec53a84
|
WIP: Encyclopedia service
|
2022-05-28 14:35:32 +02:00 |
|
vlofgren
|
0acdd5b660
|
Switch to beefier docker image to fix 'Could not initialize class sun.awt.X11FontManager' for math rendering in Encyclopedia test.
|
2022-05-28 13:59:50 +02:00 |
|
vlofgren
|
ac9064096d
|
Rewrote Encyclopedia loader, added functioning E2E test for new encyclopedia service
|
2022-05-28 13:51:29 +02:00 |
|
vlofgren
|
ad4521da9e
|
WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant.
|
2022-05-28 00:16:31 +02:00 |
|
vlofgren
|
e7b4ac0d34
|
WIP: Killing off Archive service, adding new Encyclopedia service consisting largely of what Archive was and a few features from Assistant.
|
2022-05-27 23:45:29 +02:00 |
|
vlofgren
|
61ef2b06b0
|
Move IP Location database out of classpath and into WMSA_HOME/data
|
2022-05-27 14:27:44 +02:00 |
|
vlofgren
|
056dec5506
|
Fixings
|
2022-05-27 13:50:06 +02:00 |
|
vlofgren
|
014a4c8076
|
Deleted old JMH benchmarks that weren't used for anything useful, fixed tests
|
2022-05-25 20:43:30 +02:00 |
|
vlofgren
|
ee6471dcaf
|
Retired the Data-Store, Director and Crawler services
|
2022-05-25 20:38:57 +02:00 |
|
Viktor Lofgren
|
cd3cae0ad5
|
Create first E2E-test with TestContainers
|
2022-05-25 18:02:19 +02:00 |
|
vlofgren
|
b45f68fedd
|
Fix build problems on jdk-18 machines
|
2022-05-21 15:14:47 +02:00 |
|
vlofgren
|
c4017c23ed
|
Fixing some compiler warnings + a rotten test
|
2022-05-19 22:02:01 +02:00 |
|
vlofgren
|
ccc5a07081
|
Extracted ranking algorithms to separate directory and made them configurable
|
2022-05-19 19:13:41 +02:00 |
|
vlofgren
|
1012de3135
|
Moving tool class to tools dir
|
2022-05-19 18:30:57 +02:00 |
|
vlofgren
|
5c04c0843b
|
Removing unnecessary files
|
2022-05-19 18:30:41 +02:00 |
|
vlofgren
|
74ae97f8f4
|
Added test util for the tests to remove hard coding of LanguageModels.
|
2022-05-19 18:05:10 +02:00 |
|
vlofgren
|
c24b978c51
|
first commit
|
2022-05-19 17:45:26 +02:00 |
|