Viktor Lofgren
|
aa0d256d6a
|
Upgrade code to Java 20.
* Change language version
* Upgrade Lombok to a JDK20 compatible version
|
2023-08-23 13:37:49 +00:00 |
|
Viktor Lofgren
|
15912f31d0
|
(control-service) Basic GUI for deleting bad links from exploration mode
|
2023-08-21 18:35:26 +02:00 |
|
Viktor Lofgren
|
6cb784df75
|
(minor) Improve comment
|
2023-08-18 11:25:36 +02:00 |
|
Viktor Lofgren
|
c019a029ec
|
(flags) Documentation and preventative bugfix
|
2023-08-17 17:42:31 +02:00 |
|
Viktor Lofgren
|
46d761f34f
|
(language) fasttext based language filter
|
2023-08-16 15:48:12 +02:00 |
|
Viktor Lofgren
|
4598c7f40f
|
(valuation) Penalize wordpress style kebab case urls
|
2023-08-16 13:11:24 +02:00 |
|
Viktor Lofgren
|
e7192a9cad
|
(mq) Refactor mq and actor library and move it to libraries out of common
|
2023-08-15 10:53:23 +02:00 |
|
Viktor Lofgren
|
8210e49b4e
|
(control) Helpful tooltips for the Actor table.
|
2023-08-13 12:55:56 +02:00 |
|
Viktor Lofgren
|
d6b8b38955
|
(db) Add indices on SERVICE_EVENTLOG
|
2023-08-12 15:00:15 +02:00 |
|
Viktor Lofgren
|
6483308bb0
|
(sql) Update default value for DOMAIN_SELECTION_TYPE
|
2023-08-11 14:01:15 +02:00 |
|
Viktor Lofgren
|
7440da240d
|
(blacklist) Fix broken SQL migration
|
2023-08-11 13:33:35 +02:00 |
|
Viktor Lofgren
|
4f8048be31
|
(blacklist) Blacklist management
|
2023-08-10 15:40:07 +02:00 |
|
Viktor Lofgren
|
807fb2d052
|
(service) Task heartbeat creates event log entries
|
2023-08-09 15:15:16 +02:00 |
|
Viktor Lofgren
|
ce293029c7
|
(converter) Treat adtech tracking as advertisement.
|
2023-08-09 14:23:53 +02:00 |
|
Viktor Lofgren
|
b5ed21be21
|
(mq) MqPersistence no longer relies on autoCommit being enabled
|
2023-08-09 14:23:22 +02:00 |
|
Viktor Lofgren
|
251fc63b42
|
(*) Fix merge gore
|
2023-08-09 13:33:28 +02:00 |
|
Viktor Lofgren
|
afad4f5ebb
|
(*) last touches
|
2023-08-07 12:59:33 +02:00 |
|
Viktor Lofgren
|
4ab1cd9502
|
(*) last touches
|
2023-08-07 12:57:44 +02:00 |
|
Viktor
|
52e2ab45bf
|
Merge branch 'master' into master-control-program
|
2023-08-07 12:53:43 +02:00 |
|
Viktor Lofgren
|
715d61dfea
|
(mq) Fix bug in notice handling where they were registered on the wrong name
|
2023-08-05 14:45:04 +02:00 |
|
Viktor Lofgren
|
c2b45bec8d
|
(mq) Rename notify to sendNotice to avoid name clash with the java object function
|
2023-08-05 14:45:04 +02:00 |
|
Viktor Lofgren
|
cdfe284f9a
|
(file storage) File Storage Type for EXPORT data
(file storage) File Storage Type for EXPORT data
|
2023-08-05 14:45:03 +02:00 |
|
Viktor Lofgren
|
624b78ec3a
|
(heartbeat) Task heartbeats
|
2023-08-04 14:40:06 +02:00 |
|
Viktor Lofgren
|
f01f608474
|
(blacklist) Support blacklists with subdomain
|
2023-08-03 17:58:52 +02:00 |
|
Viktor Lofgren
|
659d2134ba
|
(file-storage) Deprecate mustClean flag
|
2023-08-01 22:32:30 +02:00 |
|
Viktor Lofgren
|
867410c66b
|
(file-storage) Automatic file storage discovery via manifest file
|
2023-08-01 18:05:43 +02:00 |
|
Viktor Lofgren
|
58556af6c7
|
(db) Use flwyay for database migrations.
|
2023-08-01 17:08:42 +02:00 |
|
Viktor Lofgren
|
2e29038ecd
|
(db) Fix broken insert statement, move file storage defaults to a separate file.
|
2023-08-01 15:50:08 +02:00 |
|
Viktor Lofgren
|
c1ea60b399
|
(db) Default values for storage base
|
2023-08-01 15:05:04 +02:00 |
|
Viktor Lofgren
|
2f8488610a
|
(loader) Fix bug where trailing deferred domain meta inserts weren't executed
|
2023-07-31 14:23:23 +02:00 |
|
Viktor Lofgren
|
d95f01b701
|
(control) Reduce log spam in control svc
|
2023-07-31 14:21:06 +02:00 |
|
Viktor Lofgren
|
c9d7635370
|
(control) Aborting an actor that waits on a process request terminates the running job.
(control) Aborting an actor that waits on a process request terminates the running job.
|
2023-07-31 14:21:06 +02:00 |
|
Viktor Lofgren
|
6b5fb0f841
|
(control) Disable the start button for actors that aren't directly initializable.
(control) Disable the start button for actors that aren't directly initializable.
|
2023-07-31 14:21:00 +02:00 |
|
Viktor Lofgren
|
5411950b87
|
(minor) Tidy up EdgeDomain class a bit, no functional difference
|
2023-07-31 10:31:29 +02:00 |
|
Viktor Lofgren
|
5c071ce4d3
|
(crawler) Clean up the code and remove unnecessary logging
|
2023-07-30 16:53:39 +02:00 |
|
Viktor Lofgren
|
866db6c63f
|
(control) Dialog for updating message state; clean up file view.
|
2023-07-28 22:02:05 +02:00 |
|
Viktor Lofgren
|
77d5e39fe0
|
Make processed data Serializable
|
2023-07-28 18:11:19 +02:00 |
|
Viktor Lofgren
|
27e781761d
|
(mq single shot inbox) Flag messages as OK if there is no recipient
|
2023-07-28 12:04:23 +02:00 |
|
Viktor Lofgren
|
92cac52813
|
(mq) Add indexes to MESSAGE_QUEUE
|
2023-07-28 12:03:51 +02:00 |
|
Viktor Lofgren
|
507f26ad47
|
(converter) Refactor converter to not keep instructions list in RAM.
(converter) Refactor converter to not keep instructions list in RAM.
(converter) Refactor converter to not keep instructions list in RAM.
|
2023-07-25 22:06:46 +02:00 |
|
Viktor Lofgren
|
09fd0a1d0e
|
(converter) Automatically clean stale file storage records if they disappear on disk
|
2023-07-24 17:04:42 +02:00 |
|
Viktor Lofgren
|
7470c170b1
|
(minor) EdgeUrl.parse() should deal with null
|
2023-07-24 15:06:57 +02:00 |
|
Viktor Lofgren
|
f91d92cccb
|
(crawler) WIP
|
2023-07-20 21:05:16 +02:00 |
|
Viktor Lofgren
|
08ca6399ec
|
(converter) WIP
|
2023-07-19 17:14:45 +02:00 |
|
Viktor Lofgren
|
c0b5ea0e7d
|
Revert "Less spammy default log settings"
This reverts commit f6e2216b87 .
|
2023-07-18 19:28:42 +02:00 |
|
Viktor Lofgren
|
f21a3983aa
|
Abortable processes
|
2023-07-18 18:40:12 +02:00 |
|
Viktor Lofgren
|
f6e2216b87
|
Less spammy default log settings
|
2023-07-17 21:42:13 +02:00 |
|
Viktor Lofgren
|
92ed513e4f
|
Less spammy default log settings
|
2023-07-17 21:41:56 +02:00 |
|
Viktor Lofgren
|
d7ab21fe34
|
(*) Refactor Control Service and processes
|
2023-07-17 21:20:31 +02:00 |
|
Viktor Lofgren
|
bca4bbb6c8
|
(*) Refactor MQ and MQSM
|
2023-07-17 13:57:32 +02:00 |
|