Viktor Lofgren
|
d6b8b38955
|
(db) Add indices on SERVICE_EVENTLOG
|
2023-08-12 15:00:15 +02:00 |
|
Viktor Lofgren
|
6483308bb0
|
(sql) Update default value for DOMAIN_SELECTION_TYPE
|
2023-08-11 14:01:15 +02:00 |
|
Viktor Lofgren
|
7440da240d
|
(blacklist) Fix broken SQL migration
|
2023-08-11 13:33:35 +02:00 |
|
Viktor Lofgren
|
4f8048be31
|
(blacklist) Blacklist management
|
2023-08-10 15:40:07 +02:00 |
|
Viktor Lofgren
|
251fc63b42
|
(*) Fix merge gore
|
2023-08-09 13:33:28 +02:00 |
|
Viktor Lofgren
|
afad4f5ebb
|
(*) last touches
|
2023-08-07 12:59:33 +02:00 |
|
Viktor
|
52e2ab45bf
|
Merge branch 'master' into master-control-program
|
2023-08-07 12:53:43 +02:00 |
|
Viktor Lofgren
|
cdfe284f9a
|
(file storage) File Storage Type for EXPORT data
(file storage) File Storage Type for EXPORT data
|
2023-08-05 14:45:03 +02:00 |
|
Viktor Lofgren
|
624b78ec3a
|
(heartbeat) Task heartbeats
|
2023-08-04 14:40:06 +02:00 |
|
Viktor Lofgren
|
f01f608474
|
(blacklist) Support blacklists with subdomain
|
2023-08-03 17:58:52 +02:00 |
|
Viktor Lofgren
|
659d2134ba
|
(file-storage) Deprecate mustClean flag
|
2023-08-01 22:32:30 +02:00 |
|
Viktor Lofgren
|
867410c66b
|
(file-storage) Automatic file storage discovery via manifest file
|
2023-08-01 18:05:43 +02:00 |
|
Viktor Lofgren
|
58556af6c7
|
(db) Use flwyay for database migrations.
|
2023-08-01 17:08:42 +02:00 |
|
Viktor Lofgren
|
2e29038ecd
|
(db) Fix broken insert statement, move file storage defaults to a separate file.
|
2023-08-01 15:50:08 +02:00 |
|
Viktor Lofgren
|
c1ea60b399
|
(db) Default values for storage base
|
2023-08-01 15:05:04 +02:00 |
|
Viktor Lofgren
|
92cac52813
|
(mq) Add indexes to MESSAGE_QUEUE
|
2023-07-28 12:03:51 +02:00 |
|
Viktor Lofgren
|
09fd0a1d0e
|
(converter) Automatically clean stale file storage records if they disappear on disk
|
2023-07-24 17:04:42 +02:00 |
|
Viktor Lofgren
|
f91d92cccb
|
(crawler) WIP
|
2023-07-20 21:05:16 +02:00 |
|
Viktor Lofgren
|
d7ab21fe34
|
(*) Refactor Control Service and processes
|
2023-07-17 21:20:31 +02:00 |
|
Viktor Lofgren
|
bca4bbb6c8
|
(*) Refactor MQ and MQSM
|
2023-07-17 13:57:32 +02:00 |
|
Viktor Lofgren
|
e618aa34e9
|
(control) Name change process->fsm, new fsm:s
* FSM for spawning processes when messages appear for them
* FSM for removing data flagged for purging
|
2023-07-17 12:27:27 +02:00 |
|
Viktor Lofgren
|
8b74e3aa0d
|
(*) File Storage WIP
|
2023-07-14 17:08:10 +02:00 |
|
Viktor Lofgren
|
23169ad818
|
(db) Model for file storage areas
|
2023-07-14 11:40:05 +02:00 |
|
Viktor Lofgren
|
6c88f00a9d
|
(mqsm) guard against spurious transitions from unexpected messages
|
2023-07-12 22:44:05 +02:00 |
|
Viktor Lofgren
|
4c016b0318
|
Process monitoring
* Also refactored the SQL tables a bit
|
2023-07-11 14:46:21 +02:00 |
|
Viktor
|
cbbf60a599
|
Better fingerprinting (#35)
* Better fingerprinting for server tech
* Many more features in FeatureExtractor
* Blog specialization
* SiteType table
|
2023-07-10 18:58:43 +02:00 |
|
Viktor
|
0f9b90eb1c
|
Better fingerprinting (#35)
* Better fingerprinting for server tech
* Many more features in FeatureExtractor
* Blog specialization
* SiteType table
|
2023-07-10 17:36:12 +02:00 |
|
Viktor Lofgren
|
31ae71c7d6
|
Message queue WIP
|
2023-07-04 14:28:14 +02:00 |
|
Viktor Lofgren
|
62cc9df206
|
Embryo of new control process
* New events and heartbeat tables in mariadb
* Refactored to a cleaner Service interface
|
2023-07-03 10:40:32 +02:00 |
|
Viktor Lofgren
|
8274e8a953
|
JVM flags for disabling black and block-lists.
|
2023-06-30 17:07:47 +02:00 |
|
Viktor Lofgren
|
a6a66c6d8a
|
Improve site info for unknown domains:
* Placeholder screenshot should work
* Add a link to git-repo for submitting the site for crawling
|
2023-06-27 15:32:11 +02:00 |
|
Viktor Lofgren
|
d42ab19166
|
Issue 5: Fix bug where some IPv6 addresses blew up domain loading.
|
2023-04-15 14:11:08 +02:00 |
|
Viktor Lofgren
|
c5f4cb34bf
|
Documentation for DB
|
2023-03-25 16:14:16 +01:00 |
|
Viktor
|
ac1ac3ea57
|
Move database to a separate module
* Move database to a separate project, break apart sql file into separate entities.
* Fix front page news listing.
|
2023-03-25 15:26:17 +01:00 |
|