CatgirlIntelligenceAgency/run
2024-02-20 14:22:47 +01:00
..
dist (control, WIP) MQFSM and ProcessService are sitting in a tree 2023-07-11 17:08:43 +02:00
env (cleanup) Clean up code 2024-02-20 14:22:47 +01:00
install (refac) Zookeeper for service-discovery, kill service-client lib (WIP) 2024-02-20 11:41:14 +01:00
template/conf (*) Add single-node barebones configuration 2024-01-25 16:40:28 +01:00
test-data Make the code run properly without WMSA_HOME set, adding missing test assets. 2023-03-05 13:47:40 +01:00
.gitignore Restructuring the git repo 2023-03-04 13:19:01 +01:00
experiment-elsewhere.sh (screenshot-capture-tool) Make screenshot-capture-tool cooperate with docker 2023-11-01 16:38:55 +01:00
experiment.sh Fix experiment runner 2023-11-15 14:03:17 +01:00
install.sh Fix typo in install.sh 2024-01-25 17:08:18 +01:00
prometheus.yml (prometheus) Add in-docker prometheus instance to exfiltrate metrics from the docker-based services 2024-01-02 14:28:53 +01:00
readme.md (doc) Migrate documentation https://docs.marginalia.nu/ 2024-01-22 19:40:08 +01:00
setup.sh (control) UX-improvements for control service 2024-01-12 12:33:05 +01:00

Run

This directory is a staging area for running the system. It contains scripts and templates for installing the system on a server, and for running it locally.

See https://docs.marginalia.nu/ for additional documentation.

Requirements

Docker - It is a bit of a pain to install, but if you follow this guide you're on the right track for ubuntu-like systems.

JDK 21 - The code uses Java 21 preview features. The civilized way of installing this is to use SDKMAN; graalce is a good distribution choice but it doesn't matter too much.

Set up

To go from a clean check out of the git repo to a running search engine, follow these steps.

You're assumed to sit in the project root the whole time.

1. Run the one-time setup

It will create the basic runtime directory structure and download some models and data that doesn't come with the git repo because git deals poorly with large binary files.

$ run/setup.sh

2. Compile the project and build docker images

$ ./gradlew docker

3. Install the system

$ run/install.sh <install-directory>

To install the system, you need to run the install script. It will prompt you for which installation mode you want to use. The options are:

  1. Barebones - This will install a white-label search engine with no data. You can use this to index your own data. It disables and hides functionality that is strongly related to the Marginalia project, such as the Marginalia GUI.
  2. Full Marginalia Search instance - This will install an instance of the search engine configured like search.marginalia.nu. This is useful for local development and testing.

It will also prompt you for account details for a new mariadb instance, which will be created for you. The database will be initialized with the schema and data required for the search engine to run.

After filling out all the details, the script will copy the installation files to the specified directory.

4. Run the system

$ cd install_directory
$ docker-compose up -d 
# To see the logs: 
$ docker-compose logs -f

You can now access a search interface at http://localhost:8080, and the admin interface at http://localhost:8081/.

There is no data in the system yet. To load data into the system, see the guide at https://docs.marginalia.nu/.