161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
f9320995d6
CatgirlIntelligenceAgency/docker-compose.yml

294 lines
8.4 KiB
YAML
Raw Normal View History

Restructuring the git repo
2023-03-04 13:19:01 +01:00
x-svc: &service
env_file:
Move env into run for clarity
2023-03-04 14:24:38 +01:00
- "run/env/service.env"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
volumes:
- conf:/wmsa/conf:ro
- model:/wmsa/model
Fix typeahead suggestions
2023-03-25 10:20:44 +01:00
- data:/wmsa/data
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
- logs:/var/log/wmsa
networks:
- wmsa
(prometheus) Add in-docker prometheus instance to exfiltrate metrics from the docker-based services
2024-01-01 17:16:29 +01:00
labels:
- "__meta_docker_port_private=7000"
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
x-p1: &partition-1
env_file:
- "run/env/service.env"
volumes:
- conf:/wmsa/conf:ro
- model:/wmsa/model
- data:/wmsa/data
Restructuring the git repo
2023-03-04 13:19:01 +01:00
- logs:/var/log/wmsa
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
- index-1:/idx
- work-1:/work
- backup-1:/backup
- samples-1:/storage
Restructuring the git repo
2023-03-04 13:19:01 +01:00
networks:
- wmsa
depends_on:
- mariadb
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
environment:
- "WMSA_SERVICE_NODE=1"
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
x-p2: &partition-2
env_file:
- "run/env/service.env"
volumes:
- conf:/wmsa/conf:ro
- model:/wmsa/model
- data:/wmsa/data
- logs:/var/log/wmsa
- index-2:/idx
- work-2:/work
- backup-2:/backup
- samples-2:/storage
networks:
- wmsa
depends_on:
(docker-compose) Add health check to mariadb
2023-10-26 11:10:53 +02:00
mariadb:
condition: service_healthy
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
environment:
- "WMSA_SERVICE_NODE=2"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
services:
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
index-service-1:
<<: *partition-1
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/index-service"
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
container_name: "index-service-1"
executor-service-1:
<<: *partition-1
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/executor-service"
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
container_name: "executor-service-1"
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
index-service-2:
<<: *partition-2
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/index-service"
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
container_name: "index-service-2"
executor-service-2:
<<: *partition-2
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/executor-service"
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
container_name: "executor-service-2"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
query-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/query-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
container_name: "query-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
search-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/search-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "search-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- 80
labels:
- "traefik.enable=true"
- "traefik.http.routers.search-service.rule=PathPrefix(`/`)"
- "traefik.http.routers.search-service.entrypoints=search"
- "traefik.http.routers.search-service.middlewares=add-xpublic"
- "traefik.http.routers.search-service.middlewares=add-public"
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
assistant-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/assistant-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "assistant-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- 80
labels:
- "traefik.enable=true"
Route suggestions to assistant
2023-10-25 14:50:21 +02:00
- "traefik.http.routers.assistant-service-screenshot.rule=PathPrefix(`/screenshot`)"
(docker) Route screenshots to dating as well
2023-11-02 15:47:18 +01:00
- "traefik.http.routers.assistant-service-screenshot.entrypoints=search,dating"
Route suggestions to assistant
2023-10-25 14:50:21 +02:00
- "traefik.http.routers.assistant-service-screenshot.middlewares=add-xpublic"
- "traefik.http.routers.assistant-service-screenshot.middlewares=add-public"
- "traefik.http.routers.assistant-service-suggest.rule=PathPrefix(`/suggest`)"
- "traefik.http.routers.assistant-service-suggest.entrypoints=search"
- "traefik.http.routers.assistant-service-suggest.middlewares=add-xpublic"
- "traefik.http.routers.assistant-service-suggest.middlewares=add-public"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
api-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/api-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "api-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- "80"
labels:
- "traefik.enable=true"
- "traefik.http.routers.api-service.rule=PathPrefix(`/`)"
- "traefik.http.routers.api-service.entrypoints=api"
- "traefik.http.routers.api-service.middlewares=add-xpublic"
- "traefik.http.routers.api-service.middlewares=add-public"
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
dating-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/dating-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "dating-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- 80
labels:
- "traefik.enable=true"
- "traefik.http.routers.dating-service.rule=PathPrefix(`/`)"
- "traefik.http.routers.dating-service.entrypoints=dating"
- "traefik.http.routers.dating-service.middlewares=add-xpublic"
- "traefik.http.routers.dating-service.middlewares=add-public"
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
explorer-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/explorer-service"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "explorer-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- 80
labels:
- "traefik.enable=true"
- "traefik.http.routers.explorer-service.rule=PathPrefix(`/`)"
- "traefik.http.routers.explorer-service.entrypoints=explore"
- "traefik.http.routers.explorer-service.middlewares=add-xpublic"
- "traefik.http.routers.explorer-service.middlewares=add-public"
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Embryo of new control process * New events and heartbeat tables in mariadb * Refactored to a cleaner Service interface
2023-07-03 10:40:32 +02:00
control-service:
<<: *service
(gradle) Make docker image registry and tag configurable This is to enable running an external repository for production and test. Use the ./gradle -Pdocker-registry=registry.foo.bar -Pdocker-tag=my-tag while building to accomplish this. By default, use 'marginalia' for repository and 'latest' as tag.
2023-11-16 21:12:55 +01:00
image: "marginalia/control-service"
Embryo of new control process * New events and heartbeat tables in mariadb * Refactored to a cleaner Service interface
2023-07-03 10:40:32 +02:00
container_name: "control-service"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
expose:
- 80
labels:
- "traefik.enable=true"
- "traefik.http.routers.control-service.rule=PathPrefix(`/`)"
- "traefik.http.routers.control-service.entrypoints=control"
- "traefik.http.routers.control-service.middlewares=add-xpublic"
- "traefik.http.routers.control-service.middlewares=add-public"
- "traefik.http.middlewares.add-xpublic.headers.customrequestheaders.X-Public=1"
- "traefik.http.middlewares.add-public.addprefix.prefix=/public"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
mariadb:
(setup) Upgrade mariadb image to one that exists in real life
2023-10-03 11:07:58 +02:00
image: "mariadb:lts"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
container_name: "mariadb"
Move env into run for clarity
2023-03-04 14:24:38 +01:00
env_file: "run/env/mariadb.env"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
command: ['mysqld', '--character-set-server=utf8mb4', '--collation-server=utf8mb4_unicode_ci']
ports:
- "127.0.0.1:3306:3306/tcp"
(docker-compose) Add health check to mariadb
2023-10-26 11:10:53 +02:00
healthcheck:
test: mysqladmin ping -h 127.0.0.1 -u $$MARIADB_USER --password=$$MARIADB_PASSWORD
start_period: 5s
interval: 5s
timeout: 5s
retries: 60
Restructuring the git repo
2023-03-04 13:19:01 +01:00
volumes:
- db:/var/lib/mysql
Move database to a separate module * Move database to a separate project, break apart sql file into separate entities. * Fix front page news listing.
2023-03-25 15:26:17 +01:00
- "./code/common/db/src/main/resources/sql/current/:/docker-entrypoint-initdb.d/"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
networks:
- wmsa
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
traefik:
image: "traefik:v2.10"
container_name: "traefik"
command:
#- "--log.level=DEBUG"
- "--api.insecure=true"
- "--providers.docker=true"
- "--providers.docker.exposedbydefault=false"
- "--entrypoints.search.address=:80"
- "--entrypoints.control.address=:81"
- "--entrypoints.api.address=:82"
- "--entrypoints.dating.address=:83"
- "--entrypoints.explore.address=:84"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
ports:
- "127.0.0.1:8080:80"
(control) WIP control service
2023-07-10 18:58:33 +02:00
- "127.0.0.1:8081:81"
(api-service) Improved testability, always set content type to application/json
2023-10-09 15:39:34 +02:00
- "127.0.0.1:8082:82"
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
- "127.0.0.1:8083:83"
- "127.0.0.1:8084:84"
- "127.0.0.1:8090:8080"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
volumes:
(*) Use trafeik instead of nginx for reverse proxy
2023-10-24 14:44:19 +02:00
- "/var/run/docker.sock:/var/run/docker.sock:ro"
Restructuring the git repo
2023-03-04 13:19:01 +01:00
networks:
- wmsa
(prometheus) Add in-docker prometheus instance to exfiltrate metrics from the docker-based services
2024-01-01 17:16:29 +01:00
prometheus:
image: "prom/prometheus"
container_name: "prometheus"
command:
- "--config.file=/etc/prometheus/prometheus.yml"
ports:
- "127.0.0.1:8091:9090"
volumes:
- "./run/prometheus.yml:/etc/prometheus/prometheus.yml"
- "/var/run/docker.sock:/var/run/docker.sock:ro"
networks:
- wmsa
Restructuring the git repo
2023-03-04 13:19:01 +01:00
networks:
wmsa:
volumes:
db:
driver: local
driver_opts:
type: none
o: bind
device: run/db
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
logs:
(*) Get multi-node routing working.
2023-10-15 18:38:30 +02:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/logs
model:
Restructuring the git repo
2023-03-04 13:19:01 +01:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/model
conf:
(index,control) Recoverable index backups
2023-08-25 14:57:43 +02:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/conf
data:
Restructuring the git repo
2023-03-04 13:19:01 +01:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/data
samples-1:
Restructuring the git repo
2023-03-04 13:19:01 +01:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/node-1/samples
index-1:
Fix typeahead suggestions
2023-03-25 10:20:44 +01:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/node-1/index
work-1:
(control, WIP) MQFSM and ProcessService are sitting in a tree We're spawning processes from the MSFSM in control service now!
2023-07-11 17:08:43 +02:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/node-1/work
backup-1:
driver: local
driver_opts:
type: none
o: bind
device: run/node-1/backup
samples-2:
driver: local
driver_opts:
type: none
o: bind
device: run/node-2/samples
index-2:
driver: local
driver_opts:
type: none
o: bind
device: run/node-2/index
work-2:
driver: local
driver_opts:
type: none
o: bind
device: run/node-2/work
backup-2:
(control, WIP) MQFSM and ProcessService are sitting in a tree We're spawning processes from the MSFSM in control service now!
2023-07-11 17:08:43 +02:00
driver: local
driver_opts:
type: none
o: bind
(run) Add two nodes to the demo setup
2023-10-16 17:37:26 +02:00
device: run/node-2/backup
Reference in New Issue Copy Permalink