CatgirlIntelligenceAgency/code
Viktor 112f43b3a1
Api service response cache (#16)
* Add response caching to the API service to help SearXNG

* Clean up the code a bit.

* Add an endpoint without a terminating slash for getLicense.

* Add tests for API service.
2023-04-22 15:42:32 +02:00
..
api Add a ranking parameter for biasing toward recent or old content. 2023-04-20 16:00:59 +02:00
common Issue 5: Fix bug where some IPv6 addresses blew up domain loading. 2023-04-15 14:11:08 +02:00
features-convert (converter) Adjust the pub-date sniffing heuristics' order. Doing HTML5 tags too early puts some sites too early. Also expanded support for JSON+LD. 2023-04-19 15:28:50 +02:00
features-crawl Yet more restructuring. Improved search result ranking. 2023-03-16 21:35:54 +01:00
features-index Clean up of the index query handling related code. 2023-04-10 14:50:57 +02:00
features-search Add a ranking parameter for biasing toward recent or old content. 2023-04-20 16:00:59 +02:00
libraries Tools for merging sorted lists, and merging btrees. (#14) 2023-04-20 15:28:09 +02:00
process-models Bugfix crawl plan, doesn't use rewrite() everywhere 2023-03-30 15:41:07 +02:00
processes Api service response cache (#16) 2023-04-22 15:42:32 +02:00
services-core Reformulate search-header.hdb, s/Support/Donate/ the formulation was apparently confusing some people thinking they could get support on this page. 2023-04-18 17:04:24 +02:00
services-satellite Api service response cache (#16) 2023-04-22 15:42:32 +02:00
tools Improvements to the adjacency calculator and screenshots tool (#13) 2023-04-18 22:21:49 +02:00
readme.md Fix broken diagram links after doc/ restructuring. 2023-03-25 16:32:10 +01:00

Code

This is a pretty large and diverse project with many moving parts.

You'll find a short description in each module of what it does and how it relates to other modules. The modules each have names like "library" or "process" or "feature". These have specific meanings. See doc/module-taxonomy.md.

Overview

A map of the most important components and how they relate can be found below.

image

Services

Processes

Processes are batch jobs that deal with data retrieval, processing and loading.

Tools

Features

Features are relatively stand-alone components that serve some part of the domain. They aren't domain-independent, but isolated.

Libraries and primitives

Libraries are stand-alone code that is independent of the domain logic.

  • common elements for creating a service, a client etc.
  • libraries containing non-search specific code.
    • array - large memory mapped area library
    • btree - static btree library