CatgirlIntelligenceAgency/code/libraries
2023-03-10 16:46:56 +01:00
..
array Move all code to a code directory. 2023-03-07 17:14:32 +01:00
big-string Move all code to a code directory. 2023-03-07 17:14:32 +01:00
btree Move all code to a code directory. 2023-03-07 17:14:32 +01:00
easy-lsh Move all code to a code directory. 2023-03-07 17:14:32 +01:00
guarded-regex Move all code to a code directory. 2023-03-07 17:14:32 +01:00
language-processing Word feature bit for words that appear in the URL, new search profile for plain text files, better plain text titles. 2023-03-10 16:46:56 +01:00
misc Move all code to a code directory. 2023-03-07 17:14:32 +01:00
random-write-funnel Move all code to a code directory. 2023-03-07 17:14:32 +01:00
readme.md Move all code to a code directory. 2023-03-07 17:14:32 +01:00

Libraries

These are libraries that are not strongly coupled to the search engine.

  • The array library is for memory mapping large memory-areas, which Java has bad support for. It's designed to be able to easily replaced when Java's Foreign Function And Memory API is released.
  • The btree library offers a static BTree implementation based on the array library.
  • language-processing contains primitives for sentence extraction and POS-tagging.

Micro libraries

  • easy-lsh is a simple locality-sensitive hash for document deduplication
  • guarded-regex makes predicated regular expressions clearer
  • big-string offers seamless string compression
  • random-write-funnel is a tool for reducing write amplification when constructing large files out of order.

The rest

  • misc is just random bits and bobs that didn't fit anywhere.