CatgirlIntelligenceAgency/code/process-models/processed-data
Viktor Lofgren dbe9235f3a (*) Upgrade to JDK21 with preview enabled.
... also move some common configuration into the root build.gradle-file.

Support for JDK21 in lombok is a bit sketchy at the moment, but it seems to work.  This upgrade is kind of important as the new index construction really benefits from Arena based lifecycle control over off-heap memory.
2023-09-24 10:38:59 +02:00
..
src (converter,loader) Converter outputs parquet files instead of compressed json. 2023-09-13 16:13:41 +02:00
build.gradle (*) Upgrade to JDK21 with preview enabled. 2023-09-24 10:38:59 +02:00
readme.md (docs) Update the documentation up-to-date information 2023-09-14 11:33:36 +02:00

The processed-data package contains models and logic for reading and writing parquet files with the output from the converting-process.

Main models:

Since parquet is a column based format, some of the readable models are projections that only read parts of the input file.

See Also

third-party/parquet-floor