161sh/CatgirlIntelligenceAgency

History

Viktor Lofgren 0806aa6dfe (language-processing) Add maximum length limit for text input in SentenceExtractor Added a new constant, MAX_TEXT_LENGTH, to the SentenceExtractor class. If the length of the text input exceeds this limit, the text is truncated to fit within the limit. This modification is designed to prevent excessive resource usage for unusually long text inputs.		2024-01-03 14:27:47 +01:00
..
src	(language-processing) Add maximum length limit for text input in SentenceExtractor	2024-01-03 14:27:47 +01:00
build.gradle	(build) Move unit test configuration to root build.gradle	2023-10-04 12:46:22 +02:00
readme.md	(refactor) Remove features-search and update documentation	2023-10-09 15:12:30 +02:00

readme.md

Language Processing

This library contains various tools used in language processing.

Central Classes

SentenceExtractor - Creates a DocumentLanguageData from a text, containing its words, how they stem, POS tags, and so on.

See Also

features-convert/keyword-extraction uses this code to identify which keywords are important.

features-qs/query-parser also does some language processing.