CatgirlIntelligenceAgency/code/libraries/language-processing

Language Processing

This library contains various tools used in language processing.

Central Classes

• SentenceExtractor - Creates a DocumentLanguageData from a text, containing its words, how they stem, POS tags, and so on.

• TermFrequencyDict

• NGramBloomFilter

See Also

features-convert/keyword-extraction uses this code to identify which keywords are important.

features-search/query-parser also does some language processing.