(deps) Remove monkey patched GSON
The codebase used to have a monkey patched version of gson that made special optimizations for the unusually large JSON files that used to store e.g. crawl data. Since JSON is no longer used in this fashion, the GSON fork is not needed anymore.
This commit is contained in:
parent
a2fc83d94e
commit
7286596fb4
@ -19,9 +19,6 @@ application {
|
|||||||
tasks.distZip.enabled = false
|
tasks.distZip.enabled = false
|
||||||
|
|
||||||
dependencies {
|
dependencies {
|
||||||
|
|
||||||
implementation project(':third-party:monkey-patch-gson')
|
|
||||||
|
|
||||||
implementation project(':code:common:process')
|
implementation project(':code:common:process')
|
||||||
|
|
||||||
implementation project(':third-party:porterstemmer')
|
implementation project(':third-party:porterstemmer')
|
||||||
|
@ -93,12 +93,10 @@ include 'third-party:rdrpostagger'
|
|||||||
include 'third-party:openzim'
|
include 'third-party:openzim'
|
||||||
include 'third-party:count-min-sketch'
|
include 'third-party:count-min-sketch'
|
||||||
include 'third-party:monkey-patch-opennlp'
|
include 'third-party:monkey-patch-opennlp'
|
||||||
include 'third-party:monkey-patch-gson'
|
|
||||||
include 'third-party:commons-codec'
|
include 'third-party:commons-codec'
|
||||||
include 'third-party:parquet-floor'
|
include 'third-party:parquet-floor'
|
||||||
include 'third-party:encyclopedia-marginalia-nu'
|
include 'third-party:encyclopedia-marginalia-nu'
|
||||||
|
|
||||||
|
|
||||||
dependencyResolutionManagement {
|
dependencyResolutionManagement {
|
||||||
|
|
||||||
repositories {
|
repositories {
|
||||||
|
3
third-party/README.md
vendored
3
third-party/README.md
vendored
@ -17,5 +17,4 @@ or lack an artifact, or to override some default that is inappropriate for the t
|
|||||||
* [Count-Min-Sketch](count-min-sketch/) - Apache 2.0
|
* [Count-Min-Sketch](count-min-sketch/) - Apache 2.0
|
||||||
|
|
||||||
### Monkey Patched
|
### Monkey Patched
|
||||||
* [Stanford OpenNLP](monkey-patch-opennlp/) - Apache-2.0
|
* [Stanford OpenNLP](monkey-patch-opennlp/) - Apache-2.0
|
||||||
* [GSON](monkey-patch-gson/) - Apache-2.0
|
|
17
third-party/monkey-patch-gson/build.gradle
vendored
17
third-party/monkey-patch-gson/build.gradle
vendored
@ -1,17 +0,0 @@
|
|||||||
plugins {
|
|
||||||
id 'java'
|
|
||||||
}
|
|
||||||
|
|
||||||
java {
|
|
||||||
toolchain {
|
|
||||||
languageVersion.set(JavaLanguageVersion.of(21))
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
dependencies {
|
|
||||||
implementation libs.bundles.gson
|
|
||||||
}
|
|
||||||
|
|
||||||
test {
|
|
||||||
useJUnitPlatform()
|
|
||||||
}
|
|
13
third-party/monkey-patch-gson/readme.md
vendored
13
third-party/monkey-patch-gson/readme.md
vendored
@ -1,13 +0,0 @@
|
|||||||
# Monkey Patched GSON
|
|
||||||
|
|
||||||
Stanford OpenNLP - Apache-2.0
|
|
||||||
|
|
||||||
## Rationale
|
|
||||||
|
|
||||||
GSON makes some assumptions that make it not work very well
|
|
||||||
for deserializing extremely large JSON objects. This patch
|
|
||||||
makes the code technically leak memory, but the way it's used
|
|
||||||
makes this not much of a problem.
|
|
||||||
|
|
||||||
It should only be applied to the converter or possibly
|
|
||||||
loader processes, not the services.
|
|
File diff suppressed because it is too large
Load Diff
Loading…
Reference in New Issue
Block a user