(deps) Remove monkey patched GSON

The codebase used to have a monkey patched version of gson that made special optimizations for the unusually large JSON files that used to store e.g. crawl data.

Since JSON is no longer used in this fashion, the GSON fork is not needed anymore.
This commit is contained in:
Viktor Lofgren 2024-02-06 12:11:39 +01:00
parent a2fc83d94e
commit 7286596fb4
6 changed files with 1 additions and 1690 deletions

View File

@ -19,9 +19,6 @@ application {
tasks.distZip.enabled = false tasks.distZip.enabled = false
dependencies { dependencies {
implementation project(':third-party:monkey-patch-gson')
implementation project(':code:common:process') implementation project(':code:common:process')
implementation project(':third-party:porterstemmer') implementation project(':third-party:porterstemmer')

View File

@ -93,12 +93,10 @@ include 'third-party:rdrpostagger'
include 'third-party:openzim' include 'third-party:openzim'
include 'third-party:count-min-sketch' include 'third-party:count-min-sketch'
include 'third-party:monkey-patch-opennlp' include 'third-party:monkey-patch-opennlp'
include 'third-party:monkey-patch-gson'
include 'third-party:commons-codec' include 'third-party:commons-codec'
include 'third-party:parquet-floor' include 'third-party:parquet-floor'
include 'third-party:encyclopedia-marginalia-nu' include 'third-party:encyclopedia-marginalia-nu'
dependencyResolutionManagement { dependencyResolutionManagement {
repositories { repositories {

View File

@ -17,5 +17,4 @@ or lack an artifact, or to override some default that is inappropriate for the t
* [Count-Min-Sketch](count-min-sketch/) - Apache 2.0 * [Count-Min-Sketch](count-min-sketch/) - Apache 2.0
### Monkey Patched ### Monkey Patched
* [Stanford OpenNLP](monkey-patch-opennlp/) - Apache-2.0 * [Stanford OpenNLP](monkey-patch-opennlp/) - Apache-2.0
* [GSON](monkey-patch-gson/) - Apache-2.0

View File

@ -1,17 +0,0 @@
plugins {
id 'java'
}
java {
toolchain {
languageVersion.set(JavaLanguageVersion.of(21))
}
}
dependencies {
implementation libs.bundles.gson
}
test {
useJUnitPlatform()
}

View File

@ -1,13 +0,0 @@
# Monkey Patched GSON
Stanford OpenNLP - Apache-2.0
## Rationale
GSON makes some assumptions that make it not work very well
for deserializing extremely large JSON objects. This patch
makes the code technically leak memory, but the way it's used
makes this not much of a problem.
It should only be applied to the converter or possibly
loader processes, not the services.