161sh/CatgirlIntelligenceAgency
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

(converter) Refactor content type check in PlainTextDocumentProcessorPlugin

Browse source 
The method `isApplicable` in the `PlainTextDocumentProcessorPlugin` was refactored to handle a wider range of content types beyond merely "text/plain". It now also handles any content type that starts with "text/plain;", to accomodate contentTypes that append a charset as well.
This commit is contained in:
Viktor Lofgren 2024-01-22 17:52:14 +01:00
parent 51cdf46645
commit 41d896ba3e
1 changed files with 8 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
code/processes/converting-process/src/main/java/nu/marginalia/converting/processor/plugin/PlainTextDocumentProcessorPlugin.java
View file

@ -54,7 +54,14 @@ public class PlainTextDocumentProcessorPlugin extends AbstractDocumentProcessorP
@Override
public boolean isApplicable(CrawledDocument doc) {
return doc.contentType.equalsIgnoreCase("text/plain");
String contentType = doc.contentType.toLowerCase();
if (contentType.equals("text/plain"))
return true;
if (contentType.startsWith("text/plain;")) // charset=blabla
return true;
return false;
}
@Override