Parsing error related to "MediaType IllegalArgumentException"

[ceylanb]

The stack trace of the error that I've got is shared below. Here is what you need to debug it:

• The version: 4.0.0
• I run it with the JAR file on MacOS Silicon.
• I've tried with different versions such as OpenJDK 24, 21, Temurin JDK 8, and Oracle JDK 8, here is the output of one of them:

  java version "1.8.0_461"
  Java(TM) SE Runtime Environment (build 1.8.0_461-b11)
  Java HotSpot(TM) 64-Bit Server VM (build 25.461-b11, mixed mode)

• The options:

  java -jar evomaster.jar \
   --blackBox true  \
   --maxTime 3600s  \
   --bbSwaggerUrl "/redacted/crapi-openapi-spec.json"  \
   --bbTargetUrl http://localhost:8888  \
   --seed 0 \
   --showProgress false  \
   --createConfigPathIfMissing false \
   --outputFilePrefix test_evomaster \
   --outputFileSuffix "_" \
   --outputFolder "/redacted/output"  \
   --writeWFCReport true \
   --configPath "/redacted/crapi-auth.yaml" \
   --security true
  

The stacktrace:

* [ERROR] EvoMaster process terminated abruptly. This is likely a bug in EvoMaster. Please copy&paste the following stacktrace, and create a new issue on https://github.com/WebFuzzing/EvoMaster/issues
java.lang.IllegalArgumentException: Could not parse ''
        at com.google.common.net.MediaType.parse(MediaType.java:1078)
        at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
        at java.base/java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1856)
        at java.base/java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129)
        at java.base/java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527)
        at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513)
        at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
        at java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230)
        at java.base/java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196)
        at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.base/java.util.stream.ReferencePipeline.anyMatch(ReferencePipeline.java:632)
        at com.atlassian.oai.validator.util.ContentTypeUtils.matchesAny(ContentTypeUtils.java:257)
        at com.atlassian.oai.validator.interaction.response.ResponseValidator.validateContentType(ResponseValidator.java:204)
        at com.atlassian.oai.validator.interaction.response.ResponseValidator.validateResponse(ResponseValidator.java:97)
        at com.atlassian.oai.validator.OpenApiInteractionValidator.lambda$validateResponse$4(OpenApiInteractionValidator.java:237)
        at java.base/java.util.function.Function.lambda$andThen$1(Function.java:88)
        at com.atlassian.oai.validator.OpenApiInteractionValidator.validateOnApiOperation(OpenApiInteractionValidator.java:268)
        at com.atlassian.oai.validator.OpenApiInteractionValidator.validateResponse(OpenApiInteractionValidator.java:234)
        at org.evomaster.core.problem.rest.oracle.RestSchemaOracle.handleSchemaOracles(RestSchemaOracle.kt:71)
        at org.evomaster.core.problem.rest.service.fitness.AbstractRestFitness.handleRestCall(AbstractRestFitness.kt:723)
        at org.evomaster.core.problem.rest.service.fitness.BlackBoxRestFitness.doCalculateCoverage(BlackBoxRestFitness.kt:63)
        at org.evomaster.core.problem.rest.service.fitness.BlackBoxRestFitness.doCalculateCoverage(BlackBoxRestFitness.kt:22)
        at org.evomaster.core.search.service.FitnessFunction.calculateIndividualCoverageWithStats(FitnessFunction.kt:149)
        at org.evomaster.core.search.service.FitnessFunction.calculateCoverage(FitnessFunction.kt:66)
        at org.evomaster.core.search.service.FitnessFunction.calculateCoverage$default(FitnessFunction.kt:55)
        at org.evomaster.core.search.algorithms.SmartsAlgorithm.searchOnce(SmartsAlgorithm.kt:30)
        at org.evomaster.core.search.service.SearchAlgorithm.search(SearchAlgorithm.kt:77)
        at org.evomaster.core.Main$Companion.run(Main.kt:727)
        at org.evomaster.core.Main$Companion.initAndRun(Main.kt:225)
        at org.evomaster.core.Main$Companion.main(Main.kt:120)
        at org.evomaster.core.Main.main(Main.kt)
Caused by: java.lang.IllegalStateException: null
        at com.google.common.base.Preconditions.checkState(Preconditions.java:486)
        at com.google.common.net.MediaType$Tokenizer.consumeTokenIfPresent(MediaType.java:1092)
        at com.google.common.net.MediaType$Tokenizer.consumeToken(MediaType.java:1100)
        at com.google.common.net.MediaType.parse(MediaType.java:1047)
        ... 30 common frames omitted

[arcuri82]

hi @ceylanb ,

thanks for taking the time to report this bug.

It looks like it is a bug in a library that we use for JSON, or how we set it up with body-type info of the response.

[ceylanb]

The spec file that I used: https://github.com/OWASP/crAPI/blob/develop/openapi-spec/crapi-openapi-spec.json.

[arcuri82]

@ceylanb could you build EvoMaster from the branch issue-1295, and see if the problem persists? the problem is not in the schema itself, but on how the actual response from the API is handled

[ceylanb]

Wow, that was incredibly fast! Thank you so much for the quick response and fix. You just surprised me with this level of developer support.

I am able to see the related log lines in the console with your fix.

14:10:41.147 [main] WARN  o.e.c.p.r.s.f.AbstractRestFitness - Failed to handle response validation for GET:/workshop/api/shop/return_qr_code. This might be a bug in EvoMaster, or in one of the third-party libraries it uses. Error: Could not parse ''

[arcuri82]

with that branch, EvoMaster will not crash. it simply will avoid evaluating schema oracles on some endpoints.

I will need to investigate if it is a bug in the library swagger-request-validator-core which we use, or if it is a bug in the way we call it

[arcuri82]

the problem is not fully solve yet, as I don't have much time know to investigate it in detail. but i have merged that branch. at least now master branch will not crash when seen such issue, and rather issue a warning log