Skip to content

publications.md

Latest commit

 

History

History
338 lines (252 loc) · 13.9 KB

publications.md

File metadata and controls

338 lines (252 loc) · 13.9 KB

Publications

The development of EvoMaster is rooted in academia. Here, you can find the PDFs of all the academic publications based on EvoMaster. Furthermore, slides of presentations can be found here. These can be useful if you want to know more on how EvoMaster works internally, e.g., details on the Many Independent Objective (MIO) algorithm.

To help to replicate previous studies, for most of these papers we also provide the scripts used to setup the experiments. This explained in more details here. Also, some of these papers provides full replication packages, which are linked directly in the papers (and not stored in this repository).

Recent arXiv Technical Reports, not Peer-Reviewed (Yet)

  • A. Arcuri, A. Poth, O. Rrjolli, P. Garrett, J. P. Galeotti Fuzzing REST APIs in Industry: Necessary Features and Open Problems. [arxiv]

  • O. Sahin, M. Zhang, A. Arcuri. Enhancing REST API Fuzzing with Access Policy Violation Checks and Injection Attacks. [arxiv]

  • H. Sartaj, S. Ali, P. Arcaini, A. Arcuri. Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmap. [arxiv]

  • P. Garrett, J. P. Galeotti, A. Arcuri, A. Poth, O. Rrjolli. Generating REST API Tests With Descriptive Names. [arxiv]

  • O. Sahin, M. Zhang, A. Arcuri. WFC/WFD: Web Fuzzing Commons, Dataset and Guidelines to Support Experimentation in REST API Fuzzing. [arxiv]

Peer-Reviewed Publications

2026

  • M. Zhang, T. Yue, A. Arcuri. Fuzzing Microservices in Face of Intrinsic Uncertainties. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF]

  • H. Ghianni, M. Zhang, J. P. Galeotti, A. Arcuri. Search-Based Fuzzing For RESTful APIs That Use MongoDB. ACM/IEEE International Conference on Automation of Software Test (AST). [PDF]

  • A. Arcuri, M. Zhang, S. Seran, J. P. Galeotti, A. Golmohammadi, P. Garrett, O. Sahin, M. Shalmani, F. Castagna, I. Kertusha, F. Susilo, G. Bhandari, G. Assres, J. Molléri. EvoMaster at REST League 2026 Tool Competition. IEEE International Workshop on Search-Based and Fuzz Testing (SBFT). [PDF]

  • S. Seran, G. Bhandari, A. Arcuri. Detecting Server-Side Request Forgery (SSRF) Vulnerabilities In REST API Fuzz Testing. IEEE International Workshop on Search-Based and Fuzz Testing (SBFT). [PDF]

2025

  • A. Golmohammadi, M. Zhang, A. Arcuri. Tools and Benchmarks Evolve: What is their Impact on Parameter Tuning in SBSE Experiments?. Empirical Software Engineering (EMSE). [PDF]

  • F. F. Susilo. Human-Centered Evaluation of REST API Fuzzing Tools: Bridging Academia and Industry. IEEE/ACM International Conference on Automated Software Engineering (ASE), Doctoral Symposium. [PDF]

  • A. Arcuri, O. Sahin, M. Zhang. Fuzzing for Detecting Access Policy Violations in REST APIs. IEEE International Symposium on Software Reliability Engineering (ISSRE). [PDF]

  • O. Sahin, M. Zhang, A. Arcuri. Causes and Effects of Fitness Landscapes in System Test Generation: A Replication Study. Automated Software Engineering (ASE). [PDF]

  • M. Zhang, A. Arcuri, Y. Li, K. Xue, Z Wang, J. Huo, W Huang. Fuzzing Microservices: A Series of User Studies in Industry on Industrial Systems with EvoMaster. Science of Computer Programming (SCP). [PDF]

  • S. Seran, M. Zhang, O. Duman, A. Arcuri. Handling Web Service Interactions in Fuzzing with Search-Based Mock-Generation. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF][Scripts]

  • A. Arcuri, P. Garrett, J.P. Galeotti, M . Zhang. Widening The Adoption of Web API Fuzzing: Docker, GitHub Action and Python Support for EvoMaster. ACM International Conference on the Foundations of Software Engineering (FSE), Demo Track. [PDF]

  • G. Fraser, A. Arcuri. A Retrospective on Whole Test Suite Generation: On the Role of SBST in the Age of LLMs. IEEE Transactions on Software Engineering (TSE). [PDF]

  • A. Arcuri, A. Poth, O. Rrjolli. Introducing Black-Box Fuzz Testing for REST APIs in Industry: Challenges and Solutions. IEEE International Conference on Software Testing, Validation and Verification (ICST), Industry Track. [PDF]

  • S. Seran, O. Duman, A. Arcuri. Multi-Phase Taint Analysis for JSON Inference in Search-Based Fuzzing. IEEE International Workshop on Search-Based and Fuzz Testing (SBFT). [PDF]

2024

  • A. Arcuri, M. Zhang, S. Seran, J.P. Galeotti, A. Golmohammadi, O. Duman, A. Aldasoro, H. Ghianni. Tool Report: EvoMaster -- Black and White Box Search-Based Fuzzing for REST, GraphQL and RPC APIs. Automated Software Engineering (ASE). [PDF]

  • A. Poth, O. Rrjolli, A. Arcuri. Technology Adoption Performance Evaluation Applied to Testing Industrial REST APIs. Automated Software Engineering (ASE). [PDF]

  • M. Zhang, A. Arcuri, P. Teng, K. Xue, W. Wang. Seeding and Mocking in White-Box Fuzzing Enterprise RPC APIs: An Industrial Case Study. IEEE/ACM International Conference on Automated Software Engineering (ASE), Industry Track. [PDF]

  • I. Kertusha. Search-Based White-Box Fuzzing of Web Frontend Applications. IEEE International Symposium on Software Reliability Engineering (ISSRE), Doctoral Symposium. [PDF]

  • S. Seran. Search-based Security Testing of Enterprise Microservices. IEEE International Conference on Software Testing, Validation and Verification (ICST), Doctoral Symposium. [PDF]

  • A. Arcuri, M. Zhang, J.P. Galeotti. Advanced White-Box Heuristics for Search-Based Fuzzing of REST APIs. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF][Scripts]

2023

  • S. Seran, M. Zhang, A. Arcuri. Search-Based Mock Generation of External Web Service Interactions. Symposium on Search-based Software Engineering (SSBSE). [PDF]

  • A. Golmohammadi, M. Zhang, A. Arcuri. On the Impact of Tool Evolution and Case Study Size on SBSE Experiments: A Replicated Study with EvoMaster. Symposium on Search-based Software Engineering (SSBSE). [PDF]

  • A. Golmohammadi. Enhancing White-Box Search-Based Testing of RESTful APIs. IEEE International Symposium on Software Reliability Engineering (ISSRE), Doctoral Symposium. [PDF]

  • A. Golmohammadi, M. Zhang, A. Arcuri. Testing RESTful APIs: A Survey. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF]

  • A. Golmohammadi, M. Zhang, A. Arcuri .NET/C# Instrumentation for Search-Based Software Testing. Software Quality Journal (SQJ). [PDF]

  • A. Belhadi, M. Zhang, A. Arcuri. Random Testing and Evolutionary Testing for Fuzzing GraphQL APIs. ACM Transactions on the Web (TWEB). [PDF] [Script 0] [Script 1]

  • M. Zhang, A. Arcuri. Open Problems in Fuzzing RESTful APIs: A Comparison of Tools. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Script 0] [Script 1] [Script others]

  • M. Zhang, A. Belhadi, A. Arcuri. JavaScript SBST Heuristics To Enable Effective Fuzzing of NodeJS Web APIs. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF]

  • A. Arcuri, M Zhang, A. Belhadi, B. Marculescu, A. Golmohammadi, J. P. Galeotti, S. Seran. Building An Open-Source System Test Generation Tool: Lessons Learned And Empirical Analyses with EvoMaster. Software Quality Journal (SQJ). [PDF]

  • M. Zhang, A. Arcuri, Y. Li, Y. Liu, K. Xue. White-box Fuzzing RPC-based APIs with EvoMaster: An Industrial Case Study. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF]

  • A. Arcuri, M. Zhang, A. Golmohammadi, A. Belhadi, J. P. Galeotti, B. Marculescu, S. Seran. EMB: A Curated Corpus of Web/Enterprise Applications And Library Support for Software Testing Research. IEEE International Conference on Software Testing, Validation and Verification (ICST). [PDF]

2022

  • A. Belhadi, M. Zhang, A. Arcuri. Evolutionary-based Automated Testing for GraphQL APIs. ACM Genetic and Evolutionary Computation Conference (GECCO). [PDF] [Scripts]

  • M. Zhang, A. Belhadi, A. Arcuri. JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs. IEEE International Conference on Software Testing, Validation and Verification (ICST). [PDF]

  • B. Marculescu, M. Zhang, A. Arcuri. On the faults found in REST APIs by Automated Test Generation. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Scripts]

2021

  • A. Martin-Lopez, A. Arcuri, S. Segura, A. Ruiz-Cortes. Black-Box and White-Box Test Case Generation for RESTful APIs: Enemies or Allies? IEEE International Symposium on Software Reliability Engineering (ISSRE). [PDF]

  • M. Zhang, A. Arcuri. Enhancing Resource-based Test Case Generation For RESTful APIs with SQL Handling. Symposium on Search-based Software Engineering (SSBSE). [PDF] [Scripts]

  • A. Arcuri, J.P. Galeotti. Enhancing Search-Based Testing With Testability Transformations For Existing APIs. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Scripts]

  • M. Zhang, A. Arcuri. Adaptive Hypermutation for Search-Based System Test Generation: A Study on REST APIs with EvoMaster. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Scripts]

  • M. Zhang, B. Marculescu, A. Arcuri. Resource and Dependency based Test Case Generation for RESTful Web Services. Empirical Software Engineering (EMSE). [PDF] [Scripts]

  • A. Arcuri, J.P. Galeotti, B. Marculescu, M. Zhang. EvoMaster: A Search-Based System Test Generation Tool. The Journal of Open Source Software (JOSS). [PDF]

2020

  • A. Arcuri. Automated Blackbox and Whitebox Testing of RESTful APIs with EvoMaster. IEEE Software. [PDF] [Scripts]

  • A. Arcuri, J.P. Galeotti. Handling SQL Databases in Automated System Test Generation. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Scripts]

  • A. Arcuri, J.P. Galeotti. Testability Transformations For Existing APIs. IEEE International Conference on Software Testing, Validation and Verification (ICST). [PDF] [Scripts]

2019

  • M. Zhang, B. Marculescu, A. Arcuri. Resource-based Test Case Generation for RESTful Web Services. ACM Genetic and Evolutionary Computation Conference (GECCO). [PDF] [Scripts]

  • A. Arcuri, J.P. Galeotti. SQL Data Generation to Enhance Search-Based System Testing. ACM Genetic and Evolutionary Computation Conference (GECCO). [PDF] [Scripts]

  • A. Arcuri. RESTful API Automated Test Case Generation with EvoMaster. ACM Transactions on Software Engineering and Methodology (TOSEM). [PDF] [Scripts]

2018

  • A. Arcuri. Test Suite Generation with the Many Independent Objective (MIO) Algorithm. Information and Software Technology (IST). [PDF] [Scripts]

  • A. Arcuri. EvoMaster: Evolutionary Multi-context Automated System Test Generation. IEEE International Conference on Software Testing, Validation and Verification (ICST). [PDF]

  • A. Arcuri. An Experience Report On Applying Software Testing Academic Results In Industry: We Need Usable Automated Test Generation. Empirical Software Engineering (EMSE). [PDF]

2017

  • A. Arcuri. RESTful API Automated Test Case Generation. IEEE International Conference on Software Quality, Reliability & Security (QRS). [PDF] [Scripts]

  • A. Arcuri. Many Independent Objective (MIO) Algorithm for Test Suite Generation. Symposium on Search-based Software Engineering (SSBSE). Best paper award. [PDF] [Scripts]