v3.1.0 — The Resilience Release

v3.1.0 — The Resilience Release

Release date: 2026-04-19

SubProber v3.1.0 is a complete internal overhaul. The entire module structure has been rewritten from the ground up with a domain-driven architecture, and the persistent resume system has been rebuilt on LevelDB for reliable exact-point-of-interruption recovery.

---

New Features

LevelDB Disk Cache (Persistent Resume)

The previous in-memory caching layer has been replaced with a plyvel-backed LevelDB store. Interrupted scans now resume from the exact URL that was last processed — no re-scanning from scratch. The cache survives process crashes, SIGKILL, and system reboots.

Full Architecture Overhaul

The flat subprober/modules/ layout has been replaced with a domain-driven package structure:

Package	Responsibility
cli/	Argument parsing and entry point
dnsclient/	Async DNS resolution
httpclient/	HTTP probe engine
httpfilters/	Response filtering logic
hmap/	Response fingerprinting / tech detection
headless/	Headless browser / screenshot integration
jarmscanner/	JARM TLS fingerprinting
websocketclient/	WebSocket probe support
workerpool/	Async worker pool and concurrency control
pyrunner/	Core scan orchestration engine
resparser/	Response parsing utilities
urlbuilder/	URL normalization and construction
progresslogger/	Rich progress and output formatting
settings/	Configuration and runtime settings
syncutils/	Thread/async synchronization helpers
utils/	General utility functions

Modern Packaging

• Migrated from setup.py + requirements.txt to pyproject.toml with setuptools backend and uv.lock for reproducible installs
• Official Dockerfile and .dockerignore added
• PyPI publish workflow (.github/python-publish.yml) added
• Python 3.13+ required

---

Bug Fixes

f-string SyntaxError on certain Python builds (#16)

An f-string containing a backslash escape inside the expression caused a SyntaxError on some Python version/build combinations. Fixed by extracting the value before the f-string.

---

Dependencies

Package	Change
plyvel>=1.5.0	New — LevelDB bindings for persistent cache

---

Installation

pip install subprober
# or
uv tool install subprober

Docker:

docker build -t subprober .
docker run --rm -it subprober -h

---

Powered by RevoltSecurities

V3.0.1

SubProber V3.0.1 Updates

Whats Changed

• Fixed the issue in response html content parsing
• Handled the parser exception, if lxml parser is missed then automatically errors handled
• Improved the requirements of packages to install missing pacakges
• Removed port number unless --port option is provided and normalised the urls

Information:

If any of our users faced empty titles in output then indicates that lxml and bs4 packages are not installed properly, We request that users to install the missing packages with the following command

pip install -U beautifulsoup4 lxml bs4 --break-system-packages

V3.0.0

Subprober

An essential HTTP multi-purpose Probing Tool for Penetration Testers and Security Researchers with Asynchronous httpx client support

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

• Fast and configurable probings
• Supported Inputs: hosts, URLS, IPs
• Supports multiple methods http requests
• Supports proxies and customizable Header for probing
• Progress your probing tasks

Features in V3.0.0:

• New Features

  • Advanced Probing Configuration: Fine-tune your probes with support for custom HTTP methods, headers, and proxies.
  • Improved Matching and Filtering Options: Additional flags in Matchers and Filters sections for precise output control.
  • Optimized Rate Limiting and Concurrency: Enhanced performance with user-defined rate limits and delays for probe requests.
  • Enhanced Headless Mode: Thread options for screenshots to reduce memory overhead, supporting both PNG and PDF output formats.
  • Improved Output Formats: Includes detailed response and request headers, with added support for JSON format outputs.
  • TLS Information Retrieval: Capture TLS details during probes for deeper network insights.

V2.0.0

Subprober - An essential HTTP multi-purpose Probing Tool for Penetration Testers and Security Researchers with Asynchronous httpx client support

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

• Fast and configurable probings
• Supported Inputs: hosts, URLS, IPs
• Supports multiple methods http requests
• Supports proxies and customizable Header for probing
• Progress your probing tasks

Features in V2.0.0:

• New Probing configurations

  • --http2 : Now subprober support to request with Http/2 version
  • --http-version : display the server supported http version of the host
  • --http-reason : display the reason for http connection of the host
  • --jarm-fingerprint : display the jarm figerprint hash of the host

New Updates:

Subprober now supports HTTP/2 to give request and Improved concurrency using next generation http request client httpx
and also now gives jarm figerprints and other probe configurations. Subprober Concurrency performance improved with
more Asynchronous concurrency which make subprober more accurate and Concurrent tool for probing.

Subprober Probing Configuration:

Probes	Default check	Flags to Use
Url	True
Title	True	-tl, --title
Status code	True	-sc, --status-code
Response Length	true	-wc. --word-count
Server	True	-sv, --server
Content Type	True	-apt, --application-type
Follow redirection	False	-ar, --allow-redirect
Path	False	-p, --path
Redirect location	False	-l, --location
Max redirect follow	False	-maxr, --max-redirection
Disable http probe	False	-dhp, --disable-http-probe
Random user agents	False	-ra, --random-agent
Ipaddress of Host	False	-ip, --ipaddress
Cname of Host	False	-cn, --cname
Proxy	False	-px, --proxy
Custom Headers	False	-H, --header
Jarm	False	-jarm --jarm-fingerprint

v1.0.9

Subprober v1.0.9 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.9:

• New Probing configurations

  • -ip : finds the ips of urls
  • -cn : find the cname of urls
  • -maxr : maximum redirection for url
  • -ra : enable random agent to probe with random agent
  • -X : custom method for urls to probe
  • -H : set custom header for urls to probe
  • -sc : removed default to show response code and this flag to improve the subprober I/O

• Improved Concurrency

  • Subprober concurrency and accuracy are improved with asynchoronous libraries aiohttp, arsenic, aiodns which make subprober to asynchornously probe urls

• Headless

  • -ss : enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)
  • -st : set a timeout value for urls to take screenshots
  • -bt : select your browser type to take screenshots

• IO Support:

  • Subprober now support stdout when using -nc flag which make subprober output to be piped and extend your automated workflows
  • Now Subprober automatically detect the stdin are connected or not and quits
  • Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls

• Patched issues:

  • Fixed issue to probe urls when passing u, --url by @blackcodersec
  • Fixed double appendence of path when using -p, --path
  • Fixed update issue in previous version
  • Fixed issue in saving scrennshots output when urls passed with -p, --path

Speed and Loads:

Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources aws VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

v1.0.8

Subprober v1.0.8 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.8:

• New Probing configurations

  • -ip : finds the ips of urls
  • -cn : find the cname of urls
  • -maxr : maximum redirection for url
  • -ra : enable random agent to probe with random agent
  • -X : custom method for urls to probe
  • -H : set custom header for urls to probe
  • -sc : removed default to show response code and this flag to improve the subprober I/O

• Improved Concurrency

  • Subprober concurrency and accuracy are improved with asynchoronous libraries aiohttp, arsenic, aiodns which make subprober to asynchornously probe
    urls

• Headless

  • -ss : enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)
  • -st : set a timeout value for urls to take screenshots
  • -bt : select your browser type to take screenshots

• IO Support:

  • Subprober now support stdout when using -nc flag which make subprober output to be piped and extend your automated workflows
  • Now Subprober automatically detect the stdin are connected or not and quits
  • Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls

Speed and Loads:

Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources aws VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

v1.0.7

Subprober v1.0.7 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.7:

• Subprober is capable to handle high loads
• accuracy and concurrency are improved
• add extra configuration in probing saving outputs
• added new command -dhp --disable-http-probe to only probe https protocol
• improved subprober's memory allocations
• added deduplication that remove duplicated urls and etc..

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

v1.0.6

Subprober v1.0.6 - A Fast Multi-Purpose Http Probing Tool for Penetration Testing

Overview

Subprober v1.0.6 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.6:

• Subprober Concurrency and Accuracy are Improved than previous version
• Introduced new options and probes configuration
• Improved handling exception and increased the accuracy in results

v1.0.5

Subprober v1.0.5 - Fast Probing Tool for Penetration Testing

Overview

Subprober v1.0.5 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.5:

• Subprober Concurrency and Accuracy are Improved with libraries like aiohttp,asyncio
• Subprober Error handling and Synchronization are improved
• Resolved some Bugs for Subprober
• Subprober Commands are changed with usefull flags
• Resolved executive errors in v1.0.4
• Subprober requires python version 3.11.x

Installation and Updates

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

update to v1.0.4 to v1.04.5:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Recommended Concurrencies:

Info: Subprober is improved with higher concurrency and accuracy for probings and recommend the users to use the concurrencies less which is efficient and accurate for probing

• 30-50 : this range of concurrency can be given when probing for more than 50K+ Subdomains, ips, domains etc..
• 50-80 : this range of concurrency can be given when probing for more than 100K+ Subdomains, ips, domains etc..
• 100-120 : this range of concurrency can be given when probing for more than 150K+ Subdomains, ips, domains etc..

Note higher concurrency values may results in inaccurate results because subprober builded with higher concurrency and more accurate than other probing tool with following mentioned concurrency values

v1.0.4

Subprober v1.0.4 - Fast Probing Tool for Penetration Testing

Overview

Subprober v1.0.4 is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

Features in V1.0.4:

• Subprober Concurrency and Accuracy are Improved with libraries like aiohttp,asyncio
• Subprober Error handling and Synchronization are improved
• Resolved some Bugs for Subprober
• Subprober Commands are changed with usefull flags