Skip to content

feat: Add P95 latency metrics alongside P99 system-wide#573

Merged
alwayslove2013 merged 3 commits intozilliztech:mainfrom
akhilpathivada:feat/add-p95-latency-metrics-clean
Jul 25, 2025
Merged

feat: Add P95 latency metrics alongside P99 system-wide#573
alwayslove2013 merged 3 commits intozilliztech:mainfrom
akhilpathivada:feat/add-p95-latency-metrics-clean

Conversation

@akhilpathivada
Copy link
Copy Markdown
Contributor

📋 Summary

Adds P95 (95th percentile) latency metrics alongside existing P99 metrics across all VectorDBBench components for more comprehensive performance analysis.

🎯 Motivation

  • P95 provides a middle ground between P99 (slowest 1%) and average latency
  • More actionable for optimization compared to P99 alone
  • Industry standard metric for performance monitoring

🔧 Key Changes

  • Backend: Added P95 calculation in serial, concurrent, and streaming runners
  • Frontend: Added P95 selection option in streaming and concurrent pages
  • Results: Added P95 column to results table and exports
  • Backward Compatibility: Existing result files show 0.0 for P95 metrics

🎮 Usage

# Streaming/Concurrent pages now offer P95 option
latency_type = st.radio("Latency Type", options=["latency_p99", "latency_p95", "latency_avg"])

Results Table:

latency(p99) latency(p95) recall
12.5ms 8.3ms 0.95

🧪 Testing

  • All files compile successfully
  • Backward compatibility with existing result files
  • No breaking changes to existing APIs

📊 Impact

Generic support across all database clients and test cases. Users can now choose between P99 and P95 latency metrics based on their analysis needs.

@akhilpathivada akhilpathivada marked this pull request as ready for review July 24, 2025 19:40
@akhilpathivada
Copy link
Copy Markdown
Contributor Author

/assign @XuanYang-cn @alwayslove2013

@sre-ci-robot
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: akhilpathivada, alwayslove2013
To complete the pull request process, please assign xuanyang-cn after the PR has been reviewed.
You can assign the PR to them by writing /assign @xuanyang-cn in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@alwayslove2013 alwayslove2013 merged commit 0240dd1 into zilliztech:main Jul 25, 2025
4 checks passed
euphoria0-0 pushed a commit to CryptoLabInc/VectorDBBench that referenced this pull request Nov 21, 2025
* feat: Add P95 latency metrics alongside P99 system-wide

* fix serial_runner context manager protocol error

* fix: lint issues
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants