Skip to content

Commit 2390f90

Browse files
Ignacio Van Droogenbroeckclaude
andcommitted
feat: Update performance metrics to 2.42M RPS with improved latency
Update throughput from 2.01M/2.32M to 2.42M records/sec across all documentation to reflect latest benchmarks with authentication enabled and token caching. Updated latency metrics: - p50: 6.75ms → 1.74ms (78x improvement vs row format) - p95: 39.46ms → 28.13ms (30x improvement vs row format) - p99: 59.09ms → 45.27ms (34x improvement vs row format) Updated files: - Homepage and features components - Introduction and getting started guides - Performance benchmarks documentation - Installation guides (Docker and native) - Advanced features (WAL, compaction) - Integration guides Co-Authored-By: Claude <noreply@anthropic.com>
1 parent 4ab70d7 commit 2390f90

10 files changed

Lines changed: 24 additions & 24 deletions

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ Official documentation for [Arc](https://github.com/basekick-labs/arc) - the fas
44

55
## About
66

7-
This repository contains the documentation website for Arc, a high-performance time-series data warehouse built on DuckDB and Parquet. Arc achieves 36.43s on ClickBench (99.9M rows) and delivers 2.01M records/sec ingestion.
7+
This repository contains the documentation website for Arc, a high-performance time-series data warehouse built on DuckDB and Parquet. Arc achieves 36.43s on ClickBench (99.9M rows) and delivers 2.42M records/sec ingestion.
88

99
Visit the live documentation at [docs.basekick.net](https://docs.basekick.net)
1010

docs/advanced/compaction.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -25,10 +25,10 @@ Compaction is **enabled by default** and runs automatically every hour.
2525

2626
### The Small File Problem
2727

28-
Arc's high-performance ingestion (2.01M records/sec) creates many small files:
28+
Arc's high-performance ingestion (2.42M records/sec) creates many small files:
2929

3030
```
31-
At 2.01M records/sec with 5-second flush:
31+
At 2.42M records/sec with 5-second flush:
3232
→ 10M records every 5 seconds
3333
→ 12 files per minute per measurement
3434
→ 720 files per hour per measurement

docs/advanced/wal.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ There are **two different WAL features** in Arc:
2121
WAL is an optional durability feature that persists all incoming data to disk **before** acknowledging writes. When enabled, Arc guarantees that data can be recovered even if the instance crashes.
2222

2323
:::info
24-
WAL is **disabled by default** to maximize throughput (2.01M records/sec). Enable it when zero data loss is required.
24+
WAL is **disabled by default** to maximize throughput (2.42M records/sec). Enable it when zero data loss is required.
2525
:::
2626

2727
### When to Enable WAL
@@ -32,15 +32,15 @@ Enable WAL if you need:
3232
- **Recovery from unexpected failures** (power loss, OOM kills)
3333

3434
Keep WAL disabled if you:
35-
- **Prioritize maximum throughput** (2.01M records/sec)
35+
- **Prioritize maximum throughput** (2.42M records/sec)
3636
- **Can tolerate 0-5 seconds data loss** on rare crashes
3737
- **Have client-side retry logic** or message queue upstream
3838

3939
### Performance vs Durability Tradeoff
4040

4141
| Configuration | Throughput | Data Loss Risk |
4242
|--------------|-----------|----------------|
43-
| **No WAL (default)** | 2.01M rec/s | 0-5 seconds |
43+
| **No WAL (default)** | 2.42M rec/s | 0-5 seconds |
4444
| **WAL + async** | 1.67M rec/s (-17%) | &lt;1 second |
4545
| **WAL + fdatasync** | 1.63M rec/s (-19%) | Near-zero |
4646
| **WAL + fsync** | 1.67M rec/s (-17%) | Zero |
@@ -403,7 +403,7 @@ $ du -sh ./data/wal
403403
### Performance Degradation with WAL
404404

405405
**Symptoms:**
406-
- Throughput dropped from 2.01M to 600K rec/s
406+
- Throughput dropped from 2.42M to 600K rec/s
407407
- High CPU usage from fsync calls
408408

409409
**Solutions:**

docs/installation/docker.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -171,7 +171,7 @@ docker-compose up -d --build
171171

172172
## Performance Considerations
173173

174-
Docker deployment achieves **~570K records/sec** write throughput. For maximum performance (2.01M RPS), use [native deployment](/arc/installation/native).
174+
Docker deployment achieves **~570K records/sec** write throughput. For maximum performance (2.42M RPS), use [native deployment](/arc/installation/native).
175175

176176
### Optimize Docker Performance
177177

docs/installation/native.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ sidebar_position: 2
44

55
# Native Installation
66

7-
Install Arc natively for **maximum performance**. Native deployment achieves **2.01M records/sec** (3.5x faster than Docker).
7+
Install Arc natively for **maximum performance**. Native deployment achieves **2.42M records/sec** (3.5x faster than Docker).
88

99
## Prerequisites
1010

@@ -203,8 +203,8 @@ pip install uvloop httptools orjson
203203
| Backend | Performance | Use Case |
204204
|---------|-------------|----------|
205205
| **Local NVMe** | 2.08M RPS | Maximum performance, single-node |
206-
| **Local SSD** | 2.01M RPS | High performance, single-node |
207-
| **MinIO** | 2.01M RPS | Distributed, multi-tenant |
206+
| **Local SSD** | 2.42M RPS | High performance, single-node |
207+
| **MinIO** | 2.42M RPS | Distributed, multi-tenant |
208208
| **AWS S3** | 1.5M RPS | Cloud, unlimited scale |
209209

210210
**Recommendation**:

docs/integrations/telegraf.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ Arc is compatible with InfluxDB Line Protocol, making it a perfect drop-in repla
1313
**Benefits:**
1414
- No configuration changes needed
1515
- All Telegraf plugins work unchanged
16-
- 8x faster than InfluxDB (2.01M RPS)
16+
- 8x faster than InfluxDB (2.42M RPS)
1717
- Lower cost with object storage
1818
- Full SQL analytics with DuckDB
1919

docs/intro.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,11 +5,11 @@ slug: /
55

66
# Welcome to Arc
77

8-
Arc is a high-performance time-series data warehouse built on DuckDB, Parquet, and flexible storage backends. It achieves **2.01M records/sec ingestion** and is the **fastest time-series database**.
8+
Arc is a high-performance time-series data warehouse built on DuckDB, Parquet, and flexible storage backends. It achieves **2.42M records/sec ingestion** and is the **fastest time-series database**.
99

1010
## Key Features
1111

12-
- **High-Performance Ingestion**: 2.01M records/sec with MessagePack binary protocol
12+
- **High-Performance Ingestion**: 2.42M records/sec with MessagePack binary protocol
1313
- **Fast Analytical Queries**: Powered by DuckDB with full SQL support
1414
- **Flexible Storage**: Local filesystem, MinIO, AWS S3, or Google Cloud Storage
1515
- **Multi-Database Architecture**: Organize data by environment, tenant, or application

docs/performance/benchmarks.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -193,16 +193,16 @@ Arc achieves exceptional write throughput through MessagePack columnar binary pr
193193

194194
| Wire Format | Throughput | p50 Latency | p95 Latency | p99 Latency | Notes |
195195
|-------------|------------|-------------|-------------|-------------|-------|
196-
| **MessagePack Columnar** | **2.32M RPS** | **6.75ms** | **39.46ms** | **59.09ms** | Zero-copy passthrough (RECOMMENDED) |
196+
| **MessagePack Columnar** | **2.42M RPS** | **1.74ms** | **28.13ms** | **45.27ms** | Zero-copy passthrough + auth cache (RECOMMENDED) |
197197
| **MessagePack Row** | **908K RPS** | **136.86ms** | **851.71ms** | **1542ms** | Legacy format with conversion overhead |
198198
| **Line Protocol** | **240K RPS** | N/A | N/A | N/A | InfluxDB compatibility mode |
199199

200200
**Columnar Format Advantages:**
201-
- **2.55x faster throughput** vs row format (2.32M vs 908K RPS)
202-
- **20x lower p50 latency** (6.75ms vs 136.86ms)
203-
- **21x lower p95 latency** (39.46ms vs 851.71ms)
204-
- **26x lower p99 latency** (59.09ms vs 1542ms)
205-
- **67x fewer errors** under load (63 vs 4,211 errors at 2.5M target RPS)
201+
- **2.66x faster throughput** vs row format (2.42M vs 908K RPS)
202+
- **78x lower p50 latency** (1.74ms vs 136.86ms)
203+
- **30x lower p95 latency** (28.13ms vs 851.71ms)
204+
- **34x lower p99 latency** (45.27ms vs 1542ms)
205+
- **Near-zero authentication overhead** with 30s token cache
206206

207207
**Test Configuration**:
208208
- Hardware: Apple M3 Max (14 cores)

src/components/HomepageFeatures/index.tsx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -22,10 +22,10 @@ const FeatureList: FeatureItem[] = [
2222
},
2323
{
2424
title: 'Massive Throughput',
25-
icon: '2.01M',
25+
icon: '2.42M',
2626
description: (
2727
<>
28-
Ingest 2.01M records/sec with MessagePack binary protocol.
28+
Ingest 2.42M records/sec with MessagePack binary protocol.
2929
Built for IoT sensors, metrics collection, and observability platforms that need extreme write performance.
3030
</>
3131
),

src/pages/index.tsx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ function HomepageHeader() {
3131
</Link>
3232
</div>
3333
<div style={{marginTop: '2rem', fontSize: '1.2rem', opacity: 0.9}}>
34-
<strong>36.43s</strong> ClickBench cold run • <strong>2.01M</strong> records/sec • <strong>205+</strong> GitHub stars
34+
<strong>36.43s</strong> ClickBench cold run • <strong>2.42M</strong> records/sec • <strong>205+</strong> GitHub stars
3535
</div>
3636
</div>
3737
</header>
@@ -42,7 +42,7 @@ export default function Home(): ReactNode {
4242
return (
4343
<Layout
4444
title="Arc - Fastest Time-Series Database"
45-
description="Arc is the fastest time-series database. 36.43s cold run on ClickBench, 2.01M records/sec ingestion, powered by DuckDB and Parquet.">
45+
description="Arc is the fastest time-series database. 36.43s cold run on ClickBench, 2.42M records/sec ingestion, powered by DuckDB and Parquet.">
4646
<HomepageHeader />
4747
<main>
4848
<HomepageFeatures />

0 commit comments

Comments
 (0)