Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
167 commits
Select commit Hold shift + click to select a range
a2cd00b
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
72c17d7
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
1152fb3
feat: add internal benchmarking tool to compare latency and memory fo…
thiyaguk09 May 20, 2026
8a8f635
fix(benchmark): address PR security, cleanup, and type safety comments
thiyaguk09 May 20, 2026
8eb2d72
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
eacb087
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
05f71d9
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 21, 2026
afa53c9
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 21, 2026
c0113c7
refactor: enhance benchmark tool with configurable file sizes and fle…
thiyaguk09 May 21, 2026
683b3f4
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
0c58a9a
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
679fe27
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 25, 2026
d38bfa9
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 25, 2026
2d093dd
feat(storage): enhance benchmark tool with configurable file sizes an…
thiyaguk09 May 25, 2026
b5c81a1
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
fe44861
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
d221bce
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 26, 2026
7c3ee50
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
0a4f5ac
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
8b417f9
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 May 27, 2026
0fcae7d
feat: expand benchmark tool to include stream upload, stream download…
thiyaguk09 May 27, 2026
ef7c4d4
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
e3288e3
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
cfdbf08
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 1, 2026
72218c2
test: add bytes method to mock responses in acl and headers tests
thiyaguk09 Jun 1, 2026
d2d226c
feat: expand benchmark suite with additional file and bucket operatio…
thiyaguk09 Jun 2, 2026
eb547c4
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
1fba172
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
531dd2d
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 2, 2026
fafab27
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
d4b912f
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
19316d1
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 3, 2026
c5be999
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
c0a6220
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
43f4319
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 4, 2026
4865c5d
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
747d276
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
0f2652b
test: add bytes method to mock Gaxios response in acl and headers tests
thiyaguk09 Jun 5, 2026
dbd798f
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 5, 2026
a82723e
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
e366cc2
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
ffd2057
test: add bytes method to mock Gaxios response in acl and headers tests
thiyaguk09 Jun 5, 2026
1be39a9
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 12, 2026
8a0e737
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
4f69ca3
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
2d55123
test: add bytes method to mock Gaxios response in acl and headers tests
thiyaguk09 Jun 5, 2026
dcccbb3
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 15, 2026
17ffbe5
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
3b19434
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
7d5c5ac
test: add bytes method to mock Gaxios response in acl and headers tests
thiyaguk09 Jun 5, 2026
4411d89
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 17, 2026
9379a79
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
2c0e9c8
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
b0f3a85
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 18, 2026
fb221c3
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
696a337
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
3f17517
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 19, 2026
efaaf4b
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
fe055f7
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
8f80c9d
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 22, 2026
e03e122
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
7218474
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
d4ee55c
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
9271939
lint fix
thiyaguk09 Jun 23, 2026
d052763
Merge remote-tracking branch 'upstream/storage-node-18' into chore/34…
thiyaguk09 Jun 23, 2026
de6b408
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
20fcb11
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
9519ae8
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
1819fe4
lint fix
thiyaguk09 Jun 23, 2026
53b1f4e
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 23, 2026
85c50e2
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
0979efb
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
ba27a8f
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
948d035
lint fix
thiyaguk09 Jun 23, 2026
5cb84b0
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 24, 2026
fc44591
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
a81e28d
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
018f71e
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
43fc1e8
lint fix
thiyaguk09 Jun 23, 2026
9e96c48
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 25, 2026
1946ca8
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
bae6491
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
aeb3a02
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
3217d07
lint fix
thiyaguk09 Jun 23, 2026
5efc907
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 26, 2026
6723f3e
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
43fc14b
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
3f1dcdf
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
0d373cf
lint fix
thiyaguk09 Jun 23, 2026
e1c892e
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jun 29, 2026
0a993d6
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
4f16b2e
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
dae5c48
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
b1a54b0
lint fix
thiyaguk09 Jun 23, 2026
060e076
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 1, 2026
de16592
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
82a2239
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
74e6d6b
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
f41a664
lint fix
thiyaguk09 Jun 23, 2026
bebcf50
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 3, 2026
111aa89
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
eaf8c63
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
a5aac31
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
b4ac2f3
lint fix
thiyaguk09 Jun 23, 2026
e7c3e9d
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 7, 2026
20e15b0
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
c9e4407
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
01223bc
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
72b5e10
lint fix
thiyaguk09 Jun 23, 2026
619bc39
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 8, 2026
b0498ea
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
40f27b2
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
4b31465
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
191e96c
lint fix
thiyaguk09 Jun 23, 2026
c2a5d8b
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 9, 2026
38849e1
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
2e8a5c9
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
929c38d
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
560a61b
lint fix
thiyaguk09 Jun 23, 2026
f618f52
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 21, 2026
2161bde
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
b52e1f7
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
58ec490
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
99d0a21
lint fix
thiyaguk09 Jun 23, 2026
4a52c0f
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 22, 2026
487c6e3
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
7920b7e
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
a31e5be
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
d8af687
lint fix
thiyaguk09 Jun 23, 2026
859d802
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 23, 2026
dbd46bc
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
7e8f9ec
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
ad50970
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
ae0485b
lint fix
thiyaguk09 Jun 23, 2026
78ab894
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 24, 2026
6ea2aee
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
321d91d
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
48db3ca
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
2686699
lint fix
thiyaguk09 Jun 23, 2026
e968fe7
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 27, 2026
106c994
fix(storage): Invocation ID is not retained on multipart upload retri…
thiyaguk09 Jul 28, 2026
bebe7f1
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
8975172
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
b984e82
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
58ef9bf
lint fix
thiyaguk09 Jun 23, 2026
b16d16a
fix(storage): Invocation ID is not retained on multipart upload retri…
thiyaguk09 Jul 28, 2026
0551270
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 28, 2026
557b3f5
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 28, 2026
678f64c
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
676e767
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
fd0a8fc
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
c6cbede
lint fix
thiyaguk09 Jun 23, 2026
374f80d
fix(storage): Invocation ID is not retained on multipart upload retri…
thiyaguk09 Jul 28, 2026
7091d61
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 28, 2026
4937d6c
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
6ba890f
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
2ad86cc
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
4f26b73
lint fix
thiyaguk09 Jun 23, 2026
7b78138
fix(storage): Invocation ID is not retained on multipart upload retri…
thiyaguk09 Jul 28, 2026
389d0db
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 29, 2026
9875e06
fix(storage): standardize URL formatting and enhance transport retry
thiyaguk09 May 7, 2026
7ec256e
refactor(storage): remove Service.ts and migrate logic to StorageTran…
thiyaguk09 May 14, 2026
690b5a1
fix(storage): resolve transport and retry issues (#8235)
thiyaguk09 Jun 23, 2026
4e72213
lint fix
thiyaguk09 Jun 23, 2026
81b96dc
fix(storage): Invocation ID is not retained on multipart upload retri…
thiyaguk09 Jul 28, 2026
68a14de
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 30, 2026
41a4359
Merge branch 'storage-node-18' into chore/344856049-gaxios-benchmark
thiyaguk09 Jul 31, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 32 additions & 1 deletion handwritten/storage/internal-tooling/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,4 +40,35 @@ For each invocation of the benchmark, write a new object of random size between
| ElapsedTimeUs | the elapsed time in microseconds the operation took |
| Status | completion state of the operation [OK, FAIL] |
| AppBufferSize | N/A |
| CpuTimeUs | N/A |
| CpuTimeUs | N/A |

---

## Comparative Latency & Memory Benchmarking (`benchmark.ts`)

This benchmark compares the current codebase build against a specified baseline NPM version of `@google-cloud/storage` (e.g. comparing Gaxios migration vs baseline `7.19.0`). It measures latency and throughput metrics for standard upload, stream upload, metadata lookup, standard download, stream download, bucket file listing, file existence checks (Exists), updating metadata (Set Metadata), copying files (Copy File), and deleting files (Delete File) scenarios, while tracking heap memory footprint changes.

### Run Example:

1. **Compile the codebase:**
```bash
cd handwritten/storage
npm run compile
```

2. **Execute the benchmark comparison:**
*(Note: `--experimental-specifier-resolution=node` is recommended for ESM-compiled specifiers in node).*
```bash
node --experimental-specifier-resolution=node build/esm/internal-tooling/benchmark.js --projectid <YOUR_PROJECT_ID> --bucket <YOUR_BUCKET_NAME> --iterations 100 --baseline 7.19.0 --fileSize 10485760 --resumable
```

### CLI Parameters:

| Parameter | Description | Requirement | Default |
| --------- | ----------- | :---: | :---: |
| `--projectid` | Google Cloud Project ID | **Required** | - |
| `--bucket` | Cloud Storage Bucket Name to upload/download files | **Required** | - |
| `--iterations` | Number of iterations for each workload scenario | Optional | `100` |
| `--baseline` | Stable baseline NPM version of `@google-cloud/storage` to compare against | Optional | - |
| `--fileSize` | File size in bytes for benchmark uploads/downloads | Optional | `1024` (1KB) |
| `--resumable` | Force resumable upload for the upload scenarios | Optional | - (default behavior) |
Loading
Loading