In today's meeting for "Zarr Performance & Benchmarking (Europe-friendly time)", @joshmoore described the Zarr Implementations project: The Zarr Implementations project collects "data in zarr / n5 format written by different implementations" and tests for compatibility. Zarr Implementations is related to - although distinct from - benchmarking. Specifically: it might be nice to benchmark Zarr Implementations.
With perfcapture's current API, it should be possible to call Zarr Implementations from perfcapture.Workload.run (probably using one perfcapture.Workload class per Zarr implementation).
But it might also be nice to harmonize the API, such that both perfcapture and Zarr Implementations use the same yaml structures to define the workloads.
Related:
In today's meeting for "Zarr Performance & Benchmarking (Europe-friendly time)", @joshmoore described the Zarr Implementations project: The Zarr Implementations project collects "data in zarr / n5 format written by different implementations" and tests for compatibility. Zarr Implementations is related to - although distinct from - benchmarking. Specifically: it might be nice to benchmark
Zarr Implementations.With
perfcapture's current API, it should be possible to callZarr Implementationsfromperfcapture.Workload.run(probably using oneperfcapture.Workloadclass per Zarr implementation).But it might also be nice to harmonize the API, such that both
perfcaptureandZarr Implementationsuse the sameyamlstructures to define the workloads.Related: