Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
186 commits
Select commit Hold shift + click to select a range
88b2635
chore: ci/cd workflow improvements and fixes (#6127)
esteban Mar 9, 2026
e7eb014
chore: release beta version 4.0.0-beta.8
Mar 10, 2026
31de8d4
fix: replace `fetch_arrow_table` with `to_arrow_table` (#6146)
BubbleCal Mar 10, 2026
0681a08
perf: parallelize FTS prewarming (#6144)
BubbleCal Mar 10, 2026
e1aa70a
ci: fix pinned auth action ref in benchmarks workflow (#6153)
Xuanwo Mar 10, 2026
6be1b58
docs: document the rules for transaction conflicts (#6158)
westonpace Mar 10, 2026
3ccd602
fix: handle DataType::Null in adjust_child_validity to prevent panic …
wjones127 Mar 11, 2026
be5f439
fix: persist frag reuse index external file on local filesystem (#6163)
wjones127 Mar 11, 2026
fa64837
feat: clearer progress reporting for IVF (#6126)
wkalt Mar 11, 2026
e133d82
chore: release beta version 4.0.0-beta.9
Mar 11, 2026
31cd8d3
chore: clippy cleanups (#6172)
Xuanwo Mar 12, 2026
98bb073
ci: move Linux and Windows jobs to GitHub-hosted runners (#6175)
Xuanwo Mar 12, 2026
f3e50d7
docs: add alicloud oss configuration (#6167)
FarmerChillax Mar 12, 2026
58f3b84
fix: avoid empty range reads for zero-length blobs (#6168)
Xuanwo Mar 12, 2026
f4adbc0
perf: remove shard content key sorting from distributed merge (#6179)
Xuanwo Mar 12, 2026
c70ee41
perf(inverted)!: reduce fts indexing time and memory (#6174)
BubbleCal Mar 12, 2026
3f74834
chore: release beta version 4.0.0-beta.10
Mar 12, 2026
46826b1
docs: update the rules for data replacement conflicts to reflect real…
westonpace Mar 13, 2026
0851b14
fix: handle nullable validity layers without def levels (#6187)
Xuanwo Mar 13, 2026
311ff1a
fix: preserve merge insert delete-by-source semantics (#6148)
Xuanwo Mar 13, 2026
29075c9
fix: use to_arrow_reader in benchmark datagen (#6190)
Xuanwo Mar 13, 2026
e675fdb
perf(inverted): reuse posting batch builder and merge tail partitions…
BubbleCal Mar 13, 2026
7aa6d33
refactor: rename arrow-scalar to lance-arrow-scalar (#6199)
westonpace Mar 13, 2026
71c6e21
feat: support vector indices in describe_indices filtering (#6145)
ndpvt-web Mar 13, 2026
c9c8c46
fix: memory_limit and num_workers params are not passed to index work…
BubbleCal Mar 13, 2026
e8109ad
chore: release beta version 4.0.0-beta.11
Mar 13, 2026
f02df43
fix: disallowing stale credentials from directory namespace (#6194)
hamersaw Mar 13, 2026
1e7b725
chore: release beta version 4.0.0-beta.12
Mar 13, 2026
f0160c7
feat: enable HNSW-accelerated partition assignment for fp16 vectors (…
wkalt Mar 14, 2026
79ba632
refactor: use the dataset file version to determine index file versio…
westonpace Mar 16, 2026
44b3bd2
feat: add compaction options in manifest config (#6170)
hamersaw Mar 16, 2026
bfe7f56
feat: reduce open file handles during IVF training (#6169)
westonpace Mar 16, 2026
4110d04
fix: preserve create index transaction semantics (#6204)
Xuanwo Mar 16, 2026
50c778e
fix: allow same field name with different type in dataset overwrites …
hamersaw Mar 16, 2026
7790f2c
docs: add example to show how to index JSON column (#6208)
prrao87 Mar 17, 2026
147b957
perf: reuse distance calculator at selecting candidates (#6202)
BubbleCal Mar 17, 2026
0693908
chore: bump lz4_flex patch versions (#6212)
Xuanwo Mar 17, 2026
0a0b831
fix: prewarm all segments for named indices (#6211)
Xuanwo Mar 17, 2026
7b42fd5
fix: prevent duplicate manifest entries from concurrent table creatio…
jmhsieh Mar 17, 2026
fb1566a
fix: add missing type hint for producer function (#6133)
Gallardot Mar 18, 2026
ae9a2cb
fix: maintaining individual fragment operation when calling take_sour…
hamersaw Mar 18, 2026
d59bd23
perf: pre-transpose PQ codebook for SIMD-friendly L2 distance (#5923)
wkalt Mar 18, 2026
023b14b
feat: add file list with sizes to IndexMetadata (#5497)
wjones127 Mar 18, 2026
28db831
docs: fix incorrect URLs and cleanup (#5317)
prrao87 Mar 18, 2026
c9e5b1e
feat: add index segment commit API (#6209)
Xuanwo Mar 18, 2026
1a8b23d
feat: add abfss:// scheme support for Azure ADLS Gen2 (#6192)
burlacio Mar 18, 2026
f404d0e
docs: document vector index RAM (training) & storage requirements (#6…
westonpace Mar 18, 2026
416f5a6
feat: support atomic multi-table transactions via namespace manifest …
XuQianJin-Stars Mar 19, 2026
60cae4c
chore: release beta version 4.0.0-beta.13
Mar 19, 2026
674ccce
docs: remove legacy preview index note (#6218)
Xuanwo Mar 19, 2026
15e16cd
chore: bump main to 4.1.0-beta.0
Mar 19, 2026
42581d4
perf: new layout for positions and new algo for phrase query (#6203)
BubbleCal Mar 20, 2026
43c7f0b
fix: 2.1/2.2 panic when a list column had small values and many empty…
westonpace Mar 20, 2026
382d8d3
feat: bounding source fragments for compaction execution (#6232)
hamersaw Mar 20, 2026
a5e5104
fix: filter out detached versions when scanning manifests (#6245)
jackye1995 Mar 20, 2026
63d923b
fix: like queries with a prefix should be accelerated by btree and zo…
jackye1995 Mar 20, 2026
e143cba
feat: allow setting transaction properties in various operations (#6246)
jackye1995 Mar 21, 2026
13a929c
chore(deps): bump tar from 0.4.44 to 0.4.45 (#6244)
dependabot[bot] Mar 21, 2026
630dbfa
build: remove legacy rustls-webpki 0.101.7 and bump 0.103.10 (#6249)
Xuanwo Mar 21, 2026
b80fbb3
refactor: distributed vector segment build (#6220)
Xuanwo Mar 21, 2026
88c627b
chore: release beta version 4.1.0-beta.1
Mar 22, 2026
727a45c
fix: adding namespace support to java SDK CommitBuilder from dataset …
hamersaw Mar 23, 2026
0302473
chore: release beta version 4.1.0-beta.2
Mar 23, 2026
baa13ab
fix: resolve_latest_location converts errors to not_found uncondition…
wkalt Mar 23, 2026
384fb55
perf: batched WAND and new WAND structure, ~50% faster (#6241)
BubbleCal Mar 23, 2026
1d4052c
fix: return errors for unsupported fixed-size-list child types (#6253)
myandpr Mar 23, 2026
40929fe
feat: add OpenDAL Azdls backend for abfss:// with use_opendal flag (#…
burlacio Mar 23, 2026
244c721
chore: release beta version 4.1.0-beta.3
Mar 23, 2026
30cad43
test: fix flaky distributed vector build results test (#6268)
myandpr Mar 24, 2026
8b4a926
fix: handle list-level NULLs in NOT filters (#6044)
fenfeng9 Mar 24, 2026
66404ca
refactor!: remove staging from distributed vector indexing (#6269)
Xuanwo Mar 24, 2026
b678812
test: stabilize distributed IVF grouped build query test (#6281)
myandpr Mar 24, 2026
f2d2068
fix: pass dataset_options to SafeLanceDataset in worker processes (#6…
eddyxu Mar 24, 2026
d3803a9
fix: respect the old data filter on inverted index (#6216)
westonpace Mar 24, 2026
75f0195
feat(DirectoryNamespace): support index and transaction related opera…
zhangyue19921010 Mar 25, 2026
e2231fd
feat: add aimd throttled object store (#6266)
westonpace Mar 25, 2026
d016a82
feat: support stop-word gaps in phrase queries (#6277)
BubbleCal Mar 25, 2026
a6b033c
fix: support hamming distance in IndicesBuilder (#6295)
jmhsieh Mar 25, 2026
305b729
perf: add benchmark for distributed vector merge finalization (#6176)
Xuanwo Mar 26, 2026
ee324f4
refactor: move DatasetIndexExt out of lance-index (#6280)
Xuanwo Mar 26, 2026
c54f529
fix: restore namespace build after DatasetIndexExt move (#6302)
Xuanwo Mar 26, 2026
3a82648
feat: actually using namespace error variants (#6275)
hamersaw Mar 26, 2026
2ad415a
fix: multiple improvements for gh workflows (#6306)
esteban Mar 26, 2026
f0aa55f
feat!: support sampling selected fragments (#6294)
Xuanwo Mar 26, 2026
7f6fd0e
feat(java): add non-blocking AsyncScanner with CompletableFuture API …
beinan Mar 26, 2026
8c99eef
fix(namespace): support nested types in convert_json_arrow_type (#6300)
jiaoew1991 Mar 27, 2026
08ec995
feat: add a fast dataset version ID API (#6303)
BubbleCal Mar 27, 2026
8b8e36a
feat: clarify logical indices and physical index segments (#6270)
Xuanwo Mar 27, 2026
05c796c
docs: shorten core major release vote window (#6154)
Xuanwo Mar 27, 2026
9b43852
test: tighten multi-segment vector index coverage and cleanup (#6251)
Xuanwo Mar 27, 2026
92c45f6
feat: support non-shared centroid vector index builds (#6296)
Xuanwo Mar 27, 2026
55311f8
feat(python): add storage_options to IvfModel and PqModel save/load (…
hushengquan Mar 27, 2026
36e8b2d
perf: optimize stable row_id index build from O(rows) to O(fragments)…
jiaoew1991 Mar 27, 2026
209f99b
feat: move rate limiting to the object store (#6293)
westonpace Mar 27, 2026
75b8d2a
chore: bump to 5.0.0-beta.1 based on breaking change detection
Mar 27, 2026
2a4daf1
docs: add conflict handling and FRI guidance (#6304)
westonpace Mar 28, 2026
7342abf
feat: pluggable index cache via CacheBackend trait (#6222)
wjones127 Mar 29, 2026
277db86
chore: cleanup dead functions and dead_code annotations (#6314)
Xuanwo Mar 30, 2026
38454c8
docs(python): prefer uv for local environment setup (#6335)
Xuanwo Mar 30, 2026
26bf8f3
feat: add write progress callback to InsertBuilder (#6318)
wjones127 Mar 30, 2026
30eceac
feat: support hamming distance in HNSW (#6336)
BubbleCal Mar 30, 2026
34e311c
chore: release beta version 5.0.0-beta.2
Mar 30, 2026
ee71812
feat: make MAX_MINIBLOCK_VALUES configurable via env var (#6340)
westonpace Mar 30, 2026
0c754aa
fix: use StorageOptions::new() in cloud providers to pick up env vars…
westonpace Mar 30, 2026
2e10283
perf: remove O(n²) performance regression in take() with duplicate in…
YSBF Mar 31, 2026
da46e7e
refactor: remove row-id ordering from vector index merge (#6332)
Xuanwo Mar 31, 2026
b7f6baa
fix: avoid full scan for nullable vector fragment sampling (#6341)
Xuanwo Mar 31, 2026
c869512
fix: respect fragment filters during distributed worker training (#6358)
Xuanwo Mar 31, 2026
507dd6f
feat: expose stable row ids (#6325)
ivscheianu Mar 31, 2026
3c35f48
feat: change default file format version to 2.1 (#6115)
westonpace Mar 31, 2026
0f08160
feat: support distributed IVF_RQ segment builds (#6359)
Xuanwo Mar 31, 2026
03dd364
feat: expose stable row ids (#6325)
ivscheianu Mar 31, 2026
65e2ad0
chore(deps): bump pygments from 2.19.2 to 2.20.0 in /python (#6348)
dependabot[bot] Mar 31, 2026
d4df618
docs: clarify helper function guidance in AGENTS.md (#6357)
Xuanwo Mar 31, 2026
88d8faf
feat: io_uring based file reader (#5777)
westonpace Mar 31, 2026
526a72f
feat: expose branch_identifier in python and java bindings (#6360)
majin1102 Apr 1, 2026
1ef6310
refactor!: align distributed index build around segments (#6313)
Xuanwo Apr 1, 2026
21ae66b
feat: add an arrow-stats crate with the ability to calculate basic st…
westonpace Apr 1, 2026
932d4aa
feat: support DataFusion Expr in DeleteBuilder (#6343)
wjones127 Apr 1, 2026
b08528e
fix: preserve index details in python index metadata (#6279)
Xuanwo Apr 1, 2026
175a492
perf: reduce bitmap index build to 1 bitmap in RAM (#6371)
wkalt Apr 1, 2026
21d830a
feat: support bf16 from pytorch dataset (#6342)
eddyxu Apr 1, 2026
1a1094d
feat: object store decides scheduler type (#6373)
westonpace Apr 1, 2026
d13d7d8
refactor!: cleanup namespace related APIs (#6186)
jackye1995 Apr 2, 2026
5504998
chore: release beta version 5.0.0-beta.3
Apr 2, 2026
402f7b7
feat: support vector query pruning by index segments (#6376)
Xuanwo Apr 2, 2026
8b59eb6
feat: support ingest mode for external blob writes (#6356)
Xuanwo Apr 2, 2026
8bd9b90
perf: fix O(N²) version column scan with deletion vectors (#6375)
pengw0048 Apr 2, 2026
2b62004
fix: ensure durable writes actually wait for WAL flush (#6368)
hamersaw Apr 2, 2026
cc89488
feat!: add progress monitoring via callbacks for distributed merge (#…
vivek-bharathan Apr 2, 2026
a97c647
fix: preserve multipart part ordering in throttle wrapper (#6393)
westonpace Apr 2, 2026
d9068e7
chore: release beta version 5.0.0-beta.4
Apr 2, 2026
b36df7d
chore(deps): bump requests from 2.32.5 to 2.33.0 in /python (#6299)
dependabot[bot] Apr 2, 2026
36b344f
feat: thread data_size through decode pipeline (#6391)
westonpace Apr 2, 2026
f810c7b
chore(python): sync uv lock (#6401)
Xuanwo Apr 3, 2026
b98670b
fix: remove legacy tempfile save of IVF centroids in GPU training pat…
hushengquan Apr 3, 2026
effca10
feat: refine logical vector index into an IVF view (#6400)
Xuanwo Apr 3, 2026
408a951
refactor: rename "region" to "shard" in mem_wal implementation (#6367)
hamersaw Apr 3, 2026
01a25e9
feat: optimize one segmented vector segment per run (#6402)
Xuanwo Apr 3, 2026
8a06079
chore(deps): bump aiohttp from 3.12.15 to 3.13.4 in /python (#6379)
dependabot[bot] Apr 3, 2026
2c20d75
feat: support index build progress callbacks in Python bindings (#6394)
vivek-bharathan Apr 3, 2026
3c8fe53
feat(namespace): add count_table_rows, insert_into_table, query_table…
XuQianJin-Stars Apr 4, 2026
d630106
chore: release beta version 5.0.0-beta.5
Apr 4, 2026
efc9374
feat: validate DataFile column_indices at commit time (#6414)
westonpace Apr 6, 2026
6199e6c
docs: document DataFile column_indices changes in 2.1 format (#6416)
westonpace Apr 6, 2026
a43e725
fix: implement RowIdMeta.asdict() and from_dict() for stable row ID s…
pengw0048 Apr 6, 2026
4f6e3c1
fix: avoid corrupting sub-schema merge_insert pages on v2.2 (#6420)
Xuanwo Apr 7, 2026
54196a2
feat(java): add allowExternalBlobOutsideBases to WriteParams (#6330)
beinan Apr 7, 2026
4e61245
fix: skip legacy validation for Overwrite operations (#6418)
hamersaw Apr 7, 2026
774d1bd
feat: introduce `CacheCodec` for serializing index cache entries (#6223)
wjones127 Apr 7, 2026
83ae74b
docs: add community sync to docs (#6434)
ccmao1130 Apr 8, 2026
87ef5e2
test: fix vector progress callback timing assertion (#6437)
Xuanwo Apr 8, 2026
5310f36
feat: support IVF partitions multi-split (#6423)
BubbleCal Apr 8, 2026
40d09bf
feat: add batch_size_bytes to encoding decode stream (#6388)
westonpace Apr 8, 2026
6112a34
feat: add DataFile.create helper for building DataFile metadata (#6427)
westonpace Apr 8, 2026
25a2020
feat(java): add Dataset.getZonemapStats() API (#6421)
beinan Apr 8, 2026
943e14a
fix: implement next page token support in list namespaces and tables …
ayao227 Apr 8, 2026
c04c585
fix: return error instead of OOM on corrupt binary page offsets (#6392)
westonpace Apr 8, 2026
a7aba1f
fix(namespace): remove trailing empty query in table uri (#6415)
jackye1995 Apr 8, 2026
46650e6
fix(merge_insert): use sentinel column for NULL-safe source row detec…
pratik0316 Apr 8, 2026
d503b8e
ci: add explicit permissions to GitHub Actions workflows (#6440)
wjones127 Apr 8, 2026
05c7ff9
feat(python): add blob-aware to_pandas (#6424)
BubbleCal Apr 9, 2026
9b177ad
chore: release beta version 5.0.0-beta.6
Apr 9, 2026
5f4bf81
feat: add configurable FTS index prewarm options (#6298)
BubbleCal Apr 9, 2026
7c39a31
chore: bump main to 5.1.0-beta.0
Apr 9, 2026
bec9491
fix: warn and clamp LANCE_INITIAL_UPLOAD_SIZE instead of panicking (#…
LuciferYang Apr 9, 2026
f2db129
chore: upgrade Rust toolchain to 1.94.0 (#6460)
wjones127 Apr 9, 2026
a57ec81
feat(index): support float16 and float64 in IVF_FLAT (#6476)
BubbleCal Apr 10, 2026
103e947
chore: release beta version 5.1.0-beta.1
Apr 10, 2026
e7369fb
feat: wire batch_size_bytes to Python and public Rust API (#6428)
westonpace Apr 10, 2026
5aca703
chore: remove custom cast_with_options in favor of upstream (#6344)
wjones127 Apr 10, 2026
6db7525
feat: clean up transaction files on failed commits (#6319)
wjones127 Apr 10, 2026
df61d95
chore: release beta version 5.1.0-beta.2
Apr 11, 2026
0634c6a
fix(index): preserve fts prewarm position codec (#6485)
BubbleCal Apr 11, 2026
8ac0741
fix: include column_metadatas and column_infos in CachedFileMetadata:…
jiaoew1991 Apr 11, 2026
7a65e88
fix: handle FlatBin quantization in optimize_vector_indices_v2 (#6488)
jackye1995 Apr 11, 2026
0a0d53b
chore: release beta version 5.1.0-beta.3
Apr 11, 2026
dabfb93
fix: use logical OR instead of bitwise OR in conflict resolver (#6492)
dentiny Apr 13, 2026
27351e5
fix: keep delete-by-source fast path with scalar indexes (#6435)
Xuanwo Apr 13, 2026
9931ace
perf: intern DataFile fields/column_indices to reduce manifest memory…
beinan Apr 13, 2026
23526f6
perf: intern RowDatasetVersionMeta inline bytes to reduce manifest me…
beinan Apr 14, 2026
d37348d
feat(dictionary-namespace): support table related operation (#6308)
zhangyue19921010 Apr 14, 2026
97a89a6
chore: add tracing instrumentation to mem_wal module (#6430)
hamersaw Apr 14, 2026
9df651b
perf: submit I/O requests eagerly in FullZipScheduler (#6513)
hushengquan Apr 14, 2026
9672573
feat: add configurable blob v2 pack file size (#6508)
hamersaw Apr 14, 2026
b775da2
feat: add NamespaceClientTableContext for cached namespace info acros…
jackye1995 Apr 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .bumpversion.toml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[tool.bumpversion]
current_version = "4.0.0-beta.7"
current_version = "5.1.0-beta.3"
parse = "(?P<major>\\d+)\\.(?P<minor>\\d+)\\.(?P<patch>\\d+)(-(?P<prerelease>(beta|rc))\\.(?P<prerelease_num>\\d+))?"
serialize = [
"{major}.{minor}.{patch}-{prerelease}.{prerelease_num}",
Expand Down
4 changes: 2 additions & 2 deletions .github/actions/setup-release-env/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ runs:
using: "composite"
steps:
- name: Set up Python
uses: actions/setup-python@v4
uses: actions/setup-python@7f4fc3e22c37d6ff65e88745f38bd3157c663f7c # v4
with:
python-version: "3.11"

Expand All @@ -14,7 +14,7 @@ runs:
pip install bump-my-version packaging PyGithub PyYAML

- name: Set up Rust
uses: actions-rs/toolchain@v1
uses: actions-rs/toolchain@16499b5e05bf2e26879000db0c1d13f7e13fa3af # v1
with:
toolchain: stable
override: true
Expand Down
7 changes: 5 additions & 2 deletions .github/workflows/approve-rc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,9 @@ on:
default: false
type: boolean

permissions:
contents: read

jobs:
approve-rc:
runs-on: ubuntu-latest
Expand All @@ -27,7 +30,7 @@ jobs:
run: echo "${{ toJSON(github.event.inputs) }}"

- name: Check out repository
uses: actions/checkout@v4
uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
token: ${{ secrets.LANCE_RELEASE_TOKEN }}
fetch-depth: 0
Expand Down Expand Up @@ -73,7 +76,7 @@ jobs:

- name: Create GitHub Release (if not dry run)
if: ${{ !inputs.dry_run }}
uses: softprops/action-gh-release@v2
uses: softprops/action-gh-release@a06a81a03ee405af7f2048a818ed3f03bbf83c7b # v2
with:
tag_name: ${{ steps.approve.outputs.STABLE_TAG }}
name: ${{ steps.approve.outputs.STABLE_TAG }}
Expand Down
8 changes: 6 additions & 2 deletions .github/workflows/benchmark-comment-trigger.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,10 @@ on:
issue_comment:
types: [created]

permissions:
contents: read
pull-requests: read

jobs:
forward-to-bench:
# Only process comments on PRs that mention @bench-bot and contain 'benchmark'
Expand All @@ -24,7 +28,7 @@ jobs:
steps:
- name: Get PR details
id: pr
uses: actions/github-script@v7
uses: actions/github-script@f28e40c7f34bde8b3046d885e986cb6290c5673b # v7
with:
script: |
const pr = await github.rest.pulls.get({
Expand All @@ -36,7 +40,7 @@ jobs:
core.setOutput('head_sha', pr.data.head.sha);

- name: Forward to lance-bench
uses: peter-evans/repository-dispatch@v2
uses: peter-evans/repository-dispatch@bf47d102fdb849e755b0b0023ea3e81a44b6f570 # v2
with:
token: ${{ secrets.LANCE_BENCH_DISPATCH_TOKEN }}
repository: lancedb/lance-bench
Expand Down
9 changes: 6 additions & 3 deletions .github/workflows/benchmarks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@ name: Run benchmarks
on:
workflow_dispatch:

permissions:
contents: read

jobs:
dataset:
timeout-minutes: 30
Expand All @@ -11,12 +14,12 @@ jobs:
matrix:
dataset: ["sift"]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
fetch-depth: 0
lfs: true
- name: Set up Python
uses: actions/setup-python@v4
uses: actions/setup-python@7f4fc3e22c37d6ff65e88745f38bd3157c663f7c # v4
with:
python-version: "3.10"
- uses: ./.github/workflows/build_linux_wheel
Expand All @@ -32,7 +35,7 @@ jobs:
run: |
./test_dataset.sh
- name: Archive results
uses: actions/upload-artifact@v3
uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4
with:
name: ${{ matrix.dataset }}-results
path: |
Expand Down
9 changes: 6 additions & 3 deletions .github/workflows/buf-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,16 +11,19 @@ on:
default: ''
type: string

permissions:
contents: read

jobs:
push-module:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
ref: ${{ inputs.ref || github.ref }}
fetch-depth: 0
lfs: true
- uses: bufbuild/buf-setup-action@v1
- uses: bufbuild/buf-push-action@v1
- uses: bufbuild/buf-setup-action@a47c93e0b1648d5651a065437926377d060baa99 # v1.50.0
- uses: bufbuild/buf-push-action@a654ff18effe4641ebea4a4ce242c49800728459 # v1.2.0
with:
buf_token: ${{ secrets.BUF_TOKEN }}
6 changes: 3 additions & 3 deletions .github/workflows/build_linux_wheel/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ runs:
rm -f python/target/wheels/pylance-*.whl || true
- name: Build x86_64 Manylinux2014 wheel
if: ${{ inputs.arm-build == 'false' && inputs.manylinux == '2_17' }}
uses: PyO3/maturin-action@v1
uses: PyO3/maturin-action@04ac600d27cdf7a9a280dadf7147097c42b757ad # v1
with:
command: build
working-directory: python
Expand All @@ -48,7 +48,7 @@ runs:
&& rm /tmp/protoc.zip
- name: Build x86_64 Manylinux {manylinux} wheel
if: ${{ inputs.arm-build == 'false' && inputs.manylinux != '2_17' }}
uses: PyO3/maturin-action@v1
uses: PyO3/maturin-action@04ac600d27cdf7a9a280dadf7147097c42b757ad # v1
with:
command: build
working-directory: python
Expand All @@ -67,7 +67,7 @@ runs:
&& rm /tmp/protoc.zip
- name: Build Arm Manylinux Wheel
if: ${{ inputs.arm-build == 'true' }}
uses: PyO3/maturin-action@v1
uses: PyO3/maturin-action@04ac600d27cdf7a9a280dadf7147097c42b757ad # v1
with:
command: build
working-directory: python
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/build_mac_wheel/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ runs:
run: |
brew install protobuf
- name: Build wheel
uses: PyO3/maturin-action@v1
uses: PyO3/maturin-action@04ac600d27cdf7a9a280dadf7147097c42b757ad # v1
with:
command: build
args: ${{ inputs.args }}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build_windows_wheel/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,12 +22,12 @@ runs:
Add-Content $env:GITHUB_PATH "C:\protoc\bin"
shell: powershell
- name: Build wheel
uses: PyO3/maturin-action@v1
uses: PyO3/maturin-action@04ac600d27cdf7a9a280dadf7147097c42b757ad # v1
with:
command: build
args: ${{ inputs.args }}
working-directory: python
- uses: actions/upload-artifact@v4
- uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4
with:
name: windows-wheels
path: python\target\wheels
23 changes: 14 additions & 9 deletions .github/workflows/cargo-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,11 +24,15 @@ env:
CARGO_INCREMENTAL: "0"
RUSTFLAGS: "-C debuginfo=0"

permissions:
contents: read

jobs:
build:
# Needs additional disk space for the full build.
runs-on: warp-ubuntu-latest-x64-8x
runs-on: ubuntu-24.04-8x
permissions:
contents: read
id-token: write
timeout-minutes: 60
env:
Expand All @@ -39,7 +43,7 @@ jobs:
run:
working-directory: .
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
- name: Check if stable release
id: check_version
run: |
Expand All @@ -60,19 +64,20 @@ jobs:
echo "Stable version detected: $TAG"
echo "skip=false" >> $GITHUB_OUTPUT
fi
- uses: Swatinem/rust-cache@v2
- uses: Swatinem/rust-cache@779680da715d629ac1d338a641029a2f4372abb5 # v2
if: steps.check_version.outputs.skip != 'true'
with:
workspaces: rust
- name: Verify and checkout specified tag
if: github.event_name == 'workflow_dispatch' && steps.check_version.outputs.skip != 'true'
run: |
TAG="${{ github.event.inputs.tag }}"
git fetch --all --tags
if git rev-parse ${{ github.event.inputs.tag }} >/dev/null 2>&1; then
git checkout ${{ github.event.inputs.tag }}
echo "Successfully checked out tag ${{ github.event.inputs.tag }}"
if git rev-parse "$TAG" >/dev/null 2>&1; then
git checkout "$TAG"
echo "Successfully checked out tag $TAG"
else
echo "Error: Tag ${{ github.event.inputs.tag }} does not exist"
echo "Error: Tag $TAG does not exist"
echo "Available tags:"
git tag -l
exit 1
Expand All @@ -85,7 +90,7 @@ jobs:
# Wait until https://github.com/rust-lang/crates-io-auth-action/issues/51 fixed
# - uses: rust-lang/crates-io-auth-action@v1
# id: auth
- uses: albertlockett/publish-crates@v2.2
- uses: albertlockett/publish-crates@85f0989f1298bc3889830b5fc28122c7586efeec # v2.2
if: steps.check_version.outputs.skip != 'true'
with:
# registry-token: ${{ steps.auth.outputs.token }}
Expand All @@ -102,7 +107,7 @@ jobs:
contents: read
issues: write
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
- uses: ./.github/actions/create-failure-issue
with:
job-results: ${{ toJSON(needs) }}
Expand Down
13 changes: 8 additions & 5 deletions .github/workflows/ci-benchmarks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@ on:
branches:
- main

permissions:
contents: read

jobs:
bench_regress:
timeout-minutes: 120
Expand All @@ -19,21 +22,21 @@ jobs:
shell: bash
working-directory: python
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
fetch-depth: 0
lfs: true
- name: Authenticate with GCS
uses: "google-github-actions/auth@v2"
uses: google-github-actions/auth@c200f3691d83b41bf9bbd8638997a462592937ed # v2
with:
credentials_json: "${{ secrets.GCLOUD_BENCH_STORAGE_USER_KEY }}"
- name: Install bencher
uses: bencherdev/bencher@main
uses: bencherdev/bencher@8151077aa7b1bceaac11c4b308265417cae60e2b # v0.5.10
- name: Set up Python
uses: actions/setup-python@v5
uses: actions/setup-python@a26af69be951a213d495a4c3e4e4022e16d87065 # v5
with:
python-version: 3.11 # Ray does not support 3.12 yet.
- uses: Swatinem/rust-cache@v2
- uses: Swatinem/rust-cache@779680da715d629ac1d338a641029a2f4372abb5 # v2
with:
workspaces: python
- name: Install dependencies
Expand Down
21 changes: 9 additions & 12 deletions .github/workflows/claude-code-review.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
name: Claude Code Review

on:
pull_request_target:
pull_request:
types: [opened]
# Optional: Only run on specific file changes
# paths:
Expand All @@ -12,33 +12,30 @@ on:

jobs:
claude-review:
if: github.event.pull_request.author_association != 'FIRST_TIME_CONTRIBUTOR'
# Optional: Filter by PR author
# if: |
# github.event.pull_request.user.login == 'external-contributor' ||
# github.event.pull_request.user.login == 'new-developer' ||
# github.event.pull_request.author_association == 'FIRST_TIME_CONTRIBUTOR'
if: |
github.event.pull_request.author_association == 'MEMBER' ||
github.event.pull_request.author_association == 'OWNER'

runs-on: ubuntu-latest
permissions:
contents: read
pull-requests: write
issues: write
id-token: write

steps:
- name: Checkout repository
uses: actions/checkout@v4
uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
fetch-depth: 1

- name: Run Claude Code Review
id: claude-review
uses: anthropics/claude-code-action@v1
uses: anthropics/claude-code-action@3ac52d0da9f8ec9ca7b4dc23bb477e36ef9c77a9 # v1.0.79
env:
CLAUDE_CODE_SUBPROCESS_ENV_SCRUB: '1'
with:
anthropic_api_key: ${{ secrets.CLAUDE_TOKEN }}
github_token: ${{ secrets.GITHUB_TOKEN }}
allowed_non_write_users: ${{ github.event.pull_request.user.login }}
prompt: |
REPO: ${{ github.repository }}
PR NUMBER: ${{ github.event.pull_request.number }}
Expand All @@ -65,5 +62,5 @@ jobs:
# See https://github.com/anthropics/claude-code-action/blob/main/docs/usage.md
# or https://code.claude.com/docs/en/cli-reference for available options
claude_args: |
--allowed-tools "Bash(gh issue view:*),Bash(gh search:*),Bash(gh issue list:*),Bash(gh pr comment:*),Bash(gh pr diff:*),Bash(gh pr view:*),Bash(gh pr list:*)"
--allowed-tools "Bash(gh pr comment ${{ github.event.pull_request.number }}:*),Bash(gh pr diff ${{ github.event.pull_request.number }}:*),Bash(gh pr view ${{ github.event.pull_request.number }}:*)"
--model "claude-opus-4-6"
19 changes: 12 additions & 7 deletions .github/workflows/claude.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,26 +13,31 @@ on:
jobs:
claude:
if: |
(github.event_name == 'issue_comment' && contains(github.event.comment.body, '@claude')) ||
(github.event_name == 'pull_request_review_comment' && contains(github.event.comment.body, '@claude')) ||
(github.event_name == 'pull_request_review' && contains(github.event.review.body, '@claude')) ||
(github.event_name == 'issues' && (contains(github.event.issue.body, '@claude') || contains(github.event.issue.title, '@claude')))
(
(github.event_name == 'issue_comment' && contains(github.event.comment.body, '@claude') &&
contains(fromJSON('["MEMBER","COLLABORATOR","OWNER","CONTRIBUTOR"]'), github.event.comment.author_association)) ||
(github.event_name == 'pull_request_review_comment' && contains(github.event.comment.body, '@claude') &&
contains(fromJSON('["MEMBER","COLLABORATOR","OWNER","CONTRIBUTOR"]'), github.event.comment.author_association)) ||
(github.event_name == 'pull_request_review' && contains(github.event.review.body, '@claude') &&
contains(fromJSON('["MEMBER","COLLABORATOR","OWNER","CONTRIBUTOR"]'), github.event.review.author_association)) ||
(github.event_name == 'issues' && (contains(github.event.issue.body, '@claude') || contains(github.event.issue.title, '@claude')) &&
contains(fromJSON('["MEMBER","COLLABORATOR","OWNER","CONTRIBUTOR"]'), github.event.issue.author_association))
)
runs-on: ubuntu-latest
permissions:
contents: read
pull-requests: write
issues: write
id-token: write
actions: read # Required for Claude to read CI results on PRs
steps:
- name: Checkout repository
uses: actions/checkout@v4
uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4
with:
fetch-depth: 1

- name: Run Claude Code
id: claude
uses: anthropics/claude-code-action@v1
uses: anthropics/claude-code-action@26ec041249acb0a944c0a47b6c0c13f05dbc5b44 # v1
with:
anthropic_api_key: ${{ secrets.CLAUDE_TOKEN }}
github_token: ${{ secrets.GITHUB_TOKEN }}
Expand Down
Loading
Loading