Bump ORD_SCHEMA_TAG to v0.6.1 and add parquet support#240
Merged
Conversation
Updates the validation and submission workflows to use the latest ord-schema release (was v0.3.93). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
- Track *.parquet via Git LFS. - Accept *.parquet files in submission file-type checks and dataset processing. - Add a parquet pass to the validation matrix (no-op until parquet datasets exist). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
skearnes
changed the title
Drops the unscoped 'push' trigger and the dead push-only checkout step in process_submission. Every job in this workflow already gates its real work on pull_request via if: conditions; the push trigger only re-ran the validation step on direct branch pushes (and on every merge-to-main), duplicating work the PR run already covered and burning LFS bandwidth. Also collapses the now-redundant `github.event_name == 'pull_request'` clauses out of per-job and per-step if: conditions for clarity. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
bdeadman
approved these changes
May 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ORD_SCHEMA_TAGfromv0.3.93tov0.6.1in bothsubmission.ymlandvalidation.yml(3-major-version jump).*.parquetto.gitattributesso parquet datasets are tracked via Git LFS.process_dataset.pyinvocation to accept*.parquetalongside*.pb/*.pbtxt.*.parquetfiles exist indata/).scripts/upload_to_huggingface.pyis already extension-agnostic (diffsdata/**), so no change needed there.Test plan
data/*shards on the existing*.pb*files.*.parquetpass exits cleanly with "Found 0 datasets" per shard.