Skip to content

Commit f9f1777

Browse files
authored
Feature/random seed db test (#250)
* Added seed input for reproducible sampling in pre-production tests workflow * Added seed input for reproducible sampling in prod deploy workflow
1 parent 2cc5758 commit f9f1777

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

.github/workflows/pre_production_tests.yml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,11 @@ on:
1212
description: "The maximum number of SQL test cases to run"
1313
required: false
1414
default: 500
15+
seed:
16+
type: string
17+
description: "Random seed for reproducible sampling (float in [-1.0, 1.0]). Leave blank to auto-generate."
18+
required: false
19+
default: ''
1520

1621
jobs:
1722
run-pre-production-tests:
@@ -20,6 +25,7 @@ jobs:
2025
with:
2126
eval_function: ${{ inputs.eval_function }}
2227
sql_limit: ${{ inputs.sql_limit }}
28+
seed: ${{ inputs.seed }}
2329
secrets:
2430
TEST_API_ENDPOINT: ${{ secrets.TEST_API_ENDPOINT }}
2531
DB_USER: ${{ secrets.DB_USER }}

.github/workflows/production-deploy.yml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,11 @@ on:
1717
required: true
1818
type: string
1919
default: 'main'
20+
seed:
21+
description: 'Random seed for reproducible sampling (float in [-1.0, 1.0]). Leave blank to auto-generate.'
22+
required: false
23+
type: string
24+
default: ''
2025
jobs:
2126
deploy:
2227
uses: lambda-feedback/evaluation-function-workflows/.github/workflows/deploy.yml@deploy-request
@@ -28,6 +33,7 @@ jobs:
2833
version-bump: ${{ inputs.version-bump }}
2934
branch: ${{ inputs.branch }}
3035
run-database-tests: true
36+
seed: ${{ inputs.seed }}
3137

3238
secrets:
3339
aws-key-id: ${{ secrets.LAMBDA_CONTAINER_PIPELINE_AWS_ID }}

0 commit comments

Comments
 (0)