Commit 1ebfb3e
Add local training runner and record v1 full training results
Local training infrastructure:
- scripts/run_training.py: CLI training runner with auto-precision
selection (BF16 → FP32 fallback), preflight checks, structured
logging, and status.json for programmatic monitoring
- configs/rtx3090.yaml: RTX 3090 config (batch 8 × 4 accum = 32 eff)
- .gitignore: add output/ directory
v1 full training results (A100, BF16, 10 epochs, 135K train examples):
Overall F1: 0.904 | Precision: 0.907 | Recall: 0.902
Tier 1 recall: 0.722 (target 0.98) FAIL
Tier 2 recall: 0.934 (target 0.95) FAIL
Tier 3 recall: 0.919 (target 0.90) PASS
Tier 4 recall: 0.866 (target 0.85) PASS
Best checkpoint at epoch 5 (F1=0.903). Epochs 6-7 regressed due to
backbone LR drift (train loss spiked 2.96 → 5.81). load_best_model_at_end
correctly restored epoch 5.
Top types: biometric 0.996, url 0.994, email 0.991, ip_address 0.988
Weak types: pin, passport_number, tax_id, bank_account (rare, <0.70 F1)
WandB: https://wandb.ai/datafog/huggingface/runs/pj8furkq
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>1 parent c43788b commit 1ebfb3e
3 files changed
Lines changed: 516 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| 31 | + | |
31 | 32 | | |
32 | 33 | | |
33 | 34 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
0 commit comments