Skip to content

Fix hardcoded grain_worker_count in HF data processing pipelines to prevent OOM while running Multimodal SFT via pathway#4552

Open
chiajunglien wants to merge 1 commit into
AI-Hypercomputer:mainfrom
CIeNET-International:emma/fix-multimodalsft
Open

Fix hardcoded grain_worker_count in HF data processing pipelines to prevent OOM while running Multimodal SFT via pathway#4552
chiajunglien wants to merge 1 commit into
AI-Hypercomputer:mainfrom
CIeNET-International:emma/fix-multimodalsft

fix

fa28b05
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Jul 23, 2026 in 7s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

fa28b05 Author: @chiajunglien <em*****en​@cienet.com>, <em****en​@google.com>

(Only the first commit for a unique contributor is listed.)