Skip to content

Commit b5be2ad

Browse files
LLLLxmmmliuximeng
andauthored
[recipe, data] feat: TransferQueue - Support managing multiple data partitions for Train/Val/Test in controller (#45)
Co-authored-by: liuximeng <13073314+liuximeng18772102439@user.noreply.gitee.com>
1 parent a80b196 commit b5be2ad

5 files changed

Lines changed: 111 additions & 166 deletions

File tree

recipe/transfer_queue/agent_loop.py

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -67,10 +67,7 @@ def _performance_metrics(self, metrics: list[list[dict[str, str]]], output: Data
6767

6868
return timing
6969

70-
def create_transferqueue_client(self, controller_infos, storage_infos, role):
70+
def create_transferqueue_client(self, controller_info, config):
7171
ray.get(
72-
[
73-
worker.create_transferqueue_client.remote(controller_infos, storage_infos, role)
74-
for worker in self.agent_loop_workers
75-
]
72+
[worker.create_transferqueue_client.remote(controller_info, config) for worker in self.agent_loop_workers]
7673
)

0 commit comments

Comments
 (0)