Skip to content

Commit 852c27e

Browse files
committed
[feat] Support auto init YR backend based on metastore
Signed-off-by: Haichuan Hu <kaisennhu@gmail.com>
1 parent e04cc05 commit 852c27e

2 files changed

Lines changed: 328 additions & 157 deletions

File tree

transfer_queue/config.yaml

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -50,8 +50,14 @@ backend:
5050
Yuanrong:
5151
# Whether to let TQ automatically start etcd and datasystem services
5252
auto_init: True
53+
# ========== Etcd mode config ==========
5354
# etcd service address (used to start etcd when auto_init=true)
5455
etcd_address: "127.0.0.1:2379"
55-
# datasystem worker host and port (used to start dscli when auto_init=true)
56-
host: "127.0.0.1"
56+
# ========== Metastore mode config ==========
57+
# Whether to use metastore mode instead of etcd
58+
metastore_mode: False
59+
# For auto_init=True, metastore_address is auto-generated on head node
60+
# For auto_init=False, specify the external metastore address here
61+
metastore_address: ""
62+
# Datasystem worker port (host is auto-detected)
5763
port: 31501

0 commit comments

Comments
 (0)