Commit 8d264a0
committed
#AI commit# CC: REQ-01文件数据集导入功能-上传解析链路:新增StreamFileHeaderParser(BOM+ICU4J编码检测/分隔符多假设打分/列名规范化/类型推断int→long→double→decimal→date→timestamp→string/空值率/fail fast)、JobFileSourceService及Impl(有界缓冲先解析后上传BML,不全量缓冲不落盘fail fast无孤儿字节,复用BmlClients)、ExchangisJobFileSourceRestfulApi(dss/exchangis/main/job/fileSource upload/parse/delete接口) / REQ-01 file dataset import upload/parse flow: add StreamFileHeaderParser (BOM+ICU4J encoding/separator multi-hypothesis scoring/column normalization/type inference/null rate/fail fast), JobFileSourceService & Impl (bounded-buffer parse-then-upload to BML via BmlClients, no full buffer/no disk/fail fast no orphan), ExchangisJobFileSourceRestfulApi (upload/parse/delete endpoints)
1 parent d3f5dc2 commit 8d264a0
4 files changed
Lines changed: 902 additions & 0 deletions
File tree
- exchangis-job/exchangis-job-server/src/main/java/com/webank/wedatasphere/exchangis/job/server
- parse
- restful
- service
- impl
0 commit comments