官方datax写入插件报错 ，错误码400

💬 StarRocks 用户问答
#1

【详述】官方datax写入插件报错
【业务影响】
【StarRocks版本】例如：1.19.1
【集群规模】例如：3fe（1 follower+2observer）+5be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡，例如：36C/128G/万兆

请问现在有一张表，使用最新的starrocks writer写入总是报400码，同库下的别的表没事，就这张表报。该表大概300多列
请问400是什么意思

[2021-12-06 23:12:59,822] {{bash.py:182}} INFO - 2021-12-06 23:12:59.821 [Thread-7] INFO StarRocksStreamLoadVisitor - Executing stream load to: ‘http://bds.haier.net:8035/api/di_fw/hsicrm_wo_workorderbase_registrationtime_all_pk/_stream_load’, size: ‘26227130’
[2021-12-06 23:12:59,829] {{bash.py:182}} INFO - 2021-12-06 23:12:59.829 [Thread-5] INFO StarRocksStreamLoadVisitor - Executing stream load to: ‘http://bds.haier.net:8035/api/di_fw/hsicrm_wo_workorderbase_registrationtime_all_pk/_stream_load’, size: ‘26228555’
[2021-12-06 23:13:00,129] {{bash.py:182}} INFO - 2021-12-06 23:13:00.129 [Thread-6] INFO StarRocksStreamLoadVisitor - Executing stream load to: ‘http://bds.haier.net:8035/api/di_fw/hsicrm_wo_workorderbase_registrationtime_all_pk/_stream_load’, size: ‘26227565’
[2021-12-06 23:13:00,228] {{bash.py:182}} INFO - 2021-12-06 23:13:00.228 [Thread-6] WARN StarRocksStreamLoadVisitor - Request failed with code:400
[2021-12-06 23:13:00,229] {{bash.py:182}} INFO - 2021-12-06 23:13:00.228 [Thread-5] WARN StarRocksStreamLoadVisitor - Request failed with code:400
[2021-12-06 23:13:00,229] {{bash.py:182}} INFO - 2021-12-06 23:13:00.228 [Thread-7] WARN StarRocksStreamLoadVisitor - Request failed with code:400
[2021-12-06 23:13:00,234] {{bash.py:182}} INFO - 2021-12-06 23:13:00.234 [Thread-5] WARN StarRocksWriterManager - Failed to flush batch data to StarRocks, retry times = 0
[2021-12-06 23:13:00,234] {{bash.py:182}} INFO - java.io.IOException: Unable to flush data to StarRocks: unknown result status.
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:59) ~[starrockswriter-release.jar:na]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksWriterManager.asyncFlush(StarRocksWriterManager.java:161) [starrockswriter-release.jar:na]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksWriterManager.access$000(StarRocksWriterManager.java:21) [starrockswriter-release.jar:na]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksWriterManager$1.run(StarRocksWriterManager.java:132) [starrockswriter-release.jar:na]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - 2021-12-06 23:13:00.234 [Thread-7] WARN StarRocksWriterManager - Failed to flush batch data to StarRocks, retry times = 0
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - java.io.IOException: Unable to flush data to StarRocks: unknown result status.
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksStreamLoadVisitor.doStreamLoad(StarRocksStreamLoadVisitor.java:59) ~[starrockswriter-release.jar:na]
[2021-12-06 23:13:00,235] {{bash.py:182}} INFO - at com.starrocks.connector.datax.plugin.writer.starrockswriter.manager.StarRocksWriterManager.asyncFlush(StarRocksWriterManager.java:161) [starrockswriter-release.jar:na]

#2

列数过多可以暂时使用如下配置跑
“loadProps”: {
“columns”: “”,
“format”: “json”,
“strip_outer_array”: true
}

#3

加上这个配置还是报400
以前老作业，就是还叫dorisdbwriter的那个不报错。但是新作业不再使用那个包了

#4

修改后的配置发下看看

#7

用这个配置不用修改直接替换 loadProps 字段

"loadProps": {
    "columns": "",
    "format": "json",
    "strip_outer_array": true
}
#8

哦哦，就不用填列了

京ICP备2022026421号-1