【详述】使用starrocks 中的INTO OUTFILE语句向hdfs导出数据时出现kerberos认证问题
【StarRocks版本】2.3.3
【执行sql示例】
SELECT * FROM tbl
INTO OUTFILE “hdfs://path/to/result_”
FORMAT AS CSV
PROPERTIES
(
“broker.name” = “my_broker”,
“broker.username” = “starrocks”,
“column_separator” = “,”,
“line_delimiter” = “\n”,
“max_file_size” = “100MB”
);
【查询报错】
ERROR 1064 (HY000) at line 4: Broker storage service error, could not open file hdfs://nameservice1/user/hive/warehouse/vaja_gdl_test.db/hive_adl_ocm_msg_common_loan_distinct_weekly_v2_csv/result_0.csv, cause by: DestHost:destPort host:8020 , LocalHost:localPort host/host:0. Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]
您好，可以参考下
SELECT * FROM demo1
INTO OUTFILE “hdfs://hdfs:port/user/sr/demo1_”
FORMAT AS CSV
PROPERTIES
(
“broker.name” = “hdfs_broker”,
“broker.hadoop.security.authentication” = “kerberos”,
“broker.kerberos_principal"="starrocks@YOUR.COM”,
“broker.kerberos_keytab”="/home/starRocks/starRocks.keytab"
);