【详述】hadoop集群集成了open ldap鉴权，hdfs及hive访问时都需要进行open ldap鉴权
【背景】测试hadoop与starrocks集成。hadoop集群为阿里云EMR5.4
【业务影响】无
【是否存算分离】
【StarRocks版本】3.3.1
【集群规模】测试单机
【机器信息】测试单机
【联系方式】125760706@qq.com
- 查询报错：
CREATE EXTERNAL CATALOG hive_catalog_hms
PROPERTIES
(
“type” = “hive”,
“hive.metastore.type” = “hive”,
“hive.metastore.uris” = “thrift://emr-header-1.cluster-268224:9083,thrift://emr-header-2.cluster-268224:9083”
);
MySQL [dw]>
MySQL [dw]> show tables like ‘dws_audit_nx_shop_data’;
±-----------------------+
| Tables_in_dw |
±-----------------------+
| dws_audit_nx_shop_data |
±-----------------------+
1 row in set (0.02 sec)
MySQL [dw]> select * from dws_audit_nx_shop_data limit 10;
ERROR 1064 (HY000): Failed to get remote files, msg: com.starrocks.connector.exception.StarRocksConnectorException: Failed to get hive remote file’s metadata on path: RemotePathKey{path=‘hdfs://emr-cluster/user/hive/warehouse/dw.db/dws_audit_nx_shop_data’, isRecursive=true}. msg: java.net.UnknownHostException: emr-cluster
MySQL [dw]>