为了更快的定位您的问题,请提供以下信息,谢谢
【详述】3.2.10 starrocks创建数据目录catalog,本地IDE创建出现超时并卡死,通过mysql 方式依旧无法创建,.
【背景】目前dataxt’b同步维表方式不稳定,希望引入catalog取代ods.
【业务影响】创建catalog卡死,无法创建数据目录catalog.
【是否存算分离】 存算一体
【StarRocks版本】3.2.10
【集群规模】3fe(1 leader+2foller)+3be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,32C/64G/万兆
【联系方式】yaoquanxin@xueji.com
【附件】
报错:
本地IDE执行catalog创建语句:
CREATE EXTERNAL CATALOG pg_jdbc
PROPERTIES
(
“type” = “jdbc”,
“user” = “yqx”,
“password” = “xxx”,
“jdbc_uri” = “jdbc:postgresql://172.16.0.167:55432/smartretail-tenant”,
“driver_url” = “https://repo1.maven.org/maven2/org/postgresql/postgresql/42.3.3/postgresql-42.3.3.jar”,
“driver_class” = “org.postgresql.Driver”
); – 超时
方式二:本地文件方式:创建依旧超时
CREATE EXTERNAL CATALOG pg_jdbc01
PROPERTIES
(
“type” = “jdbc”,
“user” = “yqx”,
“password” = “xxxx”,
“jdbc_uri” = “jdbc:postgresql://172.16.0.167:55432/smartretail-tenant”,
“driver_url” = “file:///data/postgresql-42.3.jar”,
“driver_class” = “org.postgresql.Driver”
);
方式3:
driver带* 是因为chmod777 ,创建依旧超时
CREATE EXTERNAL CATALOG pg_jdbc01
PROPERTIES
(
“type” = “jdbc”,
“user” = “yqx”,
“password” = “xxxx”,
“jdbc_uri” = “jdbc:postgresql://172.16.0.167:55432/smartretail-tenant”,
“driver_url” = “file:///data/postgresql-42.3.jar*”,
“driver_class” = “org.postgresql.Driver”
);
- fe.log/beINFO/相应截图
1.能创建 resource,但不能创建 catalog
resource创建语句:
CREATE EXTERNAL RESOURCE jdbc111
PROPERTIES (
“type” = “jdbc”,
“user” = “yqx”,
“password” = “xxxxx”,
“jdbc_uri” = “jdbc:postgresql://172.16.0.167:xxxx/smartretail-tenant”,
“driver_url” = “https://repo1.maven.org/maven2/org/postgresql/postgresql/42.3.3/postgresql-42.3.3.jar”,
“driver_class” = “org.postgresql.Driver”
);
catalog无法创建语句:
CREATE EXTERNAL CATALOG pg_jdbc_test
PROPERTIES
(
“type” = “jdbc”,
“user” = “yqx”,
“password” = “xxxx”,
“jdbc_uri” = “jdbc:postgresql://172.16.0.167:xxxx/smartretail-tenant”,
“driver_url” = “https://repo1.maven.org/maven2/org/postgresql/postgresql/42.4.4/postgresql-42.4.4.jar”,
“driver_class” = “org.postgresql.Driver”
);
创建resource成功截图:
创建catalog,超时,本地IDE失败日志
验证FE网络和业务库ip:端口互通性:
mysql客户端执行卡死现象:
- 慢查询:
- Profile信息
- 并行度:show variables like ‘%parallel_fragment_exec_instance_num%’;
- pipeline是否开启:show variables like ‘%pipeline%’;
- be节点cpu和内存使用率截图
- 查询报错:
- query_dump,怎么获取query_dump文件
- be crash
- be.out
- 外表查询报错
- be.out和fe.warn.log