【详述】3.0通过 Audit Loader 管理 StarRocks 中的审计日志无法安装插件,按照官网操作的
【背景】做过哪些操作?
1、(StarRocks v2.4.0 及其之后小版本的建表ddl)先创建CREATE DATABASE starrocks_audit_db__;
CREATE TABLE starrocks_audit_db__.starrocks_audit_tbl__ (
queryId
VARCHAR(48) COMMENT “查询的唯一ID”,
timestamp
DATETIME NOT NULL COMMENT “查询开始时间”,
clientIp
VARCHAR(32) COMMENT “客户端IP”,
user
VARCHAR(64) COMMENT “查询用户名”,
resourceGroup
VARCHAR(64) COMMENT “资源组名”,
db
VARCHAR(96) COMMENT “查询所在数据库”,
state
VARCHAR(8) COMMENT “查询状态(EOF,ERR,OK)”,
errorCode
VARCHAR(96) COMMENT “错误码”,
queryTime
BIGINT COMMENT “查询执行时间(毫秒)”,
scanBytes
BIGINT COMMENT “查询扫描的字节数”,
scanRows
BIGINT COMMENT “查询扫描的记录行数”,
returnRows
BIGINT COMMENT “查询返回的结果行数”,
cpuCostNs
BIGINT COMMENT “查询CPU耗时(纳秒)”,
memCostBytes
BIGINT COMMENT “查询消耗内存(字节)”,
stmtId
INT COMMENT “SQL语句增量ID”,
isQuery
TINYINT COMMENT “SQL是否为查询(1或0)”,
feIp
VARCHAR(32) COMMENT “执行该语句的FE IP”,
stmt
STRING COMMENT “原始SQL语句”,
digest
VARCHAR(32) COMMENT “SQL指纹”,
planCpuCosts
DOUBLE COMMENT “查询规划阶段CPU占用(纳秒)”,
planMemCosts
DOUBLE COMMENT “查询规划阶段内存占用(字节)”
) ENGINE = OLAP
DUPLICATE KEY (queryId
, timestamp
, clientIp
)
COMMENT “审计日志表”
PARTITION BY RANGE (timestamp
) ()
DISTRIBUTED BY HASH (queryId
) BUCKETS 3
PROPERTIES (
“dynamic_partition.time_unit” = “DAY”,
“dynamic_partition.start” = “-30”,
“dynamic_partition.end” = “3”,
“dynamic_partition.prefix” = “p”,
“dynamic_partition.buckets” = “3”,
“dynamic_partition.enable” = “true”,
“replication_num” = “3”
);
2、下载Audit Loader 安装包后unzip解压
3、 修改 plugin.conf 文件的frontend_host_port、user、password
4、重新打包以上文件zip -q -m -r auditloader.zip auditloader.jar plugin.conf plugin.properties
5、INSTALL PLUGIN FROM “<absolute_path_to_package>”;
【业务影响】
【StarRocks版本】3.0
【集群规模】例如:1fe+3be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:8C/24G/万兆
【联系方式】
【附件】
开始安装
