【详述】数据导出至minio失败 (limit 1000可以成功,limit 5000条就开始失败)
【背景】做过哪些操作?
【业务影响】
【是否存算分离】否
【StarRocks版本】3.3.2
【集群规模】3fe+15be k8s部署
【机器信息】8核 32G
【表模型】主键模型
【导入或者导出方式】SELECT INTO FILES
【联系方式】论坛联系
【附件】
数据导出sql:
SET query_timeout = 3600; INSERT INTO FILES( ‘path’ = ‘s3://xxx, ‘format’ = ‘parquet’, ‘compression’ = ‘lz4’, ‘aws.s3.access_key’ = xxx’, ‘aws.s3.secret_key’ = 'xxx, ‘aws.s3.region’ = ‘cn’, ‘aws.s3.use_instance_profile’ = ‘false’, ‘aws.s3.endpoint’ = ‘https://xxx’, ‘aws.s3.enable_path_style_access’=‘true’, ‘aws.s3.enable_ssl’=‘true’,‘target_max_file_size’ = ‘54857600’ ) SELECT * FROM xxx where day = 20240729 limit 5000
-
客户端报错:
ERROR 5025 (HY000): S3: Fail to upload part of xxxx.parquet: curlCode: 28, Timeout was reached -
BE报错
-
minio 开启trace后看到的报错