【详述】在使用 insert into files 导出到 S3 时 报错,我们测试 导出 50w 条时 可以正常导出,但使用相同的参数导出60w 条时却报错了
看报错信息似乎是在报 权限问题 ,但可以确定是有权限的
【业务影响】
【是否存算分离】否
【StarRocks版本】例如:1.18.2
【集群规模】3fe(1 follower+2observer)+5be(fe与be混部)
【机器信息】CPU虚拟核/内存/网卡,例如:32C/133G/万兆
【表模型】主键模型
【导入或者导出方式】files 导出
【联系方式】邮箱 jiangyu142230@163.com
【附件】
org.jkiss.dbeaver.model.sql.DBSQLException: SQL 错误 [5025] [HY000]: close writer error: IOError: IO error: S3: Fail to create multipart upload for object bucket-20230221-test/ods_bisc_adjust_user_detail_rt_2024_11_18/data_228f0eee-190f-11f0-b9c7-02001719144a_3_1.parquet: Either the bucket named ‘bucket-20230221-test’ does not exist in the namespace ‘axg2ilqwyfm8’ or you are not authorized to access it
be/src/io/s3_output_stream.cpp:44 create_multipart_upload()
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:130)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeStatement(SQLQueryJob.java:631)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.lambda$2(SQLQueryJob.java:522)
at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:192)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeSingleQuery(SQLQueryJob.java:541)
at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.extractData(SQLQueryJob.java:1001)
at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$QueryResultsContainer.readData(SQLEditor.java:4239)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.lambda$0(ResultSetJobDataRead.java:128)
at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:192)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.run(ResultSetJobDataRead.java:126)
at org.jkiss.dbeaver.ui.controls.resultset.ResultSetViewer$ResultSetDataPumpJob.run(ResultSetViewer.java:5166)
at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:117)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)
Caused by: java.sql.SQLException: close writer error: IOError: IO error: S3: Fail to create multipart upload for object bucket-20230221-test/ods_bisc_adjust_user_detail_rt_2024_11_18/data_228f0eee-190f-11f0-b9c7-02001719144a_3_1.parquet: Either the bucket named ‘bucket-20230221-test’ does not exist in the namespace ‘axg2ilqwyfm8’ or you are not authorized to access it
be/src/io/s3_output_stream.cpp:44 create_multipart_upload()
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:763)
at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:648)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.execute(JDBCStatementImpl.java:335)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:128)
… 12 more