【详述】
使用以下语句
EXPORT TABLE xxx
TO “s3a://xxx/xxx/”
WITH BROKER
(
“aws.s3.access_key” = “xxx”,
“aws.s3.secret_key” = “xxx/xxx”,
“aws.s3.region” = “cn-northwest-1”
);
使用 show export命令查看Errmsg只提示一句type:RUN_FAIL; msg:Cancelled。
日志有一条信息:file system HDFSFileSystem [identity=com.starrocks.fs.hdfs.HdfsFsIdentity@3e67ab86, dfsFileSystem=S3AFileSystem{uri=s3a://4k-dms, workingDir=s3a://4k-dms/user/root, partSize=67108864, enableMultiObjectsDelete=true, maxKeys=5000, OpenFileSupport{changePolicy=ETagChangeDetectionPolicy mode=Server, defaultReadAhead=65536, defaultBufferSize=4096, defaultAsyncDrainThreshold=16000, defaultInputPolicy=default}, blockSize=33554432, multiPartThreshold=134217728, s3EncryptionAlgorithm=‘NONE’, blockFactory=org.apache.hadoop.fs.s3a.S3ADataBlocks$DiskBlockFactory@13d45765, auditManager=Service ActiveAuditManagerS3A in state ActiveAuditManagerS3A: STARTED, auditor=LoggingAuditor{ID=‘b3fc7d0d-76f2-4e0a-886e-945a039714c4’, headerEnabled=true, rejectOutOfSpan=false, isMultipartUploadEnabled=true}}, authoritativePath=[], useListV1=false, magicCommitter=true, boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=160, available=160, waiting=0}, activeCount=0}, unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@1d13bb6f[Running, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], credentials=AWSCredentialProviderList[refcount= 1: [SimpleAWSCredentialsProvider] last provider: SimpleAWSCredentialsProvider, delegation tokens=disabled, DirectoryMarkerRetention{policy=‘delete’}, instrumentation {S3AInstrumentation{}}, ClientSideEncryption=false}, fileSystemId=2dcabb19-1cc1-434f-bad9-5e66de93508d] is expired, close and remove it。
使用命令
EXPORT TABLE xxx
TO “s3a://xxx/xxx/”
WITH BROKER
(
“fs.s3a.access.key” = “xxx”,
“fs.s3a.secret.key” = “xxx/xx”,
“fs.s3a.endpoint” = “cn-northwest-1”
);
后,再使用show export from xxx;命令就会报错,出现Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost。
日志显示
另外还有一个问题就是,我的cn节点没有cn-3,fe的日志中出现cn-3的错误信息
【是否存算分离】 是
【StarRocks版本】3.1.5-5d8438a
【集群规模】3fe )+ 3cn
【联系方式】社区群17-王(微信号lwsy1995)