为了更快的定位您的问题，请提供以下信息，谢谢
【详述】问题详细描述
【背景】做过哪些操作？
【业务影响】
【是否存算分离】是，基于HDFS部署
【StarRocks版本】例如：3.3.0
【集群规模】例如：3fe（1 follower+2observer）+6be（fe与be混部）
【机器信息】CPU虚拟核/内存/网卡
【表模型】主键模型
【导入或者导出方式】Flink
期望：是否有参数可以调整提高数据导入能力？
【联系方式】为了在解决问题过程中能及时联系到您获取一些日志信息，请补充下您的联系方式，例如：社区群15 redscarf
I0725 14:15:10.733395 646 plan_fragment_executor.cpp:496] Fragment ad4397b1-e9d1-437c-5844-cbfb5c964ea3:(Active: 27s492ms, non-child: 0.02%)
- InstanceAllocatedMemoryUsage: 2.24 GB
- InstanceDeallocatedMemoryUsage: 858.02 MB
- InstancePeakMemoryUsage: 1.64 GB
- MemoryLimit: -1.00 B
- RowsProduced: 37.73K
OlapTableSink:(Active: 2s667ms, non-child: 9.70%)
- TxnID: 1762797
- IndexNum: 1
- ReplicatedStorage: true
- AutomaticPartition: true
- AutomaticBucketSize: 0
- AllocAutoIncrementTime: 4.483us
- CloseWaitTime: 1s729ms
- OpenTime: 6.605ms
- PrepareDataTime: 99.360ms
- ConvertChunkTime: 741.731us
- ValidateDataTime: 76.985ms
- RowsFiltered: 0
- RowsRead: 37.73K
- RowsReturned: 37.73K
- RpcClientSideTime: 9s555ms
- RpcServerSideTime: 8s696ms
- RpcServerWaitFlushTime: 0.000ns
- SendDataTime: 830.824ms
- PackChunkTime: 776.092ms
- SendRpcTime: 326.562ms
- CompressTime: 0.000ns
- SerializeChunkTime: 131.617ms
- WaitResponseTime: 25.261ms
FILE_SCAN_NODE (id=0):(Active: 24s820ms, non-child: 90.28%)
- BytesRead: 0
- IOTaskExecTime: 0.000ns
- IOTaskWaitTime: 0.000ns
- NumDiskAccess: 0
- PeakMemoryUsage: 0
- RowsRead: 0
- RowsReturned: 37.73K
- RowsReturnedRate: 1.52 K/sec
- ScanTime: 25s734ms
- ScannerQueueCounter: 1
- ScannerQueueTime: 7.034us
- ScannerThreadsInvoluntaryContextSwitches: 0
- ScannerThreadsTotalWallClockTime: 0.000ns
- MaterializeTupleTime(*): 0.000ns
- ScannerThreadsSysTime: 0.000ns
- ScannerThreadsUserTime: 0.000ns
- ScannerThreadsVoluntaryContextSwitches: 0
- TotalRawReadTime(*): 0.000ns
- TotalReadThroughput: 0.00 /sec
DataSource:
- DataSourceType: FileDataSource
- FileScanner: 0
- CastChunkTime: 4.653ms
- CreateChunkTime: 3.294ms
- FileReadCount: 3
- FileReadTime: 23s630ms
- FillTime: 0.000ns
- MaterializeTime: 1.829ms
- ReadTime: 0.000ns
- ScannerTotalTime: 25s732ms
表结构
CREATE TABLE `table_name` (
`uuu_id` varchar(65533) NOT NULL COMMENT "",
`xxx_no` varchar(65533) NOT NULL COMMENT "",
`time` datetime NOT NULL COMMENT "",
`ddd_business_code` varchar(65533) NULL COMMENT "",
`is_cap_vice` varchar(65533) NULL COMMENT "",
`using_properties_code` varchar(65533) NULL COMMENT "",
`xxx_reliability` varchar(65533) NULL COMMENT "",
`ccc_no` varchar(65533) NULL COMMENT "",
`decoration_reliablity` varchar(65533) NULL COMMENT "",
`yyy_class_ext_desc` varchar(65533) NULL COMMENT "",
`is_key_uuu` varchar(65533) NULL COMMENT "",
`aaaa_no` varchar(65533) NULL COMMENT "",
`xxx_left_topy` varchar(65533) NULL COMMENT "",
`aaaa_city_pass_desc` varchar(65533) NULL COMMENT "",
`ods_dt` varchar(65533) NULL COMMENT "",
`xxx_left_topx` varchar(65533) NULL COMMENT "",
`ddd_longitude` varchar(65533) NULL COMMENT "",
`aaaa_type_desc` varchar(65533) NULL COMMENT "",
`xxx_code` varchar(65533) NULL COMMENT "",
`load_type` varchar(65533) NULL COMMENT "",
`num_of_pendant` varchar(65533) NULL COMMENT "",
`horizon_angle` varchar(65533) NULL COMMENT "",
`bbb_width_vice` varchar(65533) NULL COMMENT "",
`kd_expired_date` varchar(65533) NULL COMMENT "",
`yyy_type_reliability` varchar(65533) NULL COMMENT "",
`image_clarity` varchar(65533) NULL COMMENT "",
`is_mask_vice` varchar(65533) NULL COMMENT "",
`yyy_size` varchar(65533) NULL COMMENT "",
`xxx_struct` varchar(65533) NULL COMMENT "",
`play_phone` varchar(65533) NULL COMMENT "",
`original_yyy_class` varchar(65533) NULL COMMENT "",
`place_code` varchar(65533) NULL COMMENT "",
`yyy_color_depth` varchar(65533) NULL COMMENT "",
`aaaa_type` varchar(65533) NULL COMMENT "",
`xxx_color_reliability` varchar(65533) NULL COMMENT "",
`original_yyy_brand` varchar(65533) NULL COMMENT "",
`curr_day` varchar(65533) NULL COMMENT "",
`xxx_structure` varchar(65533) NULL COMMENT "",
`is_mask_vice_reliability` varchar(65533) NULL COMMENT "",
`yyy_special_type` varchar(65533) NULL COMMENT "",
`city_code` varchar(65533) NULL COMMENT "",
`is_sunglass_vice_reliability` varchar(65533) NULL COMMENT "",
`pass_date` varchar(65533) NULL COMMENT "",
`back_inner_obj_reliability` varchar(65533) NULL COMMENT "",
`num_of_passenger` varchar(65533) NULL COMMENT "",
`day_or_night` varchar(65533) NULL COMMENT "",
`smoking_reliability` varchar(65533) NULL COMMENT "",
`big_xxx_left_topy` varchar(65533) NULL COMMENT "",
`internship_num` varchar(65533) NULL COMMENT "",
`is_cap_vice_reliability` varchar(65533) NULL COMMENT "",
`card_reliablity` varchar(65533) NULL COMMENT "",
`xxx_consistency` varchar(65533) NULL COMMENT "",
`big_xxx_left_topx` varchar(65533) NULL COMMENT "",
`yyy_brightness` varchar(65533) NULL COMMENT "",
`info_kind_desc` varchar(65533) NULL COMMENT "",
`ccc_unit_name` varchar(65533) NULL COMMENT "",
`num_of_temp_xxx` varchar(65533) NULL COMMENT "",
`slag_cover_status` varchar(65533) NULL COMMENT "",
`num_of_card` varchar(65533) NULL COMMENT "",
`xxx_class_code` varchar(65533) NULL COMMENT "",
`ccc_name` varchar(65533) NULL COMMENT "",
`calling` varchar(65533) NULL COMMENT "",
`sub_image_list` varchar(65533) NULL COMMENT "",
`uuu_class` varchar(65533) NULL COMMENT "",
`certificate_no` varchar(65533) NULL COMMENT "",
`car_owner_name` varchar(65533) NULL COMMENT "",
`brand_reliability` varchar(65533) NULL COMMENT "",
`attribution_desc` varchar(65533) NULL COMMENT "",
`right_btmx` varchar(65533) NULL COMMENT "",
`right_btmy` varchar(65533) NULL COMMENT "",
`xxx_cover_status` varchar(65533) NULL COMMENT "",
`yyy_category` varchar(65533) NULL COMMENT "",
`xxx_right_btmx` varchar(65533) NULL COMMENT "",
`ccc_latitude` varchar(65533) NULL COMMENT "",
`xxx_right_btmy` varchar(65533) NULL COMMENT "",
`province_code` varchar(65533) NULL COMMENT "",
`label_shape` varchar(65533) NULL COMMENT "",
`temp_xxx_no` varchar(65533) NULL COMMENT "",
`sunvisor_vice_reliability` varchar(65533) NULL COMMENT "",
`is_cap` varchar(65533) NULL COMMENT "",
`vertical_angle` varchar(65533) NULL COMMENT "",
`driving_status_code` varchar(65533) NULL COMMENT "",
`storage_url5` varchar(65533) NULL COMMENT "",
`num_of_paintting` varchar(65533) NULL COMMENT "",
`original_xxx_no` varchar(65533) NULL COMMENT "",
`storage_url3` varchar(65533) NULL COMMENT "",
`storage_url4` varchar(65533) NULL COMMENT "",
`storage_url1` varchar(65533) NULL COMMENT "",
`ccc_floor_no` varchar(65533) NULL COMMENT "",
`storage_url2` varchar(65533) NULL COMMENT "",
`luggage_reliability` varchar(65533) NULL COMMENT "",
`num_of_sunroof` varchar(65533) NULL COMMENT "",
`original_xxx_color` varchar(65533) NULL COMMENT "",
`ccc_road_type` varchar(65533) NULL COMMENT "",
`xxx_class_desc` varchar(65533) NULL COMMENT "",
`xxx_province_desc` varchar(65533) NULL COMMENT "",
`tissuebox_reliability` varchar(65533) NULL COMMENT "",
`using_properties_code_str` varchar(65533) NULL COMMENT "",
`load_type_reliablity` varchar(65533) NULL COMMENT "",
`class_reliability` varchar(65533) NULL COMMENT "",
`play_phone_reliability` varchar(65533) NULL COMMENT "",
`internship_reliability` varchar(65533) NULL COMMENT "",
`source_factory` varchar(65533) NULL COMMENT "",
`tissuebox_right_btmy` varchar(65533) NULL COMMENT "",
`tissuebox_right_btmx` varchar(65533) NULL COMMENT "",
`yyy_special_reliability` varchar(65533) NULL COMMENT "",
`window_qulity_vice_reliability` varchar(65533) NULL COMMENT "",
`ccc_unit_code` varchar(65533) NULL COMMENT "",
`aaaa_city_pass` varchar(65533) NULL COMMENT "",
`xxx_first_char_reliability` varchar(65533) NULL COMMENT "",
`spare_wheel_reliability` varchar(65533) NULL COMMENT "",
`yyy_special_type_desc` varchar(65533) NULL COMMENT "",
`ddd_latitude` varchar(65533) NULL COMMENT "",
`speed` varchar(65533) NULL COMMENT "",
`xxx_cover_reliability` varchar(65533) NULL COMMENT "",
`uuu_name` varchar(65533) NULL COMMENT "",
`big_xxx_status` varchar(65533) NULL COMMENT "",
`place_desc` varchar(65533) NULL COMMENT "",
`is_stained` varchar(65533) NULL COMMENT "",
`tissuebox_left_topy` varchar(65533) NULL COMMENT "",
`tissuebox_left_topx` varchar(65533) NULL COMMENT "",
`ccc_longitude` varchar(65533) NULL COMMENT "",
`ddd_business_desc` varchar(65533) NULL COMMENT "",
`num_of_damagepos` varchar(65533) NULL COMMENT "",
`city_desc` varchar(65533) NULL COMMENT "",
`sunvisor_reliability` varchar(65533) NULL COMMENT "",
`back_inner_obj_num` varchar(65533) NULL COMMENT "",
`similarity_degree` varchar(65533) NULL COMMENT "",
`yyy_brand_code` varchar(65533) NULL COMMENT "",
`appear_time` varchar(65533) NULL COMMENT "",
`front_or_back` varchar(65533) NULL COMMENT "",
`is_sunglass_vice` varchar(65533) NULL COMMENT "",
`sunvisor` varchar(65533) NULL COMMENT "",
`truck_ton` varchar(65533) NULL COMMENT "",
`car_seating` varchar(65533) NULL COMMENT "",
`bbb_height_main` varchar(65533) NULL COMMENT "",
`is_mask` varchar(65533) NULL COMMENT "",
`curr_month` varchar(65533) NULL COMMENT "",
`temp_xxx_reliability` varchar(65533) NULL COMMENT "",
`mark_time` varchar(65533) NULL COMMENT "",
`safety_belt_vice` varchar(65533) NULL COMMENT "",
`curr_week` varchar(65533) NULL COMMENT "",
`is_sunglass` varchar(65533) NULL COMMENT "",
`link_bbb_yyy_id` varchar(65533) NULL COMMENT "",
`curr_hour` varchar(65533) NULL COMMENT "",
`damage_pos_reliability` varchar(65533) NULL COMMENT "",
`num_of_xxx` varchar(65533) NULL COMMENT "",
`disappear_time` varchar(65533) NULL COMMENT "",
`xxx_color_desc` varchar(65533) NULL COMMENT "",
`veh_integrity` varchar(65533) NULL COMMENT "",
`big_xxx_reliability` varchar(65533) NULL COMMENT "",
`num_of_luggage` varchar(65533) NULL COMMENT "",
`left_topy` varchar(65533) NULL COMMENT "",
`register_book_date` varchar(65533) NULL COMMENT "",
`ddd_position_desc` varchar(65533) NULL COMMENT "",
`left_topx` varchar(65533) NULL COMMENT "",
`light_type_reliability` varchar(65533) NULL COMMENT "",
`veh_brightness` varchar(65533) NULL COMMENT "",
`yyy_model_desc` varchar(65533) NULL COMMENT "",
`color_reliability` varchar(65533) NULL COMMENT "",
`back_inner_obj_type` varchar(65533) NULL COMMENT "",
`viid` varchar(65533) NULL COMMENT "",
`num_of_label` varchar(65533) NULL COMMENT "",
`yyy_feature_len` varchar(65533) NULL COMMENT "",
`slag_cover_reliability` varchar(65533) NULL COMMENT "",
`motor_yyy_id` varchar(65533) NULL COMMENT "",
`yyy_manufacture` varchar(65533) NULL COMMENT "",
`aaaa_direction` varchar(65533) NULL COMMENT "",
`province_desc` varchar(65533) NULL COMMENT "",
`light_type` varchar(65533) NULL COMMENT "",
`storage_url1_feature` varchar(65533) NULL COMMENT "",
`yyy_brand_desc` varchar(65533) NULL COMMENT "",
`vpc_is_delete` varchar(65533) NULL COMMENT "",
`yyy_styles_code` varchar(65533) NULL COMMENT "",
`is_mask_reliability` varchar(65533) NULL COMMENT "",
`is_stained_reliability` varchar(65533) NULL COMMENT "",
`pendant_reliability` varchar(65533) NULL COMMENT "",
`num_of_xxx_chars` varchar(65533) NULL COMMENT "",
`ccc_id` varchar(65533) NULL COMMENT "",
`label_color` varchar(65533) NULL COMMENT "",
`num_of_tissuebox` varchar(65533) NULL COMMENT "",
`yyy_color_code` varchar(65533) NULL COMMENT "",
`bbb_status` varchar(65533) NULL COMMENT "",
`sunvisor_vice` varchar(65533) NULL COMMENT "",
`label_reliability` varchar(65533) NULL COMMENT "",
`xxx_desc` varchar(65533) NULL COMMENT "",
`truck_ton_reliability` varchar(65533) NULL COMMENT "",
`big_xxx_right_btmx` varchar(65533) NULL COMMENT "",
`big_xxx_right_btmy` varchar(65533) NULL COMMENT "",
`is_sunglass_reliability` varchar(65533) NULL COMMENT "",
`source_id` varchar(65533) NULL COMMENT "",
`attribution_code` varchar(65533) NULL COMMENT "",
`ccc_usage` varchar(65533) NULL COMMENT "",
`ccc_road_type_desc` varchar(65533) NULL COMMENT "",
`num_of_spare_wheel` varchar(65533) NULL COMMENT "",
`belt_vice_reliability` varchar(65533) NULL COMMENT "",
`xxx_color_code` varchar(65533) NULL COMMENT "",
`paintting_reliability` varchar(65533) NULL COMMENT "",
`vpc_create_time` varchar(65533) NULL COMMENT "",
`sunroof_reliability` varchar(65533) NULL COMMENT "",
`vpc_expire_time` varchar(65533) NULL COMMENT "",
`xxx_city` varchar(65533) NULL COMMENT "",
`num_of_sunvisor` varchar(65533) NULL COMMENT "",
`bbb_height_vice` varchar(65533) NULL COMMENT "",
`ccc_address` varchar(65533) NULL COMMENT "",
`num_of_decoration` varchar(65533) NULL COMMENT "",
`ccc_usage_desc` varchar(65533) NULL COMMENT "",
`ddd_position_type` varchar(65533) NULL COMMENT "",
`ccc_civil_code` varchar(65533) NULL COMMENT "",
`xxx_char_reliability` varchar(65533) NULL COMMENT "",
`safety_belt` varchar(65533) NULL COMMENT "",
`vpc_update_time` varchar(65533) NULL COMMENT "",
`yyy_color_desc` varchar(65533) NULL COMMENT "",
`window_qulity_reliability` varchar(65533) NULL COMMENT "",
`aaaa_ape_viid_id` varchar(65533) NULL COMMENT "",
`yyy_model_code` varchar(65533) NULL COMMENT "",
`xxx_city_desc` varchar(65533) NULL COMMENT "",
`belt_reliability` varchar(65533) NULL COMMENT "",
`original_yyy_class_desc` varchar(65533) NULL COMMENT "",
`uuu_class_desc` varchar(65533) NULL COMMENT "",
`car_seating_reliability` varchar(65533) NULL COMMENT "",
`bbb_width_main` varchar(65533) NULL COMMENT "",
`smoking` varchar(65533) NULL COMMENT "",
`big_xxx_name` varchar(65533) NULL COMMENT "",
`using_properties_desc` varchar(65533) NULL COMMENT "",
`is_cap_reliability` varchar(65533) NULL COMMENT "",
`direction` varchar(65533) NULL COMMENT "",
`analysis_obj_id` varchar(65533) NULL COMMENT "",
`info_kind` varchar(65533) NULL COMMENT "",
`ddd_cap_direction` varchar(65533) NULL COMMENT "",
`vvid` varchar(65533) NULL COMMENT "",
`yyy_spec` varchar(65533) NULL COMMENT "",
`ccc_road_name` varchar(65533) NULL COMMENT "",
`yyy_category_desc` varchar(65533) NULL COMMENT "",
`calling_reliability` varchar(65533) NULL COMMENT "",
`xxx_last_min_char_reliability` varchar(65533) NULL COMMENT "",
`yyy_class_ext` varchar(65533) NULL COMMENT "",
`xxx_province` varchar(65533) NULL COMMENT ""
) ENGINE=OLAP
PRIMARY KEY(`uuu_id`, `xxx_no`, `time`)
COMMENT "OLAP"
PARTITION BY date_trunc('day', `time`)
DISTRIBUTED BY HASH(`uuu_id`, `xxx_no`, `time`)
PROPERTIES (
"compression" = "LZ4",
"datacache.enable" = "true",
"datacache.partition_duration" = "60 days",
"enable_async_write_back" = "false",
"persistent_index_type" = "LOCAL",
"replication_num" = "1",
"storage_volume" = "builtin_storage_volume"
);
部分监控指标信息
