【详述】MySQL全库同步到SR，MySQL源表有BYTES字段，导致同步失败，报的错误是：Unsupported CDC data type BYTES。有什么比较好的办法，可以自动过滤所有的BYTES字段，或者把BYTES转成STRING类型，Flink CDC没有找到好的配置
【背景】
【业务影响】无法全库同步
【是否存算分离】否
【StarRocks版本】3.3.13
【集群规模】例如：3fe（1 follower+2observer）+5be（
【联系方式】社区群26-顽强
【附件】
yaml文件如下：
source:
type: mysql
hostname: cdh-01
port: 3306
username: root
password: **********
tables: dolphinscheduler.(?!QRTZ_).,jimureport..
server-id: 5400-5404
server-time-zone: Asia/Shanghai
tables.exclude: “jimureport.tmp_report_data_1,jimureport.tmp_report_data_income,dolphinscheduler.QRTZ_JOB_DETAILS,dolphinscheduler.QRTZ_BLOB_TRIGGERS”
sink:
type: starrocks
name: StarRocks Sink
jdbc-url: jdbc:mysql:loadbalance://starrocks-fe-01:9030,starrocks-fe-02:9030,starrocks-fe-03:9030/ods
load-url: starrocks-fe-01:8030;starrocks-fe-02:8030;starrocks-fe-03:8030
username: root
password: “****“”
table.create.properties.replication_num: 3
scan.newly-added-table.enabled: true
scan.binlog.newly-added-table.enabled: true
pipeline:
name: Sync MySQL Database to StarRocks
parallelism: 2
schema-operator.rpc-timeout: 5min
route:
- source-table: dolphinscheduler..*
sink-table: ods.dolphinscheduler__<>
replace-symbol: <>
description: route all tables in source_db to sink_db - source-table: jimureport..*
sink-table: ods.jimureport__<>
replace-symbol: <>
description: route all tables in source_db to sink_db