开发者社区> 问答> 正文

canal 无法读取rds上的oss日志

简单描述就是配置了 ak,sk,insId,但是没有拉取oss历史binlog

下边信息已经设置,还是无法读取18小时之前的 binlog 日志 #rds oss binlog canal.instance.rds.accesskey=2zA12sL23cxxxxx canal.instance.rds.secretkey=iEl12120i341jv326udxxxxxxxx canal.instance.rds.instanceId=rm-bp1u3833xxxxxx

配置文件只配置了时间戳 canal.instance.master.journal.name= canal.instance.master.position= canal.instance.master.timestamp=1616221497000 canal.instance.master.gtid=

2021-03-24 15:48:38.168 [destination = bsk_update , address = rm-m5xxxxxxxxxxxxc.mysql.rds.aliyuncs.com/xxxxx:3306 , EventParser] WARN c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> begin to find start position, it will be long time for reset or first position 2021-03-24 15:48:38.168 [destination = bsk_update , address = rm-xxxxxxxxx.mysql.rds.aliyuncs.com/xxxxxxxxxx:3306 , EventParser] WARN c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - prepare to find start position ::1616221497000 2021-03-24 15:48:38.189 [destination = bsk_update , address = rm-xxxxxxxxx.mysql.rds.aliyuncs.com/xxxxxxxxxx:3306 , EventParser] WARN c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - Didn't find the corresponding binlog files from mysql-bin.004069 to mysql-bin.004070 2021-03-24 15:48:38.189 [destination = bsk_update , address = rm-mxxxxxxxx.mysql.rds.aliyuncs.com/xxxx.xx1.xxxx.xxxx:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - dump address rm-xxxxxxxmysql.rds.aliyuncs.com/xxxx.31.xxx.54:3306 has an error, retrying. caused by com.alibaba.otter.canal.parse.exception.PositionNotFoundException: can't find start position for bsk_update 2021-03-24 15:48:38.190 [destination = bsk_update , address = rm-xxxxxxxxxxxx.mysql.rds.aliyuncs.com/xxx.xx.xx.xx:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:bsk_update[com.alibaba.otter.canal.parse.exception.PositionNotFoundException: can't find start position for bsk_update

提问132.png

我看源码 batchFileSize = 4;// 最多下载的binlog文件数量 跟这个有关系吗?

原提问者GitHub用户jhhnjhhn

展开
收起
山海行 2023-04-27 18:43:28 169 0
1 条回答
写回答
取消 提交回答
  • 中间版本换ak/sk的名字了,最新的代码做了兼容处理

    canal.aliyun.accessKey = canal.aliyun.secretKey =

    1.1.5的代码:

    回答15.png

    原回答者GitHub用户agapple

    2023-04-28 13:38:57
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
PostgresChina2018_赖思超_PostgreSQL10_hash索引的WAL日志修改版final 立即下载
Kubernetes下日志实时采集、存储与计算实践 立即下载
日志数据采集与分析对接 立即下载

相关镜像