测试flinkcdc3.0 同步mysql到doris,就是docs里的例子,17kb的源库,怎么都不成功?flink版本1.17.2source: type: mysql hostname: localhost port: 3306 username: root password: 123456 tables: app_db..* server-id: 5400 server-time-zone: UTCsink: type: doris fenodes: 127.0.0.1:8030 username: root password: "" table.create.properties.light_schema_change: true table.create.properties.replication_num: 1pipeline: name: Sync MySQL Database to Doris parallelism: 1``2023-12-13 22:47:11java.lang.IllegalStateException: Failed to send request to coordinator: com.ververica.cdc.runtime.operators.schema.event.SchemaChangeRequest@9b5c3d87Caused by: java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Invocation of [RemoteRpcInvocation(JobMasterOperatorEventGateway.sendRequestToCoordinator(OperatorID, SerializedValue))] at recipient [akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3] timed out. This is usually caused by: 1) Akka failed sending the message silently, due to problems like oversized payload or serialization failures. In that case, you should find detailed error information in the logs. 2) The recipient needs more time for responding, due to problems like slow machines or network jitters. In that case, you can try to increase akka.ask.timeout. at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999) at com.ververica.cdc.runtime.operators.schema.SchemaOperator.sendRequestToCoordinator(SchemaOperator.java:123) ... 26 moreCaused by: java.util.concurrent.TimeoutException: Invocation of [RemoteRpcInvocation(JobMasterOperatorEventGateway.sendRequestToCoordinator(OperatorID, SerializedValue))] at recipient [akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3] timed out. This is usually caused by: 1) Akka failed sending the message silently, due to problems like oversized payload or serialization failures. In that case, you should find detailed error information in the logs. 2) The recipient needs more time for responding, due to problems like slow machines or network jitters. In that case, you can try to increase akka.ask.timeout. at com.sun.proxy.$Proxy25.sendRequestToCoordinator(Unknown Source) at org.apache.flink.runtime.taskexecutor.rpc.RpcTaskOperatorEventGateway.sendRequestToCoordinator(RpcTaskOperatorEventGateway.java:73) at com.ververica.cdc.runtime.operators.schema.SchemaOperator.sendRequestToCoordinator(SchemaOperator.java:121) ... 26 moreCaused by: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka.tcp://flink@localhost:6123/user/rpc/jobmanager_3#1975425594]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.RemoteFencedMessage]. A typical reason for
AskTimeoutException` is that the recipient actor didn't send a reply.
从你提供的错误信息来看,问题可能是由于Flink CDC在向JobManager发送请求时超时导致的。以下是一些可能的解决方法:
akka.ask.timeout: 30 s
这将把默认的10秒超时时间增加到30秒。你可以根据实际情况调整这个值。增加一下 akka.ask.timeout 这个参数试下。doris 里 app_db 这个数据库要先创建一下,还没支持自动创建数据库。 ,此回答整理自钉群“Flink CDC 社区”
版权声明:本文内容由阿里云实名注册用户自发贡献,版权归原作者所有,阿里云开发者社区不拥有其著作权,亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容,填写侵权投诉表单进行举报,一经查实,本社区将立刻删除涉嫌侵权内容。
实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。