开发者社区 > 大数据与机器学习 > 实时计算 Flink > 正文

Flink CDC提交flink任务到yarn, 偶而报错,什么原因?

Flink CDC提交flink任务到yarn, 偶而报错
Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:47,612 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:48,612 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:49,613 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:50,614 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:51,615 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:52,615 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:53,616 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:54,617 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:55,617 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:56,620 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
2023-11-16 15:44:57,621 flink-akka.actor.default-dispatcher-5 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)?

展开
收起
真的很搞笑 2023-11-22 08:17:09 138 0
2 条回答
写回答
取消 提交回答
  • 面对过去,不要迷离;面对未来,不必彷徨;活在今天,你只要把自己完全展示给别人看。

    这个错误是因为客户端试图连接ResourceManager失败,但ResourceManager的地址是0.0.0.0/0.0.0.0:8030。这通常表明网络有问题或 ResourceManager 不在线。
    要解决这个问题,请确保 ResourceManager 在线并且可以通过正确的主机名或IP地址访问它。您还可以检查客户端和 ResourceManager 是否在同一个子网内,并且网络配置正确。
    如果您在YARN集群上部署了Kubernetes插件,请确保 ResourceManager 的配置正确,并且 ResourceManager 服务器是可见的。例如,您可以使用 kubectl get pods 来检查 ResourceManager pod 的状态,确认其处于运行状态。

    2023-11-29 14:01:55
    赞同 展开评论 打赏
  • 你这看起来是集群问题,一直在重试,此回答整理自钉群“Flink CDC 社区”

    2023-11-22 11:52:11
    赞同 展开评论 打赏

实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。

相关产品

  • 实时计算 Flink版
  • 热门讨论

    热门文章

    相关电子书

    更多
    Flink CDC Meetup PPT - 龚中强 立即下载
    Flink CDC Meetup PPT - 王赫 立即下载
    Flink CDC Meetup PPT - 覃立辉 立即下载