Flink1.9 yarn session模式 经常Ask timed out

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink1.9 yarn session模式 经常Ask timed out

star
您好,

Flink1.9 yarn session模式  经常Ask timed out


在执行flink list shell命令的时候连接不上 报
akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#180439734]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.



提交作业也是一样
Caused by: java.util.concurrent.ExecutionException: org.apache.flink.runtime.rest.util.RestClientException: [Job cancellation timed out.]





此时web ui打开会一直提示:Server Response Message: Internal server error.     作业列表也是空的






此种情况过阵子自己能恢复,但是这期间什么都干不了


请问大家有遇到过吗? 谢谢
Reply | Threaded
Open this post in threaded view
|

Re: Flink1.9 yarn session模式 经常Ask timed out

Benchao Li
我们一般遇到这种情况,大都是JobManager Full GC导致的。你可以检查下你的JM的内存使用情况

star <[hidden email]> 于2020年6月2日周二 上午10:03写道:

> 您好,
>
> Flink1.9 yarn session模式&nbsp; 经常Ask timed out
>
>
> 在执行flink list shell命令的时候连接不上 报
> akka.pattern.AskTimeoutException: Ask timed out on
> [Actor[akka://flink/user/dispatcher#180439734]] after [10000 ms]. Message
> of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A
> typical reason for `AskTimeoutException` is that the recipient actor didn't
> send a reply.
>
>
>
> 提交作业也是一样
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.flink.runtime.rest.util.RestClientException: [Job cancellation
> timed out.]
>
>
>
>
>
> 此时web ui打开会一直提示:Server Response Message: Internal server error.&nbsp;
> &nbsp; &nbsp;作业列表也是空的
>
>
>
>
>
>
> 此种情况过阵子自己能恢复,但是这期间什么都干不了
>
>
> 请问大家有遇到过吗? 谢谢



--

Best,
Benchao Li
Reply | Threaded
Open this post in threaded view
|

回复: Flink1.9 yarn session模式 经常Ask timed out

star
感谢回复,我调大JM内存试试




------------------&nbsp;原始邮件&nbsp;------------------
发件人:&nbsp;"Benchao Li"<[hidden email]&gt;;
发送时间:&nbsp;2020年6月2日(星期二) 上午10:06
收件人:&nbsp;"user-zh"<[hidden email]&gt;;

主题:&nbsp;Re: Flink1.9 yarn session模式 经常Ask timed out



我们一般遇到这种情况,大都是JobManager Full GC导致的。你可以检查下你的JM的内存使用情况

star <[hidden email]&gt; 于2020年6月2日周二 上午10:03写道:

&gt; 您好,
&gt;
&gt; Flink1.9 yarn session模式&amp;nbsp; 经常Ask timed out
&gt;
&gt;
&gt; 在执行flink list shell命令的时候连接不上 报
&gt; akka.pattern.AskTimeoutException: Ask timed out on
&gt; [Actor[akka://flink/user/dispatcher#180439734]] after [10000 ms]. Message
&gt; of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A
&gt; typical reason for `AskTimeoutException` is that the recipient actor didn't
&gt; send a reply.
&gt;
&gt;
&gt;
&gt; 提交作业也是一样
&gt; Caused by: java.util.concurrent.ExecutionException:
&gt; org.apache.flink.runtime.rest.util.RestClientException: [Job cancellation
&gt; timed out.]
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; 此时web ui打开会一直提示:Server Response Message: Internal server error.&amp;nbsp;
&gt; &amp;nbsp; &amp;nbsp;作业列表也是空的
&gt;
&gt;
&gt;
&gt;
&gt;
&gt;
&gt; 此种情况过阵子自己能恢复,但是这期间什么都干不了
&gt;
&gt;
&gt; 请问大家有遇到过吗? 谢谢



--

Best,
Benchao Li