Flink 任务提交问题

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink 任务提交问题

guaishushu1103@163.com
CliFrontend 向yarn上提交任务会因为资源不足等原因,导致任务提交进程一直卡着,直到有资源释放为止?



[hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: Flink 任务提交问题

caozhen

是的,flink on yarn启动时申请的container资源不够,会等待,直到有资源。

-------


[hidden email] wrote
> CliFrontend 向yarn上提交任务会因为资源不足等原因,导致任务提交进程一直卡着,直到有资源释放为止?
>
>

> guaishushu1103@





--
Sent from: http://apache-flink.147419.n8.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re:Re: Flink 任务提交问题

hailongwang


是的,具体代码逻辑在YarnClusterDescriptor#startAppMaster,会一直检测app state。
如果需要的话,可以自己增加超时判断(在旧版本中有这个逻辑,比如1.4.2)。




Best,
Hailong Wang


在 2020-10-12 17:17:44,"caozhen" <[hidden email]> 写道:

>
>是的,flink on yarn启动时申请的container资源不够,会等待,直到有资源。
>
>-------
>
>
>[hidden email] wrote
>> CliFrontend 向yarn上提交任务会因为资源不足等原因,导致任务提交进程一直卡着,直到有资源释放为止?
>>
>>
>
>> guaishushu1103@
>
>
>
>
>
>--
>Sent from: http://apache-flink.147419.n8.nabble.com/