flink-spillable-statebackend不能正常使用

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

flink-spillable-statebackend不能正常使用

jiafu
各位同学:
flink-1.11有一个spillable-statebackend提供给大家做前瞻使用。做了一个测试,并不能很好的工作,整体运行还是会出现OOM。相关配置参数如下:
//使用spillableStateBackend
env.setStateBackend(new SpillableStateBackend(path));

-yD jobmanager.memory.process.size=4096m \
-yD taskmanager.memory.process.size=4096m \
-yD taskmanager.memory.managed.size=512m \
-yD state.backend.spillable.chunk-size=128m \
-yD state.backend.spillable.gc-time.threshold=1s \
-yD state.backend.spillable.trigger-interval=1s \
-yD state.backend.spillable.heap-status.check-interval=1s \

请指导,谢谢!