|
各位同学:
flink-1.11有一个spillable-statebackend提供给大家做前瞻使用。做了一个测试,并不能很好的工作,整体运行还是会出现OOM。相关配置参数如下:
//使用spillableStateBackend
env.setStateBackend(new SpillableStateBackend(path));
-yD jobmanager.memory.process.size=4096m \
-yD taskmanager.memory.process.size=4096m \
-yD taskmanager.memory.managed.size=512m \
-yD state.backend.spillable.chunk-size=128m \
-yD state.backend.spillable.gc-time.threshold=1s \
-yD state.backend.spillable.trigger-interval=1s \
-yD state.backend.spillable.heap-status.check-interval=1s \
请指导,谢谢!
|