不同程序间checkpoint迁移

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

不同程序间checkpoint迁移

gimlee
程序A:jar  source: kafka
程序B:Flink SQL  source: kafka
使用同一个topic, group id
如果需要把A停掉,使用B替换A,需要把A的checkpoint中的数据、kafka的分区和offset信息改成程序B的checkpoint,请问有办法或者有工具实现嘛?



--
Sent from: http://apache-flink.147419.n8.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: 不同程序间checkpoint迁移

Yun Tang
Hi,

Flink state processor[1] 应该可以满足你的需求。

[1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html

祝好
唐云
________________________________
From: gimlee <[hidden email]>
Sent: Friday, January 22, 2021 12:07
To: [hidden email] <[hidden email]>
Subject: 不同程序间checkpoint迁移

程序A:jar  source: kafka
程序B:Flink SQL  source: kafka
使用同一个topic, group id
如果需要把A停掉,使用B替换A,需要把A的checkpoint中的数据、kafka的分区和offset信息改成程序B的checkpoint,请问有办法或者有工具实现嘛?



--
Sent from: http://apache-flink.147419.n8.nabble.com/