flink如何使用oss作为checkpoint/savepoint/statebackend?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

flink如何使用oss作为checkpoint/savepoint/statebackend?

casel.chen
请问flink如何使用oss作为checkpoint/savepoint/statebackend? 需要依赖Hadoop并配置Hadoop on OSS吗?
Reply | Threaded
Open this post in threaded view
|

Re: flink如何使用oss作为checkpoint/savepoint/statebackend?

Yun Tang
Hi

其实社区文档 [1] 已经给了很详细的步骤:

  1.  将flink-oss-fs-hadoop jar包放在plugins目录下
  2.  配置oss的endpoint,id和secret
  3.  在需要使用oss的地方,声明oss:// 开头的schema,例如state backend创建的时候

[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/filesystems/oss.html

祝好
唐云
________________________________
From: 陈帅 <[hidden email]>
Sent: Wednesday, December 30, 2020 20:53
To: [hidden email] <[hidden email]>
Subject: flink如何使用oss作为checkpoint/savepoint/statebackend?

请问flink如何使用oss作为checkpoint/savepoint/statebackend? 需要依赖Hadoop并配置Hadoop on OSS吗?
Reply | Threaded
Open this post in threaded view
|

回复: flink如何使用oss作为checkpoint/savepoint/statebackend?

changleying


发送自 Windows 10 版邮件应用

发件人: Yun Tang
发送时间: 2020年12月31日 10:00
收件人: [hidden email]
主题: Re: flink如何使用oss作为checkpoint/savepoint/statebackend?

Hi

其实社区文档 [1] 已经给了很详细的步骤:

  1.  将flink-oss-fs-hadoop jar包放在plugins目录下
  2.  配置oss的endpoint,id和secret
  3.  在需要使用oss的地方,声明oss:// 开头的schema,例如state backend创建的时候

[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/filesystems/oss.html

祝好
唐云
________________________________
From: 陈帅 <[hidden email]>
Sent: Wednesday, December 30, 2020 20:53
To: [hidden email] <[hidden email]>
Subject: flink如何使用oss作为checkpoint/savepoint/statebackend?

请问flink如何使用oss作为checkpoint/savepoint/statebackend? 需要依赖Hadoop并配置Hadoop on OSS吗?