Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?

Lei Wang
如题, 可以直接这样写吗?

env.setStateBackend(new RocksDBStateBackend(“oss://”, true));

谢谢,
王磊
Reply | Threaded
Open this post in threaded view
|

Re: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?

Yun Tang
Hi 王磊,

当然是可以的,state backend的checkpoint地址其实依赖于Flink的file system实现,只要参照文档[1]的描述,对oss进行相关配置即可。

[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/filesystems/oss.html#shaded-hadoop-oss-file-system


祝好
唐云
________________________________
From: Lei Wang <[hidden email]>
Sent: Monday, December 28, 2020 16:21
To: [hidden email] <[hidden email]>
Subject: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?

如题, 可以直接这样写吗?

env.setStateBackend(new RocksDBStateBackend(“oss://”, true));

谢谢,
王磊
Reply | Threaded
Open this post in threaded view
|

Re: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?

seuzxc
我用oss设置,状态信息能写入,但是oss日志总是提示如下的信息,有遇到过吗?

2021-03-08 20:18:58.512  [INFO][cluster-io-thread-2]:
o.a.f.f.o.s.c.a.o.c.u.LogUtils 66 logException - [Server]Unable to execute
HTTP request: Not Found
[ErrorCode]: NoSuchKey
[RequestId]: 6046163285863333350B9C61
[HostId]: null




--
Sent from: http://apache-flink.147419.n8.nabble.com/