关于广播流的疑问

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

关于广播流的疑问

Chris Guo

Hi

在官网上看到关于广播流的说法,有一些疑问,在文档[1]写到广播后台的state backend只有in memory,没有rocksdb。在CoBroadcastWithKeyedOperator的open方法中,状态是通过getOperatorStateBackend().getBroadcastState(descriptor)创建的,getOperatorStateBackend()中通过stateBackend.createOperatorStateBackend创建对应的state backend,state backend不是根据配置选择对应的工厂创建出来的吗,这部分是如何限定in memory?

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/stream/state/broadcast_state.html#important-considerations


Best

Looking forward to your reply and help.

| |
a511955993
|
|
邮箱:[hidden email]
|

签名由 网易邮箱大师 定制
Reply | Threaded
Open this post in threaded view
|

回复:关于广播流的疑问

Chris Guo


已经解决,目前OperatorStateBackend的实现只有DefaultOperatorStateBackend


| |
a511955993
|
|
邮箱:[hidden email]
|

签名由 网易邮箱大师 定制

在2020年06月18日 11:29,[hidden email] 写道:

Hi

在官网上看到关于广播流的说法,有一些疑问,在文档[1]写到广播后台的state backend只有in memory,没有rocksdb。在CoBroadcastWithKeyedOperator的open方法中,状态是通过getOperatorStateBackend().getBroadcastState(descriptor)创建的,getOperatorStateBackend()中通过stateBackend.createOperatorStateBackend创建对应的state backend,state backend不是根据配置选择对应的工厂创建出来的吗,这部分是如何限定in memory?

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/stream/state/broadcast_state.html#important-considerations


Best

Looking forward to your reply and help.

| |
a511955993
|
|
邮箱:[hidden email]
|

签名由 网易邮箱大师 定制