FLINK WEEKLY 2019/46

[tison]

FLINK WEEKLY 2019/46 <https://zhuanlan.zhihu.com/p/92339789>用户问题

   -

   关于从savepoint启动作业报错 migration for MapState currently isn't supported.
   <https://lists.apache.org/x/thread.html/3720e98cdc892f0d716dde9afb93afe3784f51a9c013de88d06a645e@%3Cuser-zh.flink.apache.org%3E>:
   1.10 中支持了 RocksDB StateBackend 的 MapState 演化
   -

   flink里删除cassandra的记录
   <https://lists.apache.org/x/thread.html/2bc64b11fdcdcf518692bd68f21b6869abb0bd4ba0e7388c080ada17@%3Cuser-zh.flink.apache.org%3E>
   -

   Queryable State 查询反序列化问题
   <https://lists.apache.org/x/thread.html/0baab135fa31635ff3db76810e732c8aba9bd5f0a9bb32c0d783e1d7@%3Cuser-zh.flink.apache.org%3E>
   -

   flink ScalarFunction 重写 getParameterTypes 方法不生效
   <https://lists.apache.org/x/thread.html/9cfe297b44e2b7b1e5f64457ece85900acb4df0aced52b89ffbc2333@%3Cuser-zh.flink.apache.org%3E>
   -

   编写 keyed raw state 的例子
   <https://lists.apache.org/x/thread.html/9e9ebad1d1d9ebd597b0cb7ec970d9f253f66e431acea5ec5dc3c745@%3Cuser.flink.apache.org%3E>
   -

   手动从 checkpoint 中恢复的方法
   <https://lists.apache.org/x/thread.html/0e75b0a21f6cbbbee50714a3ae6053b442d3df0ccd9c1c3ce0c17ec9@%3Cuser.flink.apache.org%3E>
   -

   Operator name and uuid best practices
   <https://lists.apache.org/x/thread.html/7ec8ef3d25742a01e559b53b133e8935e44c1775fe3f6cbb323e196a@%3Cuser.flink.apache.org%3E>
   -

   how to setup a ha flink cluster on k8s?
   <https://lists.apache.org/x/thread.html/bebeea66d61a7ca42e8767b64a705940acf89218714fbb04fd6e07d5@%3Cuser.flink.apache.org%3E>
   -

   How to unsubscribe the Apache projects and jira issues notification
   <https://lists.apache.org/x/thread.html/579f9bbf117a1a7dc0d8c1f5a5f609caf7cf21f7c2bff2520cf6c5ef@%3Cuser.flink.apache.org%3E>:
   取消订阅的方式是发送任意邮件到 unsubscribe-<list>@<project>.apache.org
   -

   Checkpoint 完成速度慢的问题
   <https://lists.apache.org/x/thread.html/3c9ad07e4b64c69fa76ec56d43368450334ae7baed2a0b13b8a1b372@%3Cuser.flink.apache.org%3E>:
   可能是由于 back pressure 导致的
   -

   Initialization of broadcast state before processing main stream
   <https://lists.apache.org/x/thread.html/e2afd6d2afc7bfc17b0607f5646b952f964bf35bd22e8547432d7815@%3Cuser.flink.apache.org%3E>
   -

   Flink-JDBC JDBCUpsertTableSink keyFields Problem
   <https://lists.apache.org/x/thread.html/d03f6ceb0d0a7947fd4d567f9f8caf12bf8d267bb7baa4583041f8af@%3Cuser.flink.apache.org%3E>
   -

   Propagating event time field from nested query
   <https://lists.apache.org/x/thread.html/d0daf17f1a08e31ccbecfc42b6ec8eeeec291c60a1bb806834aeea2b@%3Cuser.flink.apache.org%3E>
   -

   Monitor rocksDB memory usage
   <https://lists.apache.org/x/thread.html/d4cf7a06dce761106532c72cf11da45424e30ea1800e39742eb607d9@%3Cuser.flink.apache.org%3E>

已知缺陷

   -

   Starting a TaskExecutor blocks the YarnResourceManager's main thread
   <https://issues.apache.org/jira/browse/FLINK-13184>: 目前，YARN 上启动 FLINK
   集群可能由于同步申请 slot 的耗时而阻塞 FLINK RM 相当长的一段时间，这会导致 FLINK RM 和 TM 心跳超时。Yang Wang
   采取的修复是异步的申请 slot 以保证 FLINK RM 的可用性。目前 PR 正在 review 中，预计将会在 1.8.3 1.9.2 和
   1.10.0 中上线
   -

   Pyflink building failure in master and 1.9.0 version
   <https://issues.apache.org/jira/browse/FLINK-14066>: Windows 上的 PyFlink
   编译不通过，这是因为路径配置采用了操作系统敏感的方法的原因

开发讨论

   -

   [DISCUSS] FLIP-27: Refactor Source Interface
   <http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-27-Refactor-Source-Interface-td24952.html>:
   Source 接口的重构正在开发中，有可能在 1.10 里包括它的一个初步实现
   -

   [DISCUSS] FLIP-86: Improve Connector Properties
   <http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-86-Improve-Connector-Properties-td34922.html>:
   Jark Wu 的 FLIP-86 旨在提升 Table API/SQL 连接器的配置格式
   -

   [[DISCUSSION] Kafka Metrics Reporter]: Gyula Fóra 提出了在 FLINK 中加入 Kafka
   实现的 Metrics Report 的讨论

社区发展

   -

   [DISCUSS] Releasing Flink 1.8.3
   <http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-Flink-1-8-3-td34811.html>:
   来自阿里的工程师 Hequn Cheng 成为了 1.8.3 的 Release Manager
   -

   [DISCUSS] Release flink-shaded 9.0
   <http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Release-flink-shaded-9-0-td35041.html>:
   Chesnay Schepler 发起了发布 flink-shaded 9.0 的讨论