Flink Weekly | 每周社区动态更新 - 2020/01/07

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Flink Weekly | 每周社区动态更新 - 2020/01/07

Yun Tang
大家好

2020年转眼就来了,先恭喜大家新年快乐,Flink社区也会在新的一年中继续陪伴大家,一起来把Flink做大做好。

本周社区主要新闻是Flink-1.10.0的发布进展,将blink planner设置为SQL client默认planner的讨论,以及如何支持SQL client gateway的FLIP。

Flink开发进展
==============
* [**Release**] Yu分享了目前Flink-1.10发布的喜人进展,release-1.10分支刚被拉出来时有46个blocker,11个critical级别的issue,目前已经下降到只有12个blocker级别的issue,一个RC版本有望于近期发布,可以访问下面的链接一睹为快 [1]

* [**Build**] 在社区邮件达成一致后,目前Flink已经移除了厂商提供的仓库支持 [2] & [3]

* [**SQL**] ForwardXu发起了FLIP-90(在FlinkSQL中支持SQL 2016-2017 JSON函数)的投票,考虑到讨论时没有收到负面意见,该投票有望较快通过 [4] & [5]。

* [**SQL**] Jark发起了在Table API&SQL中将"Time-windowed Join"重命名为"Interval Join" 的投票 [6]。

* [**SQL**] Jark发起了将Blink planner在release 1.10中设置为SQL Client默认planner的讨论。目前Table API仍然使用Flink planner,但是也规划在release 1.11中将Blink planner设置为默认planner。理论上来说Blink planner是Flink planner的超集,当然不排除一些边角功能没有覆盖到,如果你有任何相关发现,欢迎在下面的邮件中回复 [7].

* [**SQL**] Godfreyhe 发起了支持SQL client gateway(FLIP-91)的讨论 [8]。 FLIP-91的目标是在FLIP-24的基础上使得SQL Client支持REST/JDBC接口,提高Flink SQL的易用性。

[1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Progress-of-Apache-Flink-1-10-3-td36359.html
[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Drop-vendor-specific-repositories-from-pom-xml-td36113.html
[3] https://issues.apache.org/jira/browse/FLINK-15459
[4] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-90-Support-SQL-2016-2017-JSON-functions-in-Flink-SQL-td36341.html
[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Support-JSON-functions-in-Flink-SQL-td32674.html
[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Rename-terminology-quot-Time-windowed-Join-quot-to-quot-Interval-Join-quot-in-Table-API-amp-SQL-td36370.html
[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Set-default-planner-for-SQL-Client-to-Blink-planner-in-1-10-release-td36379.html
[8] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-91-Support-SQL-Client-Gateway-td36349.html


需要注意的一些缺陷
==============
* [FLINK-15477] [1.9.1] 有用户反馈无法创建BatchTableEnvironment [9]

* [FLINK-15467] [1.9.1] task cancel阶段没有等待source线程发送完全数据 [10]

* [FLINK-15466] [1.8.3][1.9.1] `FlinkAggregateExpandDistinctAggregatesRule` 会在执行带有过滤的distinct aggs时创建错误的SQL plan [11]

* [FLINK-15463] [1.9.1] 使用table SQL API连接phoenix时,会遇到ClassNotFoundException异常 [12]
<https://issues.apache.org/jira/browse/FLINK-15463>

[9]   https://issues.apache.org/jira/browse/FLINK-15477
[10] https://issues.apache.org/jira/browse/FLINK-15467
[11] https://issues.apache.org/jira/browse/FLINK-15466
[12] https://issues.apache.org/jira/browse/FLINK-15463

中文邮件问题答疑汇总
===================
* IDEA默认选择java11 profile,导致IDEA在JDK8下无法编译Flink。已经获得了相关解决方法:[13]

* Flink内存配置相关的问题解答:[14]

* 如何获取一条数据记录的处理时间:[15]

* StreamTableEnvironment.registerDatastream() 开放用户自定义的schemaDescriptionh和DeserializationSchema:[16]

[13] http://apache-flink.147419.n8.nabble.com/Error-java-add-exports-java-base-sun-net-util-ALL-UNNAMED-td943.html
[14] http://apache-flink.147419.n8.nabble.com/flink-td1358.html
[15] http://apache-flink.147419.n8.nabble.com/-td1380.html
[16] http://apache-flink.147419.n8.nabble.com/StreamTableEnvironment-registerDatastream-schemaDescriptionh-DeserializationSchema-td1347.html

祝好
唐云