Flink SQL Hive 使用 partition.include 结果跟文档不一致

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink SQL Hive 使用 partition.include 结果跟文档不一致

macia kk
Flink 1.12.1

streaming-source.partition.includeOption to set the partitions to read, the
supported option are `all` and `latest`, the `all` means read all
partitions; the `latest` means read latest partition in order of
'streaming-source.partition.order', the `latest` only works` when the
streaming hive source table used as temporal table. By default the option
is `all`.


报错
Flink SQL> SELECT * FROM exrate_table /*+
OPTIONS('streaming-source.enable'='true','streaming-source.partition.include'
= 'latest') */; [ERROR] Could not execute SQL statement. Reason:
java.lang.IllegalArgumentException: The only supported
'streaming-source.partition.include' is 'all' in hive table scan, but is
'latest'
Reply | Threaded
Open this post in threaded view
|

Re: Flink SQL Hive 使用 partition.include 结果跟文档不一致

Leonard Xu
Hi

> 在 2021年2月5日,09:47,macia kk <[hidden email]> 写道:
>
> the `latest` only works` when the
> streaming hive source table used as temporal table.

只能用在temporal(时态)表中,时态表只能在 temporal join(也就是我们常说的维表join) 中使用

祝好