flink sql子查询状态清理不掉

classic Classic list List threaded Threaded
2 messages Options
op
Reply | Threaded
Open this post in threaded view
|

flink sql子查询状态清理不掉

op
大家好,我现在程序里面有像这样一段sql:  select day,
           count(id),
           sum(v1) from
(
select 
          day ,
          id ,
          sum(v1) v1 from source
      group by day,
                   id
)t


group by day


我设置了
tConfig.setIdleStateRetentionTime(Time.minutes(1440),Time.minutes(1450))


子查询里面的聚合是按照天和id聚合的,按道理1天之后就会自动清理,但是运行4天过程中,我在checkpoint的页面里面看到这个子查询的状态一直在增大,这是什么原因呢
我的版本是1.10.0
Reply | Threaded
Open this post in threaded view
|

Re: flink sql子查询状态清理不掉

Benchao Li-2
感觉不太应该。你用的是哪个Flink版本,以及哪个planner呢?

op <[hidden email]> 于2020年7月6日周一 上午11:31写道:

> 大家好,我现在程序里面有像这样一段sql:&nbsp; select day,
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;count(id),
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;sum(v1) from
> (
> select&nbsp;
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; day ,
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; id ,
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; sum(v1) v1 from source
> &nbsp; &nbsp; &nbsp; group by day,
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;id
> )t
>
>
> group by day
>
>
> 我设置了
> tConfig.setIdleStateRetentionTime(Time.minutes(1440),Time.minutes(1450))
>
>
>
> 子查询里面的聚合是按照天和id聚合的,按道理1天之后就会自动清理,但是运行4天过程中,我在checkpoint的页面里面看到这个子查询的状态一直在增大,这是什么原因呢
> 我的版本是1.10.0



--

Best,
Benchao Li