flink reduce becoming increasingly over time

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

flink reduce becoming increasingly over time

XW Marvin
Hi All

This My Coding:

statDataStream
  .map(new InnerStatMap(logType))
    .uid("InnerStatMap").name("InnerStatMap")
  .keyBy(new InnerKeySelector)
  .timeWindow(Time.seconds(statTimeWindow))
  .reduce(new InnerStatReduce)
    .uid("InnerReduce").name("InnerReduce")
  .addSink(innerStatProducer)
    .uid("InnerSink").name("InnerSink")
  .setParallelism(sinkParallelism)


I find checkpoint state is becoming increasingly over time

best wishes