flink to hdfs StreamingFileSink.forBulkFormat file rename

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

flink to hdfs StreamingFileSink.forBulkFormat file rename

XW Marvin
补充下问题

Flink 1.9.0

1. 使用StreamingFileSink 消费kafka数据到HDFS
2. 开启了EXACTLY_ONCE
3. StreamingFileSink.forBulkFormat,Parquet格式、snappy压缩

写入hdfs的文件都是
part-{parallel-task}-{count}
这种格式

如何重命名啊?