Hi LakeShen
You could refer to [1] and [2] to know the temporary directory in YARN, the related log could be
"Setting directories for temporary files to: " or "Overriding Fink's temporary file directories with those specified in the Flink config: "
[1]
https://github.com/apache/flink/blob/0dda6fe9dff4f667b110cda39bfe9738ba615b24/flink-yarn/src/main/java/org/apache/flink/yarn/YarnTaskExecutorRunner.java#L103[2]
https://github.com/apache/flink/blob/0dda6fe9dff4f667b110cda39bfe9738ba615b24/flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/BootstrapTools.java#L478-L489Best
Yun Tang
________________________________
From: Till Rohrmann <
[hidden email]>
Sent: Wednesday, May 6, 2020 17:35
To: LakeShen <
[hidden email]>
Cc: dev <
[hidden email]>; user <
[hidden email]>; user-zh <
[hidden email]>
Subject: Re: What is the RocksDB local directory in flink checkpointing?
Hi LakeShen,
`state.backend.rocksdb.localdir` defines the directory in which RocksDB
will store its local files. Local files are RocksDB's SST and metadata
files for example. This directory does not need to be persisted. If the
config option is not configured, then it will use the nodes temporary file
directory.
Cheers,
Till
On Wed, May 6, 2020 at 6:07 AM LakeShen <
[hidden email]> wrote:
> Hi community,
>
> Now I have a question about flink checkpoint local directory , our flink
> version is 1.6, job mode is
>
> flink on yarn per job . I saw the flink source code , and I find the flink
> checkpoint local directory is
>
> /tmp when you didn't config the "state.backend.rocksdb.localdir". But I go
> into the /tmp dir ,I
>
> couldn't find the flink checkpoint state local directory.
>
> What is the RocksDB local directory in flink checkpointing? I am looking
> forward to your reply.
>
> Best,
> LakeShen
>
Locked
