HI,大家好:
我在运行Flink官方的Quick Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac OS X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 操作步骤: 1. ./bin/start-cluster.sh # 启动flink。 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 随后就是抛了异常: Starting execution of program Executing WordCount example with default input data set. Use --input to specify file input. Printing result to stdout. Use --output to specify output path. ------------------------------------------------------------ The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: Could not retrieve the execution result. (JobID: 81bc8720dee57710788cc8e41079ba4d) at org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) at org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) at org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown Source) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph. at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) at org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown Source) at java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) at java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) at java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) at org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown Source) at java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) at java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) at java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Internal server error., <Exception on server side: akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply. at akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) at akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown Source) at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) at akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown Source) at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) at scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) at scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) at akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) at akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) at akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) at java.lang.Thread.run(Thread.java:745) End of exception on server side>] at org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) at org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown Source) at java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) ... 4 more 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? 我本地的环境是 jdk 1.8.0, maven 3.5.4 谢谢大家。 |
你好,
MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? [1] https://flink.apache.org/downloads.html Thanks, Biao /'bɪ.aʊ/ On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: > HI,大家好: > 我在运行Flink官方的Quick > Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac OS > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 > > 操作步骤: > 1. ./bin/start-cluster.sh # 启动flink。 > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 > > 随后就是抛了异常: > Starting execution of program > Executing WordCount example with default input data set. > Use --input to specify file input. > Printing result to stdout. Use --output to specify output path. > > ------------------------------------------------------------ > The program finished with the following exception: > > org.apache.flink.client.program.ProgramInvocationException: Could not > retrieve the execution result. (JobID: 81bc8720dee57710788cc8e41079ba4d) > at > > org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) > at > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) > at > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) > at > > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > at > > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > at > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) > at > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) > at > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) > at > > org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) > at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) > at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) > at > > org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) > at > > org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) > at > org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown > Source) > at > > org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) > at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) > Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed > to submit JobGraph. > at > > org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) > at > > org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown > Source) > at > > java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) > at > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > at > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > at > > java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) > at > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > at > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > at > > java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) > at > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > at > > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) > at > > org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) > at > > org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown > Source) > at > > java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) > at > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > at > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > at > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) > at > > java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) > at > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.flink.runtime.rest.util.RestClientException: > [Internal server error., <Exception on server side: > akka.pattern.AskTimeoutException: Ask timed out on > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. Message > of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A > typical reason for `AskTimeoutException` is that the recipient actor didn't > send a reply. > at > > akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) > at akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown > Source) > at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) > at akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown > Source) > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) > at > > scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) > at scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) > at scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) > at > scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) > at > > akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) > at > > akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) > at > > akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) > at > > akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) > at java.lang.Thread.run(Thread.java:745) > > End of exception on server side>] > at > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) > at > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) > at > > org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown > Source) > at > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) > ... 4 more > > > > 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? > 我本地的环境是 jdk 1.8.0, maven 3.5.4 > > 谢谢大家。 > |
你好。
我本地的Flink是官网提供的Binary包,非自己编译的。 我相信我的情况是少数,绝大多数人的Mac都是能跑的。 On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[hidden email]> wrote: > 你好, > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? > > [1] https://flink.apache.org/downloads.html > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: > > > HI,大家好: > > 我在运行Flink官方的Quick > > Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac OS > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 > > > > 操作步骤: > > 1. ./bin/start-cluster.sh # 启动flink。 > > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 > > > > 随后就是抛了异常: > > Starting execution of program > > Executing WordCount example with default input data set. > > Use --input to specify file input. > > Printing result to stdout. Use --output to specify output path. > > > > ------------------------------------------------------------ > > The program finished with the following exception: > > > > org.apache.flink.client.program.ProgramInvocationException: Could not > > retrieve the execution result. (JobID: 81bc8720dee57710788cc8e41079ba4d) > > at > > > > > org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) > > at > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) > > at > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) > > at > > > > > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > > at > > > > > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > > at > > > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:483) > > at > > > > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) > > at > > > > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) > > at > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) > > at > > > > > org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) > > at > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) > > at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) > > at > > > > > org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) > > at > > > > > org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) > > at > > > org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown > > Source) > > at > > > > > org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) > > at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) > > Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed > > to submit JobGraph. > > at > > > > > org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) > > at > > > > > org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown > > Source) > > at > > > > > java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) > > at > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > at > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > at > > > > > java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) > > at > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > at > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > at > > > > > java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) > > at > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > at > > > > > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) > > at > > > > > org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) > > at > > > > > org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown > > Source) > > at > > > > > java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) > > at > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > at > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > at > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) > > at > > > > > java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) > > at > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > at > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: org.apache.flink.runtime.rest.util.RestClientException: > > [Internal server error., <Exception on server side: > > akka.pattern.AskTimeoutException: Ask timed out on > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. Message > > of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A > > typical reason for `AskTimeoutException` is that the recipient actor > didn't > > send a reply. > > at > > > > > akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) > > at akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown > > Source) > > at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) > > at > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown > > Source) > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) > > at > > > > > scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) > > at scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) > > at scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) > > at > > > scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) > > at > > > > > akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) > > at > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) > > at > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) > > at > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) > > at java.lang.Thread.run(Thread.java:745) > > > > End of exception on server side>] > > at > > > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) > > at > > > > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) > > at > > > > > org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown > > Source) > > at > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) > > ... 4 more > > > > > > > > > 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? > > 我本地的环境是 jdk 1.8.0, maven 3.5.4 > > > > 谢谢大家。 > > > |
这个问题其实还挺常见的,问题有很多种可能。比如你看一下 log 下面 cluster 的日志看看
Dispatcher 有没有正常的起起来,flink-conf 你有没有改过导致超时过短(比如 1 ms)或者 资源不够。也有升级 jdk 小版本后就不复现的。 Best, tison. jeff kit <[hidden email]> 于2019年11月5日周二 下午2:43写道: > 你好。 > 我本地的Flink是官网提供的Binary包,非自己编译的。 > 我相信我的情况是少数,绝大多数人的Mac都是能跑的。 > > On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[hidden email]> wrote: > > > 你好, > > > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 > > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? > > > > [1] https://flink.apache.org/downloads.html > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: > > > > > HI,大家好: > > > 我在运行Flink官方的Quick > > > Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac OS > > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 > > > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 > > > > > > 操作步骤: > > > 1. ./bin/start-cluster.sh # 启动flink。 > > > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 > > > > > > 随后就是抛了异常: > > > Starting execution of program > > > Executing WordCount example with default input data set. > > > Use --input to specify file input. > > > Printing result to stdout. Use --output to specify output path. > > > > > > ------------------------------------------------------------ > > > The program finished with the following exception: > > > > > > org.apache.flink.client.program.ProgramInvocationException: Could not > > > retrieve the execution result. (JobID: > 81bc8720dee57710788cc8e41079ba4d) > > > at > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) > > > at > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) > > > at > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) > > > at > > > > > > > > > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > > > at > > > > > > > > > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) > > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > > > at > > > > > > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > at > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > at java.lang.reflect.Method.invoke(Method.java:483) > > > at > > > > > > > > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) > > > at > > > > > > > > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) > > > at > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) > > > at > > > > > > > > > org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) > > > at > > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) > > > at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) > > > at > > > > > > > > > org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) > > > at > > > > > > > > > org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) > > > at > > > > > > org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown > > > Source) > > > at > > > > > > > > > org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) > > > at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) > > > Caused by: org.apache.flink.runtime.client.JobSubmissionException: > Failed > > > to submit JobGraph. > > > at > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) > > > at > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown > > > Source) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) > > > at > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) > > > at > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown > > > Source) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) > > > at > > > > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > > at > > > > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > > at java.lang.Thread.run(Thread.java:745) > > > Caused by: org.apache.flink.runtime.rest.util.RestClientException: > > > [Internal server error., <Exception on server side: > > > akka.pattern.AskTimeoutException: Ask timed out on > > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. > Message > > > of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A > > > typical reason for `AskTimeoutException` is that the recipient actor > > didn't > > > send a reply. > > > at > > > > > > > > > akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) > > > at akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown > > > Source) > > > at akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) > > > at > > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown > > > Source) > > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) > > > at > > > > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) > > > at > scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) > > > at > scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) > > > at > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) > > > at > > > > > > > > > akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) > > > at > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) > > > at > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) > > > at > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) > > > at java.lang.Thread.run(Thread.java:745) > > > > > > End of exception on server side>] > > > at > > > > > > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) > > > at > > > > > > > > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) > > > at > > > > > > > > > org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown > > > Source) > > > at > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) > > > ... 4 more > > > > > > > > > > > > > > > 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? > > > 我本地的环境是 jdk 1.8.0, maven 3.5.4 > > > > > > 谢谢大家。 > > > > > > |
执行命令 1 的时候,建议打开 localhost:8081 看看是否 Flink UI 打开是否有问题,再或者看看 Flink log 目录下的
jobmanager 和 taskmanager 的日志是否有异常? 我本地测试你同样的命令是 OK 的 tison <[hidden email]> 于2019年11月5日周二 下午3:01写道: > 这个问题其实还挺常见的,问题有很多种可能。比如你看一下 log 下面 cluster 的日志看看 > Dispatcher 有没有正常的起起来,flink-conf 你有没有改过导致超时过短(比如 1 ms)或者 > 资源不够。也有升级 jdk 小版本后就不复现的。 > > Best, > tison. > > > jeff kit <[hidden email]> 于2019年11月5日周二 下午2:43写道: > > > 你好。 > > 我本地的Flink是官网提供的Binary包,非自己编译的。 > > 我相信我的情况是少数,绝大多数人的Mac都是能跑的。 > > > > On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[hidden email]> wrote: > > > > > 你好, > > > > > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 > > > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? > > > > > > [1] https://flink.apache.org/downloads.html > > > > > > Thanks, > > > Biao /'bɪ.aʊ/ > > > > > > > > > > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: > > > > > > > HI,大家好: > > > > 我在运行Flink官方的Quick > > > > Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac > OS > > > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 > > > > > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 > > > > > > > > 操作步骤: > > > > 1. ./bin/start-cluster.sh # 启动flink。 > > > > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 > > > > > > > > 随后就是抛了异常: > > > > Starting execution of program > > > > Executing WordCount example with default input data set. > > > > Use --input to specify file input. > > > > Printing result to stdout. Use --output to specify output path. > > > > > > > > ------------------------------------------------------------ > > > > The program finished with the following exception: > > > > > > > > org.apache.flink.client.program.ProgramInvocationException: Could not > > > > retrieve the execution result. (JobID: > > 81bc8720dee57710788cc8e41079ba4d) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) > > > > at > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) > > > > at > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > > > > at > > > > > > > > > > > > > > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) > > > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > > > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > > > > at > > > > > > > > > > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > at > > > > > > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > > at > > > > > > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:483) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) > > > > at > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) > > > > at > > > > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) > > > > at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) > > > > at > > > > > > > > > > org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown > > > > Source) > > > > at > > > > > > > > > > > > > > org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) > > > > at > org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) > > > > Caused by: org.apache.flink.runtime.client.JobSubmissionException: > > Failed > > > > to submit JobGraph. > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) > > > > at > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown > > > > Source) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) > > > > at > > > > > > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) > > > > at > > > > > > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown > > > > Source) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) > > > > at > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > > > at > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > > > at java.lang.Thread.run(Thread.java:745) > > > > Caused by: org.apache.flink.runtime.rest.util.RestClientException: > > > > [Internal server error., <Exception on server side: > > > > akka.pattern.AskTimeoutException: Ask timed out on > > > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. > > Message > > > > of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A > > > > typical reason for `AskTimeoutException` is that the recipient actor > > > didn't > > > > send a reply. > > > > at > > > > > > > > > > > > > > akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) > > > > at akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown > > > > Source) > > > > at > akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) > > > > at > > > > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown > > > > Source) > > > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) > > > > at > > > > > > > > > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) > > > > at > > scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) > > > > at > > scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) > > > > at > > > > > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) > > > > at > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) > > > > at > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) > > > > at > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) > > > > at > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > End of exception on server side>] > > > > at > > > > > > > > > > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) > > > > at > > > > > > > > > > > > > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) > > > > at > > > > > > > > > > > > > > org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown > > > > Source) > > > > at > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) > > > > ... 4 more > > > > > > > > > > > > > > > > > > > > > > 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? > > > > 我本地的环境是 jdk 1.8.0, maven 3.5.4 > > > > > > > > 谢谢大家。 > > > > > > > > > > |
执行命令1的时候,localhost:8081看上去是正常的,有可用的TaskManager,JobSlot等。log下的StandaloneSession和TaskExecutor的log均无异常。
dispatcher也是正常起来的: 2019-11-03 21:07:58,438 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest endpoint listening at localhost:8081 2019-11-03 21:07:58,438 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - http://localhost:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000 2019-11-03 21:07:58,439 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web frontend listening at http://localhost:8081. 2019-11-03 21:07:58,507 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager . 2019-11-03 21:07:58,526 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher . 2019-11-03 21:07:58,549 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000 2019-11-03 21:07:58,550 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Starting the SlotManager. 2019-11-03 21:07:58,563 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Dispatcher akka.tcp://flink@localhost:6123/user/dispatcher was granted leadership with fencing token 00000000-0000-0000-0000-000000000000 2019-11-03 21:07:58,565 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Recovering all persisted jobs. 2019-11-03 21:08:02,248 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID ba0633856bb7670711e9e4e946168800 (akka.tcp://[hidden email]:54796/user/taskmanager_0) at ResourceManager On Tue, Nov 5, 2019 at 8:21 PM zhisheng <[hidden email]> wrote: > 执行命令 1 的时候,建议打开 localhost:8081 看看是否 Flink UI 打开是否有问题,再或者看看 Flink log 目录下的 > jobmanager 和 taskmanager 的日志是否有异常? > > 我本地测试你同样的命令是 OK 的 > > tison <[hidden email]> 于2019年11月5日周二 下午3:01写道: > > > 这个问题其实还挺常见的,问题有很多种可能。比如你看一下 log 下面 cluster 的日志看看 > > Dispatcher 有没有正常的起起来,flink-conf 你有没有改过导致超时过短(比如 1 ms)或者 > > 资源不够。也有升级 jdk 小版本后就不复现的。 > > > > Best, > > tison. > > > > > > jeff kit <[hidden email]> 于2019年11月5日周二 下午2:43写道: > > > > > 你好。 > > > 我本地的Flink是官网提供的Binary包,非自己编译的。 > > > 我相信我的情况是少数,绝大多数人的Mac都是能跑的。 > > > > > > On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[hidden email]> wrote: > > > > > > > 你好, > > > > > > > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 > > > > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? > > > > > > > > [1] https://flink.apache.org/downloads.html > > > > > > > > Thanks, > > > > Biao /'bɪ.aʊ/ > > > > > > > > > > > > > > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: > > > > > > > > > HI,大家好: > > > > > 我在运行Flink官方的Quick > > > > > > Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac > > OS > > > > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 > > > > > > > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 > > > > > > > > > > 操作步骤: > > > > > 1. ./bin/start-cluster.sh # 启动flink。 > > > > > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 > > > > > > > > > > 随后就是抛了异常: > > > > > Starting execution of program > > > > > Executing WordCount example with default input data set. > > > > > Use --input to specify file input. > > > > > Printing result to stdout. Use --output to specify output path. > > > > > > > > > > ------------------------------------------------------------ > > > > > The program finished with the following exception: > > > > > > > > > > org.apache.flink.client.program.ProgramInvocationException: Could > not > > > > > retrieve the execution result. (JobID: > > > 81bc8720dee57710788cc8e41079ba4d) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) > > > > > at > > > > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) > > > > > at > > > > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) > > > > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) > > > > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) > > > > > at > > > > > > > > > > > > > > > org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) > > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > > at > > > > > > > > > > > > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > > > at > > > > > > > > > > > > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > > at java.lang.reflect.Method.invoke(Method.java:483) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) > > > > > at > > > > > > > > > org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) > > > > > at > > > > > > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) > > > > > at > org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) > > > > > at > > > > > > > > > > > > > > > org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) > > > > > at > > org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) > > > > > Caused by: org.apache.flink.runtime.client.JobSubmissionException: > > > Failed > > > > > to submit JobGraph. > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > Caused by: org.apache.flink.runtime.rest.util.RestClientException: > > > > > [Internal server error., <Exception on server side: > > > > > akka.pattern.AskTimeoutException: Ask timed out on > > > > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. > > > Message > > > > > of type > [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A > > > > > typical reason for `AskTimeoutException` is that the recipient > actor > > > > didn't > > > > > send a reply. > > > > > at > > > > > > > > > > > > > > > > > > > > akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) > > > > > at > akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown > > > > > Source) > > > > > at > > akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) > > > > > at > > > > > > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown > > > > > Source) > > > > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) > > > > > at > > > > > > > > > > > > > > > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) > > > > > at > > > scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) > > > > > at > > > scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) > > > > > at > > > > > > > > > > > > > > > scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) > > > > > at > > > > > > > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) > > > > > at > > > > > > > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) > > > > > at > > > > > > > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) > > > > > at > > > > > > > > > > > > > > > > > > > > akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > > > End of exception on server side>] > > > > > at > > > > > > > > > > > > > > > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) > > > > > at > > > > > > > > > > > > > > > > > > > > org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown > > > > > Source) > > > > > at > > > > > > > > > > > > > > > > > > > > java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) > > > > > ... 4 more > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? > > > > > 我本地的环境是 jdk 1.8.0, maven 3.5.4 > > > > > > > > > > 谢谢大家。 > > > > > > > > > > > > > > > |
最后解决的办法。升级jdk到1.8最新的版本解决。的确是小版本升级就能搞定了,在Mac上一系列的问題都是由此引起的。
谢谢大家。 On Wed, Nov 6, 2019 at 8:53 AM jeff kit <[hidden email]> wrote: > > 执行命令1的时候,localhost:8081看上去是正常的,有可用的TaskManager,JobSlot等。log下的StandaloneSession和TaskExecutor的log均无异常。 > dispatcher也是正常起来的: > > 2019-11-03 21:07:58,438 INFO > org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest > endpoint listening at localhost:8081 > > 2019-11-03 21:07:58,438 INFO > org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - > http://localhost:8081 was granted leadership with > leaderSessionID=00000000-0000-0000-0000-000000000000 > > 2019-11-03 21:07:58,439 INFO > org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web > frontend listening at http://localhost:8081. > > 2019-11-03 21:07:58,507 INFO > org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting > RPC endpoint for > org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at > akka://flink/user/resourcemanager . > > 2019-11-03 21:07:58,526 INFO > org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting > RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher > at akka://flink/user/dispatcher . > > 2019-11-03 21:07:58,549 INFO > org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - > ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager was > granted leadership with fencing token 00000000000000000000000000000000 > > 2019-11-03 21:07:58,550 INFO > org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - > Starting the SlotManager. > > 2019-11-03 21:07:58,563 INFO > org.apache.flink.runtime.dispatcher.StandaloneDispatcher - > Dispatcher akka.tcp://flink@localhost:6123/user/dispatcher was granted > leadership with fencing token 00000000-0000-0000-0000-000000000000 > > 2019-11-03 21:07:58,565 INFO > org.apache.flink.runtime.dispatcher.StandaloneDispatcher - > Recovering all persisted jobs. > > 2019-11-03 21:08:02,248 INFO > org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - > Registering TaskManager with ResourceID ba0633856bb7670711e9e4e946168800 > (akka.tcp://[hidden email]:54796/user/taskmanager_0) at > ResourceManager > > On Tue, Nov 5, 2019 at 8:21 PM zhisheng <[hidden email]> wrote: > >> 执行命令 1 的时候,建议打开 localhost:8081 看看是否 Flink UI 打开是否有问题,再或者看看 Flink log 目录下的 >> jobmanager 和 taskmanager 的日志是否有异常? >> >> 我本地测试你同样的命令是 OK 的 >> >> tison <[hidden email]> 于2019年11月5日周二 下午3:01写道: >> >> > 这个问题其实还挺常见的,问题有很多种可能。比如你看一下 log 下面 cluster 的日志看看 >> > Dispatcher 有没有正常的起起来,flink-conf 你有没有改过导致超时过短(比如 1 ms)或者 >> > 资源不够。也有升级 jdk 小版本后就不复现的。 >> > >> > Best, >> > tison. >> > >> > >> > jeff kit <[hidden email]> 于2019年11月5日周二 下午2:43写道: >> > >> > > 你好。 >> > > 我本地的Flink是官网提供的Binary包,非自己编译的。 >> > > 我相信我的情况是少数,绝大多数人的Mac都是能跑的。 >> > > >> > > On Tue, Nov 5, 2019 at 2:24 PM Biao Liu <[hidden email]> wrote: >> > > >> > > > 你好, >> > > > >> > > > MacOS 可以跑 Flink,我自己刚试了下,复制你的命令就可以跑。 >> > > > 建议再查一下你本地的环境,你本地的 Flink 是自己编译的吗?如果不行试一下 Flink 提供的 binary 包 [1]? >> > > > >> > > > [1] https://flink.apache.org/downloads.html >> > > > >> > > > Thanks, >> > > > Biao /'bɪ.aʊ/ >> > > > >> > > > >> > > > >> > > > On Tue, 5 Nov 2019 at 12:30, jeff kit <[hidden email]> wrote: >> > > > >> > > > > HI,大家好: >> > > > > 我在运行Flink官方的Quick >> > > > > >> Start就遇到了问題。为了避免自己问蠢问題,我先做了很多尝试,如换Flink的版本,从1.7到1.8及至1.9都试过,在我自己的Mac >> > OS >> > > > > X上这个问題是必然出现的,而换到其他操作系统例如Windows,则是正常的。 >> > > > > >> > > > > 这也许不是一个常见的问題,更多是我本机的运行环境问題,但多天尝试下来仍然没有找到解决方法,才在这里求助一下。 >> > > > > >> > > > > 操作步骤: >> > > > > 1. ./bin/start-cluster.sh # 启动flink。 >> > > > > 2. ./bin/flink run examples/batch/WordCount.jar # 提交wordCount 包 >> > > > > >> > > > > 随后就是抛了异常: >> > > > > Starting execution of program >> > > > > Executing WordCount example with default input data set. >> > > > > Use --input to specify file input. >> > > > > Printing result to stdout. Use --output to specify output path. >> > > > > >> > > > > ------------------------------------------------------------ >> > > > > The program finished with the following exception: >> > > > > >> > > > > org.apache.flink.client.program.ProgramInvocationException: Could >> not >> > > > > retrieve the execution result. (JobID: >> > > 81bc8720dee57710788cc8e41079ba4d) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:255) >> > > > > at >> > > > > >> > > >> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338) >> > > > > at >> > > > > >> > > >> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:62) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:820) >> > > > > at org.apache.flink.api.java.DataSet.collect(DataSet.java:413) >> > > > > at org.apache.flink.api.java.DataSet.print(DataSet.java:1652) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:88) >> > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> > > > > at java.lang.reflect.Method.invoke(Method.java:483) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438) >> > > > > at >> > > > > >> > > >> org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:274) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:746) >> > > > > at >> > > > >> > org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:273) >> > > > > at >> org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.cli.CliFrontend$$Lambda$31/1990451863.call(Unknown >> > > > > Source) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) >> > > > > at >> > org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083) >> > > > > Caused by: org.apache.flink.runtime.client.JobSubmissionException: >> > > Failed >> > > > > to submit JobGraph. >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$8(RestClusterClient.java:382) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.client.program.rest.RestClusterClient$$Lambda$44/1067599825.apply(Unknown >> > > > > Source) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$ExceptionCompletion.run(CompletableFuture.java:1246) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$ThenCopy.run(CompletableFuture.java:1333) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2361) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:263) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.concurrent.FutureUtils$$Lambda$63/318445555.accept(Unknown >> > > > > Source) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1298) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:626) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> > > > > at java.lang.Thread.run(Thread.java:745) >> > > > > Caused by: org.apache.flink.runtime.rest.util.RestClientException: >> > > > > [Internal server error., <Exception on server side: >> > > > > akka.pattern.AskTimeoutException: Ask timed out on >> > > > > [Actor[akka://flink/user/dispatcher#-80166821]] after [10000 ms]. >> > > Message >> > > > > of type >> [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A >> > > > > typical reason for `AskTimeoutException` is that the recipient >> actor >> > > > didn't >> > > > > send a reply. >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> akka.pattern.PromiseActorRef$.$anonfun$defaultOnTimeout$1(AskSupport.scala:635) >> > > > > at >> akka.pattern.PromiseActorRef$$$Lambda$190/1064265473.apply(Unknown >> > > > > Source) >> > > > > at >> > akka.pattern.PromiseActorRef$.$anonfun$apply$1(AskSupport.scala:650) >> > > > > at >> > > > >> > akka.pattern.PromiseActorRef$$$Lambda$191/517355658.apply$mcV$sp(Unknown >> > > > > Source) >> > > > > at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:870) >> > > > > at >> > > scala.concurrent.BatchingExecutor.execute(BatchingExecutor.scala:109) >> > > > > at >> > > scala.concurrent.BatchingExecutor.execute$(BatchingExecutor.scala:103) >> > > > > at >> > > > > >> > > > >> > > >> > >> scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:868) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> akka.actor.LightArrayRevolverScheduler$$anon$3.executeBucket$1(LightArrayRevolverScheduler.scala:279) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> akka.actor.LightArrayRevolverScheduler$$anon$3.nextTick(LightArrayRevolverScheduler.scala:283) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> akka.actor.LightArrayRevolverScheduler$$anon$3.run(LightArrayRevolverScheduler.scala:235) >> > > > > at java.lang.Thread.run(Thread.java:745) >> > > > > >> > > > > End of exception on server side>] >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:389) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:373) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> org.apache.flink.runtime.rest.RestClient$$Lambda$62/2010911005.apply(Unknown >> > > > > Source) >> > > > > at >> > > > > >> > > > > >> > > > >> > > >> > >> java.util.concurrent.CompletableFuture$AsyncCompose.exec(CompletableFuture.java:604) >> > > > > ... 4 more >> > > > > >> > > > > >> > > > > >> > > > > >> > > > >> > > >> > >> 对了,在我的Mac上,遇到的奇怪问題还不止这一个,在其他人的机器上正常运行的Flink程序,到我这里都是有这样那样的问題的。所以,Flink对系统环境有什么依赖吗? >> > > > > 我本地的环境是 jdk 1.8.0, maven 3.5.4 >> > > > > >> > > > > 谢谢大家。 >> > > > > >> > > > >> > > >> > >> > |
Free forum by Nabble | Edit this page |