flink1.9 hadoop3 on yarn "StoppableFunction not found"
Posted by Michael Ran on Aug 27, 2019; 12:40pm
URL: http://apache-flink.370.s1.nabble.com/flink1-9-hadoop3-on-yarn-StoppableFunction-not-found-tp531.html
deal ALL :
目前在CDH6.2.0 hadoop3 上,编译了 flink 1.9
提交的时候 异常:
CONSOLE#org.apache.flink.client.program.ProgramInvocationException: The program caused an error:
CONSOLE# at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:93)
CONSOLE# at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:80)
CONSOLE# at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:122)
CONSOLE# at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:227)
CONSOLE# at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
CONSOLE# at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
CONSOLE# at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
CONSOLE# at java.security.AccessController.doPrivileged(Native Method)
CONSOLE# at javax.security.auth.Subject.doAs(Subject.java:422)
CONSOLE# at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
CONSOLE# at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
CONSOLE# at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
CONSOLE#Caused by: java.lang.NoClassDefFoundError: org/apache/flink/api/common/functions/StoppableFunction
CONSOLE# at java.lang.ClassLoader.defineClass1(Native Method)
CONSOLE# at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
CONSOLE# at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
CONSOLE# at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
CONSOLE# at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
CONSOLE# at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
CONSOLE# at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
CONSOLE# at java.security.AccessController.doPrivileged(Native Method)
CONSOLE# at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
CONSOLE# at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
CONSOLE# at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
CONSOLE# at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
CONSOLE# at com.dlb.RocketApp.buildSource(RocketApp.java:89)
CONSOLE# at com.dlb.RocketApp.main(RocketApp.java:55)
CONSOLE# at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
CONSOLE# at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
CONSOLE# at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
CONSOLE# at java.lang.reflect.Method.invoke(Method.java:498)
CONSOLE# at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:576)
CONSOLE# at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:438)
CONSOLE# at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:83)
CONSOLE# ... 11 more
CONSOLE#Caused by: java.lang.ClassNotFoundException: org.apache.flink.api.common.functions.StoppableFunction
CONSOLE# at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
CONSOLE# at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
CONSOLE# at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
CONSOLE# at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
本地没问题,on yarn 就会报这个。StoppableFunction 已经被我干掉了,没任何引用,也搜索不到这个类了。
不知道社区有人遇到这个问题没?