Flink 1.9.1的报错信息,在启动flink on yran的时候出现问题

[xzw0223]

具体的报错信息


[root@node01 flink-1.9.1]# bin/flink run -m yarn-cluster -yn 2
./examples/batch/WordCount.jar
2020-09-06 14:30:00,803 INFO  org.apache.hadoop.yarn.client.RMProxy                        
- Connecting to ResourceManager at /0.0.0.0:8032
2020-09-06 14:30:00,938 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                
- No path for the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2020-09-06 14:30:00,938 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                
- No path for the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2020-09-06 14:30:00,947 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                
- The argument yn is deprecated in will be ignored.
2020-09-06 14:30:00,947 INFO  org.apache.flink.yarn.cli.FlinkYarnSessionCli                
- The argument yn is deprecated in will be ignored.
2020-09-06 14:30:01,105 INFO  org.apache.hadoop.conf.Configuration                        
- resource-types.xml not found
2020-09-06 14:30:01,105 INFO
org.apache.hadoop.yarn.util.resource.ResourceUtils            - Unable to
find 'resource-types.xml'.
2020-09-06 14:30:01,136 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Cluster
specification: ClusterSpecification{masterMemoryMB=1024,
taskManagerMemoryMB=1024, numberTaskManagers=2, slotsPerTaskManager=2}
2020-09-06 14:30:01,193 WARN
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - The file
system scheme is 'file'. This indicates that the specified Hadoop
configuration path is wrong and the system is using the default Hadoop
configuration values.The Flink YARN client needs to store its files in a
distributed file system
2020-09-06 14:30:01,196 WARN
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - The
configuration directory ('/export/servers/flink-1.9.1/conf') contains both
LOG4J and Logback configuration files. Please delete or rename one of them.
2020-09-06 14:30:01,600 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Submitting
application master application_1599371603539_0004
2020-09-06 14:30:01,635 INFO
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl         - Submitted
application application_1599371603539_0004
2020-09-06 14:30:01,635 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Waiting for
the cluster to be allocated
2020-09-06 14:30:01,644 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Deploying
cluster, current state ACCEPTED

------------------------------------------------------------
 The program finished with the following exception:

org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't
deploy Yarn session cluster
        at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploySessionCluster(AbstractYarnClusterDescriptor.java:385)
        at org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:251)
        at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
        at
org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
        at
org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at
org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
Caused by:
org.apache.flink.yarn.AbstractYarnClusterDescriptor$YarnDeploymentException:
The YARN application unexpectedly switched to state FAILED during
deployment.
Diagnostics from YARN: Application application_1599371603539_0004 failed 2
times due to AM Container for appattempt_1599371603539_0004_000002 exited
with  exitCode: 1
For more detailed output, check application tracking
page:http://node01:8088/cluster/app/application_1599371603539_0004Then,
click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1599371603539_0004_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
        at org.apache.hadoop.util.Shell.run(Shell.java:482)
        at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
        at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
        at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
If log aggregation is enabled on your cluster, use this command to further
investigate the issue:
yarn logs -applicationId application_1599371603539_0004
        at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.startAppMaster(AbstractYarnClusterDescriptor.java:1024)
        at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:507)
        at
org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploySessionCluster(AbstractYarnClusterDescriptor.java:378)
        ... 9 more
2020-09-06 14:30:06,357 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Cancelling
deployment from Deployment Failure Hook
2020-09-06 14:30:06,357 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Killing YARN
application
2020-09-06 14:30:06,378 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null. Trying
to failover immediately.
2020-09-06 14:30:06,382 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 1
failover attempts. Trying to failover after sleeping for 27593ms.
2020-09-06 14:30:33,977 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 2
failover attempts. Trying to failover after sleeping for 39571ms.
2020-09-06 14:31:13,549 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 3
failover attempts. Trying to failover after sleeping for 26075ms.
2020-09-06 14:31:39,626 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 4
failover attempts. Trying to failover after sleeping for 38795ms.
2020-09-06 14:32:18,421 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 5
failover attempts. Trying to failover after sleeping for 15929ms.
2020-09-06 14:32:34,352 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 6
failover attempts. Trying to failover after sleeping for 29440ms.
2020-09-06 14:33:03,793 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 7
failover attempts. Trying to failover after sleeping for 19292ms.
2020-09-06 14:33:23,087 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 8
failover attempts. Trying to failover after sleeping for 32326ms.
2020-09-06 14:33:55,414 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after 9
failover attempts. Trying to failover after sleeping for 17965ms.
2020-09-06 14:34:13,380 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
10 failover attempts. Trying to failover after sleeping for 35364ms.
2020-09-06 14:34:48,745 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
11 failover attempts. Trying to failover after sleeping for 39776ms.
2020-09-06 14:35:28,521 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
12 failover attempts. Trying to failover after sleeping for 26108ms.
2020-09-06 14:35:54,630 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
13 failover attempts. Trying to failover after sleeping for 36729ms.
2020-09-06 14:36:31,360 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
14 failover attempts. Trying to failover after sleeping for 31045ms.
2020-09-06 14:37:02,408 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
15 failover attempts. Trying to failover after sleeping for 41007ms.
2020-09-06 14:37:43,417 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
16 failover attempts. Trying to failover after sleeping for 40389ms.
2020-09-06 14:38:23,807 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
17 failover attempts. Trying to failover after sleeping for 20316ms.
2020-09-06 14:38:44,123 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
18 failover attempts. Trying to failover after sleeping for 27372ms.
2020-09-06 14:39:11,496 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
19 failover attempts. Trying to failover after sleeping for 28079ms.
2020-09-06 14:39:39,577 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
20 failover attempts. Trying to failover after sleeping for 15147ms.
2020-09-06 14:39:54,725 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
21 failover attempts. Trying to failover after sleeping for 21075ms.
2020-09-06 14:40:15,801 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
22 failover attempts. Trying to failover after sleeping for 23639ms.
2020-09-06 14:40:39,440 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
23 failover attempts. Trying to failover after sleeping for 19239ms.
2020-09-06 14:40:58,681 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
24 failover attempts. Trying to failover after sleeping for 44361ms.
2020-09-06 14:41:43,043 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
25 failover attempts. Trying to failover after sleeping for 20559ms.
2020-09-06 14:42:03,603 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
26 failover attempts. Trying to failover after sleeping for 33476ms.
2020-09-06 14:42:37,080 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
27 failover attempts. Trying to failover after sleeping for 26350ms.
2020-09-06 14:43:03,431 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
28 failover attempts. Trying to failover after sleeping for 28673ms.
2020-09-06 14:43:32,106 INFO
org.apache.hadoop.io.retry.RetryInvocationHandler             -
java.io.IOException: The client is stopped, while invoking
ApplicationClientProtocolPBClientImpl.forceKillApplication over null after
29 failover attempts. Trying to failover after sleeping for 39931ms.
2020-09-06 14:44:12,038 INFO
org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Deleting
files in file:/root/.flink/application_1599371603539_0004.




在查看了  yarn logs -applicationId application_1599371603539_0004后的报错信息

Container: container_1599371603539_0004_02_000001 on node01_35016
===================================================================
LogType:jobmanager.err
Log Upload Time:星期日 九月 06 14:30:07 +0800 2020
LogLength:589
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/export/servers/hadoop-2.7.7/hadoopDatas/tempDatas/nm-local-dir/usercache/root/appcache/application_1599371603539_0004/filecache/10/slf4j-log4j12-1.7.15.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/export/servers/hadoop-2.7.7/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
End of LogType:jobmanager.err

LogType:jobmanager.out
Log Upload Time:星期日 九月 06 14:30:07 +0800 2020
LogLength:0
Log Contents:
End of LogType:jobmanager.out




我想请问一下 我是哪里出现了问题  Hadoop是2.7.7的





--
Sent from: http://apache-flink.147419.n8.nabble.com/