Apache Flink 中文用户邮件列表

flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

classic Classic list List threaded Threaded
♦
♦
 5 messages Options
程龙
Reply | Threaded
Open this post in threaded view
♦
♦
|

flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

程龙
2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
2020-06-22 10:16:34,456 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,481 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,492 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,497 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,524 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,531 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,564 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,609 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,616 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,650 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,656 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,662 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,664 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,669 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,726 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,729 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,760 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:37,081 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator     - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
2020-06-22 10:16:45,065 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:45,066 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:48,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
java.lang.NoClassDefFoundError: core



看日志是在部分task里面报错
Yang Wang
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

Yang Wang
     -C,--classpath <url>                 Adds a URL to each user code
                                          classloader  on all nodes in the
                                          cluster. The paths must specify a
                                          protocol (e.g. file://) and be
                                          accessible on all nodes (e.g. by
means
                                          of a NFS share). You can use this
                                          option multiple times for
specifying
                                          more than one URL. The protocol
must
                                          be supported by the {@link
                                          java.net.URLClassLoader}.


--classpath这个参数需要提前将jar部署在各个节点上或者使用NFS，确认jar是存在的吗


Best,
Yang

程龙 <[hidden email]> 于2020年6月22日周一 上午11:43写道：

> 2020-06-22 10:16:34,379 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to
> DEPLOYING.
> 2020-06-22 10:16:34,379 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Deploying
> Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002
> @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
> 2020-06-22 10:16:34,456 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,481 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,492 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,497 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,512 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,524 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,531 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,564 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,609 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,616 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,650 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,656 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,662 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,664 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
> Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,669 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,726 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,729 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,760 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:37,081 INFO
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator     - Triggering
> checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
> 2020-06-22 10:16:45,065 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
> Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:45,066 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:48,512 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to
> FAILED on
> org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
> java.lang.NoClassDefFoundError: core
>
>
>
> 看日志是在部分task里面报错
WeiXubin
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re:flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

WeiXubin
In reply to this post by 程龙
和版本应该没什么关系。如果是多节点部署的情况下，-C 所指定的URL 需要各个节点都能访问得到。 确认下该URL能被所有节点访问到吗
 Best,
 Bin














At 2020-06-22 11:43:11, "程龙" <[hidden email]> wrote:

>2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
>2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>2020-06-22 10:16:34,456 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,481 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,492 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,497 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,524 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,531 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,564 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,609 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,616 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,650 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,656 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,662 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,664 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,669 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,726 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,729 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,760 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:37,081 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator     - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>2020-06-22 10:16:45,065 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:45,066 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:48,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>java.lang.NoClassDefFoundError: core
>
>
>
>看日志是在部分task里面报错
程龙
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re:Re:flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

程龙









嗯 确认都能访问 使用http的方式








在 2020-06-23 10:04:55，"Weixubin" <[hidden email]> 写道：

>和版本应该没什么关系。如果是多节点部署的情况下，-C 所指定的URL 需要各个节点都能访问得到。 确认下该URL能被所有节点访问到吗
> Best,
> Bin
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>At 2020-06-22 11:43:11, "程龙" <[hidden email]> wrote:
>>2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
>>2020-06-22 10:16:34,379 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>>2020-06-22 10:16:34,456 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,481 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,492 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,497 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,524 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,531 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,564 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,609 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,616 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,650 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,656 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,662 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,664 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,669 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,726 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,729 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,760 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:37,081 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator     - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>>2020-06-22 10:16:45,065 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:45,066 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:48,512 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>>java.lang.NoClassDefFoundError: core
>>
>>
>>
>>看日志是在部分task里面报错
程龙
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re:Re: flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到

程龙
In reply to this post by Yang Wang
在同一套集群离  安装有连个版本的flink 使用-C http://xxx.jar的方式  1.8能正常运行 说明都能访问 使用1.10 就不行

















At 2020-06-22 17:46:56, "Yang Wang" <[hidden email]> wrote:

>     -C,--classpath <url>                 Adds a URL to each user code
>                                          classloader  on all nodes in the
>                                          cluster. The paths must specify a
>                                          protocol (e.g. file://) and be
>                                          accessible on all nodes (e.g. by
>means
>                                          of a NFS share). You can use this
>                                          option multiple times for
>specifying
>                                          more than one URL. The protocol
>must
>                                          be supported by the {@link
>                                          java.net.URLClassLoader}.
>
>
>--classpath这个参数需要提前将jar部署在各个节点上或者使用NFS，确认jar是存在的吗
>
>
>Best,
>Yang
>
>程龙 <[hidden email]> 于2020年6月22日周一 上午11:43写道：
>
>> 2020-06-22 10:16:34,379 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to
>> DEPLOYING.
>> 2020-06-22 10:16:34,379 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Deploying
>> Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002
>> @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>> 2020-06-22 10:16:34,456 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,481 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,492 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,497 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,512 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,524 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,531 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,564 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,609 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,616 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,650 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,656 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,662 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,664 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Source:
>> Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,669 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,726 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,729 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,760 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:37,081 INFO
>> org.apache.flink.runtime.checkpoint.CheckpointCoordinator     - Triggering
>> checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>> 2020-06-22 10:16:45,065 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Sink:
>> Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:45,066 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:48,512 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Filter ->
>> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to
>> FAILED on
>> org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>> java.lang.NoClassDefFoundError: core
>>
>>
>>
>> 看日志是在部分task里面报错
Free forum by Nabble Edit this page