flink 1.12.0 + hive 3.1.2 报错 java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

flink 1.12.0 + hive 3.1.2 报错 java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument

Zeng, Jianqiang Zack

使用官网的Flink 1.12.0安装,已经正常启动,JPS可看到相关进程,WEBUI也正常启用,配置连接Hive 3.1.2,并将相关的JAR包放入了flink下面的lib文件夹当中,但启动sql-client报错,搜索定位说是guava的问题,可是我guava的包是直接软链接到hive下面的guava包,和hadoop也是共用同一个包,是哪里配置还有问题吗?相关截图如下,谢谢!

 

JPS截图

 

WebUI截图

 

Flink/Lib 截图

 

Sql-client截图

 

Sql-client启动报错截图

 

Hive正常启动截图

 

 

Best Regards!

Have a good day!

 

Zack Zeng
Associate Manager, Business Analyst
Boston Scientific
China Information Services
[hidden email]
(+86)21-61417831
#763 Mengzi Road, Shanghai, China
www.bostonscientific.com

 

 

Reply | Threaded
Open this post in threaded view
|

RE: flink 1.12.0 + hive 3.1.2 报错 java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument

Zeng, Jianqiang Zack

 

 

 

 

 

 

Best Regards!

Have a good day!

 

Zack Zeng
Associate Manager, Business Analyst
Boston Scientific
China Information Services
[hidden email]
(+86)21-61417831
#763 Mengzi Road, Shanghai, China
www.bostonscientific.com

 

 

From: Zeng, Jianqiang Zack
Sent: Wednesday, December 30, 2020 4:42 PM
To: [hidden email]
Subject: flink 1.12.0 + hive 3.1.2
报错 java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument

 

使用官网的Flink 1.12.0安装,已经正常启动,JPS可看到相关进程,WEBUI也正常启用,配置连接Hive 3.1.2,并将相关的JAR包放入了flink下面的lib文件夹当中,但启动sql-client报错,搜索定位说是guava的问题,可是我guava的包是直接软链接到hive下面的guava包,和hadoop也是共用同一个包,是哪里配置还有问题吗?相关截图如下,谢谢!

 

JPS截图

 

WebUI截图

 

Flink/Lib 截图

 

Sql-client截图

 

Sql-client启动报错截图

 

Hive正常启动截图

 

 

Best Regards!

Have a good day!

 

Zack Zeng
Associate Manager, Business Analyst
Boston Scientific
China Information Services
[hidden email]
(+86)21-61417831
#763 Mengzi Road, Shanghai, China
www.bostonscientific.com

 

 

Reply | Threaded
Open this post in threaded view
|

Re: flink 1.12.0 + hive 3.1.2 报错 java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument

SebastianLiu
Hi Jianqiang,

看不到email中的截图。但从你的描述中看,似乎是shade jar的问题,Flink SQL
client启动的时候会自动使用FLINK_HOME/bin/config.sh中的constructFlinkClassPath,
并append到当前SQL client JVM的CC_CLASSPATH中。所以理论上不需要向Flink
lib目录cp其他jar,当然如果有特殊依赖jar,还是需要保证在CLASSPATH中的,
但使用“--jar”或者“--library”来传递这些似乎是更好的选择,这两个参数会把jar当做job的user
jar随JobGraph一起上传至JM。

flink-dist这个fat jar中应该已经有guava18.

Zeng, Jianqiang Zack <[hidden email]> 于2020年12月30日周三 下午5:04写道:

>
>
>
>
>
>
>
>
>
>
>
>
> Best Regards!
>
> Have a good day!
>
>
>
>
> *Zack Zeng *Associate Manager, Business Analyst
> Boston Scientific
> China Information Services
> [hidden email]
> (+86)21-61417831
> #763 Mengzi Road, Shanghai, China
> www.bostonscientific.com
>
> [image: bsc]
>
>
>
>
>
> *From:* Zeng, Jianqiang Zack
> *Sent:* Wednesday, December 30, 2020 4:42 PM
> *To:* [hidden email]
> *Subject:* flink 1.12.0 + hive 3.1.2 报错 java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument
>
>
>
> 使用官网的Flink 1.12.0安装,已经正常启动,JPS可看到相关进程,WEBUI也正常启用,配置连接Hive 3.1.2,并将相关的JAR
> 包放入了flink下面的lib文件夹当中,但启动sql-client报错,搜索定位说是guava的问题,可是我guava的包是直接软链接到hive
> 下面的guava包,和hadoop也是共用同一个包,是哪里配置还有问题吗?相关截图如下,谢谢!
>
>
>
> JPS截图
>
>
>
> WebUI截图
>
>
>
> Flink/Lib 截图
>
>
>
> Sql-client截图
>
>
>
> *Sql-client启动报错截图*
>
>
>
> Hive正常启动截图
>
>
>
>
>
> Best Regards!
>
> Have a good day!
>
>
>
>
> *Zack Zeng *Associate Manager, Business Analyst
> Boston Scientific
> China Information Services
> [hidden email]
> (+86)21-61417831
> #763 Mengzi Road, Shanghai, China
> www.bostonscientific.com
>
> [image: bsc]
>
>
>
>
>


--

*With kind regards
------------------------------------------------------------
Sebastian Liu 刘洋
Institute of Computing Technology, Chinese Academy of Science
Mobile\WeChat: +86—15201613655
E-mail: [hidden email] <[hidden email]>
QQ: 3239559*