flink stream sink hive

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

flink stream sink hive

pass Li
flink1.11.1 往hive2.1.1 的orc表写数据报的异常,在网上查不到,只能来这里了,麻烦大佬们帮我看看

Reply | Threaded
Open this post in threaded view
|

回复: flink stream sink hive

pass Li
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.orc.TypeDescription.fromString(Ljava/lang/String;)Lorg/apache/orc/TypeDescription;
 

 
发件人: [hidden email]
发送时间: 2020-08-27 19:09
收件人: [hidden email]
主题: flink stream sink hive
flink1.11.1 往hive2.1.1 的orc表写数据报的异常,在网上查不到,只能来这里了,麻烦大佬们帮我看看

Reply | Threaded
Open this post in threaded view
|

Re: flink stream sink hive

Congxian Qiu
In reply to this post by pass Li
Hi
   从异常看,可能是类冲突了,或许是有两个版本的 `org.apache.orc.TypeDescription` 依赖,可以排除或者 shade
一下相关的 class
Best,
Congxian


[hidden email] <[hidden email]> 于2020年8月27日周四 下午8:18写道:

> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.orc.TypeDescription.fromString(Ljava/lang/String;)Lorg/apache/orc/TypeDescription;
>
> ------------------------------
> [hidden email]
>
>
> *发件人:* [hidden email]
> *发送时间:* 2020-08-27 19:09
> *收件人:* user-zh <[hidden email]>
> *主题:* flink stream sink hive
> flink1.11.1 往hive2.1.1 的orc表写数据报的异常,在网上查不到,只能来这里了,麻烦大佬们帮我看看
> ------------------------------
> [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

Re: flink stream sink hive

Rui Li
Hello,

贴一下完整的stacktrace看看吧。流式写orc表有个已知问题 [1],可能是跟这个有关。

[1] https://issues.apache.org/jira/browse/FLINK-18659

On Thu, Aug 27, 2020 at 9:16 PM Congxian Qiu <[hidden email]> wrote:

> Hi
>    从异常看,可能是类冲突了,或许是有两个版本的 `org.apache.orc.TypeDescription` 依赖,可以排除或者 shade
> 一下相关的 class
> Best,
> Congxian
>
>
> [hidden email] <[hidden email]> 于2020年8月27日周四 下午8:18写道:
>
> > Exception in thread "main" java.lang.NoSuchMethodError:
> >
> org.apache.orc.TypeDescription.fromString(Ljava/lang/String;)Lorg/apache/orc/TypeDescription;
> >
> > ------------------------------
> > [hidden email]
> >
> >
> > *发件人:* [hidden email]
> > *发送时间:* 2020-08-27 19:09
> > *收件人:* user-zh <[hidden email]>
> > *主题:* flink stream sink hive
> > flink1.11.1 往hive2.1.1 的orc表写数据报的异常,在网上查不到,只能来这里了,麻烦大佬们帮我看看
> > ------------------------------
> > [hidden email]
> >
> >
>


--
Best regards!
Rui Li
Reply | Threaded
Open this post in threaded view
|

Re: flink stream sink hive

Yun Gao
In reply to this post by pass Li
社区的邮件列表应该不支持图片,现在图看不到,要不直接把stack贴上来吧,或者用个图床。



 ------------------Original Mail ------------------
Sender:[hidden email] <[hidden email]>
Send Date:Thu Aug 27 19:09:51 2020
Recipients:user-zh <[hidden email]>
Subject:flink stream sink hive

flink1.11.1 往hive2.1.1 的orc表写数据报的异常,在网上查不到,只能来这里了,麻烦大佬们帮我看看


[hidden email]