flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

william
Reply | Threaded
Open this post in threaded view
|

Re: flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

Yangze Guo
有完整报错栈或者日志能发下么?

Best,
Yangze Guo

On Fri, Apr 16, 2021 at 9:33 AM william <[hidden email]> wrote:
>
>
>
>
>
> --
> Sent from: http://apache-flink.147419.n8.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

Yangze Guo
可以参考下[1], 如果是相同的问题,将依赖改为flink-connector-elasticsearch

[1] https://issues.apache.org/jira/browse/FLINK-18857

Best,
Yangze Guo

On Fri, Apr 16, 2021 at 10:43 AM Yangze Guo <[hidden email]> wrote:

>
> 有完整报错栈或者日志能发下么?
>
> Best,
> Yangze Guo
>
> On Fri, Apr 16, 2021 at 9:33 AM william <[hidden email]> wrote:
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-flink.147419.n8.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

william
报错日志如下:我的flink sql 已用的
flink-sql-connector-elasticsearch7,代码里使用的flink-connector-elasticsearch7,然后在同一个flink运行,就会报这个错误

Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException:
Cannot instantiate user function.
        at
org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:339)
        at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:636)
        at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:609)
        at
org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:549)
        at
org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:170)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:509)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:565)
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:570)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: unexpected exception type
        at
java.io.ObjectStreamClass.throwMiscException(ObjectStreamClass.java:1682)
        at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1254)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2076)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2285)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2209)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2285)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2209)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2285)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2209)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2285)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2209)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
        at
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615)
        at
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600)
        at
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587)
        at
org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:541)
        at
org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:323)
        ... 9 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at java.lang.invoke.SerializedLambda.readResolve(SerializedLambda.java:230)
        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1248)
        ... 33 more
Caused by: java.lang.IllegalArgumentException: Invalid lambda
deserialization
        at
org.apache.flink.streaming.connectors.elasticsearch7.ElasticsearchSink$Builder.$deserializeLambda$(ElasticsearchSink.java:86)
        ... 42 more



--
Sent from: http://apache-flink.147419.n8.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: flink1.12.1 Sink数据到ES7,遇到 Invalid lambda deserialization 问题

william
In reply to this post by Yangze Guo
您好,我是同时使用flink-sql-connector-elasticsearch7,和 flink-connector-elasticsearch7
就会报Invalid lambda deserialization 问题,请问您有解决办法吗?谢谢!



--
Sent from: http://apache-flink.147419.n8.nabble.com/