Flink SQL 问题;

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink SQL 问题;

air23
你好 我用idea本地运行的jdbc sink没有问题。但是在服务器上运行报错如下


麻烦帮忙看下什么问题 是1.11 版本的


'connector'='jdbc'
'password'='****'
'sink.buffer-flush.interval'='10s'
'sink.buffer-flush.max-rows'='500'
'table-name'='flink_test3'
'url'='jdbc:mysql://******:4000/test'
'username'='root'
        at org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:164)
        at org.apache.flink.table.planner.delegation.PlannerBase.getTableSink(PlannerBase.scala:344)
        at org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:204)
        at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
        at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
        at scala.collection.Iterator$class.foreach(Iterator.scala:891)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
        at scala.collection.AbstractTraversable.map(Traversable.scala:104)
        at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:163)
        at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1264)
        at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:700)
        at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:787)
        at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:690)
        at com.air.Tidb1.main(Tidb1.java:132)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
        ... 11 more
Caused by: org.apache.flink.table.api.ValidationException: Cannot discover a connector using option ''connector'='jdbc''.
        at org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:329)
        at org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:157)
        ... 34 more
Caused by: org.apache.flink.table.api.ValidationException: Could not find any factory for identifier 'jdbc' that implements 'org.apache.flink.table.factories.DynamicTableSinkFactory' in the classpath.


Available factory identifiers are:


blackhole
print
        at org.apache.flink.table.factories.FactoryUtil.discoverFactory(FactoryUtil.java:240)
        at org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:326)
        ... 35 more
Reply | Threaded
Open this post in threaded view
|

Re: Flink SQL 问题;

Lin Hou
jdbc connector jar没有导入线上集群,去官网上下载或者自己编译吧

air23 <[hidden email]> 于2020年8月27日周四 下午3:11写道:

> 你好 我用idea本地运行的jdbc sink没有问题。但是在服务器上运行报错如下
>
>
> 麻烦帮忙看下什么问题 是1.11 版本的
>
>
> 'connector'='jdbc'
> 'password'='****'
> 'sink.buffer-flush.interval'='10s'
> 'sink.buffer-flush.max-rows'='500'
> 'table-name'='flink_test3'
> 'url'='jdbc:mysql://******:4000/test'
> 'username'='root'
>         at
> org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:164)
>         at
> org.apache.flink.table.planner.delegation.PlannerBase.getTableSink(PlannerBase.scala:344)
>         at
> org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:204)
>         at
> org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
>         at
> org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
>         at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>         at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>         at scala.collection.Iterator$class.foreach(Iterator.scala:891)
>         at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
>         at
> scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
>         at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
>         at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
>         at scala.collection.AbstractTraversable.map(Traversable.scala:104)
>         at
> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:163)
>         at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1264)
>         at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:700)
>         at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:787)
>         at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:690)
>         at com.air.Tidb1.main(Tidb1.java:132)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
>         ... 11 more
> Caused by: org.apache.flink.table.api.ValidationException: Cannot discover
> a connector using option ''connector'='jdbc''.
>         at
> org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:329)
>         at
> org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:157)
>         ... 34 more
> Caused by: org.apache.flink.table.api.ValidationException: Could not find
> any factory for identifier 'jdbc' that implements
> 'org.apache.flink.table.factories.DynamicTableSinkFactory' in the classpath.
>
>
> Available factory identifiers are:
>
>
> blackhole
> print
>         at
> org.apache.flink.table.factories.FactoryUtil.discoverFactory(FactoryUtil.java:240)
>         at
> org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:326)
>         ... 35 more
Reply | Threaded
Open this post in threaded view
|

Re:Re: Flink SQL 问题;

air23









这个需要单独 导入到服务器lib下面吗
我的本地pom文件 是有引入的










在 2020-08-27 15:32:49,"Lin Hou" <[hidden email]> 写道:

>jdbc connector jar没有导入线上集群,去官网上下载或者自己编译吧
>
>air23 <[hidden email]> 于2020年8月27日周四 下午3:11写道:
>
>> 你好 我用idea本地运行的jdbc sink没有问题。但是在服务器上运行报错如下
>>
>>
>> 麻烦帮忙看下什么问题 是1.11 版本的
>>
>>
>> 'connector'='jdbc'
>> 'password'='****'
>> 'sink.buffer-flush.interval'='10s'
>> 'sink.buffer-flush.max-rows'='500'
>> 'table-name'='flink_test3'
>> 'url'='jdbc:mysql://******:4000/test'
>> 'username'='root'
>>         at
>> org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:164)
>>         at
>> org.apache.flink.table.planner.delegation.PlannerBase.getTableSink(PlannerBase.scala:344)
>>         at
>> org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:204)
>>         at
>> org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
>>         at
>> org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:163)
>>         at
>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>>         at
>> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
>>         at scala.collection.Iterator$class.foreach(Iterator.scala:891)
>>         at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
>>         at
>> scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
>>         at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
>>         at
>> scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
>>         at scala.collection.AbstractTraversable.map(Traversable.scala:104)
>>         at
>> org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:163)
>>         at
>> org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1264)
>>         at
>> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:700)
>>         at
>> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:787)
>>         at
>> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:690)
>>         at com.air.Tidb1.main(Tidb1.java:132)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:498)
>>         at
>> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
>>         ... 11 more
>> Caused by: org.apache.flink.table.api.ValidationException: Cannot discover
>> a connector using option ''connector'='jdbc''.
>>         at
>> org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:329)
>>         at
>> org.apache.flink.table.factories.FactoryUtil.createTableSink(FactoryUtil.java:157)
>>         ... 34 more
>> Caused by: org.apache.flink.table.api.ValidationException: Could not find
>> any factory for identifier 'jdbc' that implements
>> 'org.apache.flink.table.factories.DynamicTableSinkFactory' in the classpath.
>>
>>
>> Available factory identifiers are:
>>
>>
>> blackhole
>> print
>>         at
>> org.apache.flink.table.factories.FactoryUtil.discoverFactory(FactoryUtil.java:240)
>>         at
>> org.apache.flink.table.factories.FactoryUtil.getDynamicTableFactory(FactoryUtil.java:326)
>>         ... 35 more
Reply | Threaded
Open this post in threaded view
|

Re: Re:Re: Flink SQL 问题;

JasonLee
hi

把Flink-jdbc的包放到flink/lib下面再跑下



--
Sent from: http://apache-flink.147419.n8.nabble.com/
Best Wishes
JasonLee