Flink 1.12.2 sql api 使用parquet格式报错

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink 1.12.2 sql api 使用parquet格式报错

太平洋
使用 parquet 还需要手段添加其他相关的依赖吗?


环境和报错信息如下:


Flink 版本: 1.12.2
部署方式: standalone kubernetes session
添加的相关依赖
        &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<dependency&gt;
        &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<groupId&gt;org.apache.flink</groupId&gt;
&nbsp;&nbsp; &nbsp;&nbsp;<artifactId&gt;flink-parquet_2.11</artifactId&gt;
&nbsp;&nbsp; &nbsp;&nbsp;<version&gt;1.12.2</version&gt;
                </dependency&gt;



错误信息:
Caused by: org.apache.flink.table.api.ValidationException: Could not find any format factory for identifier 'parquet' in the classpath. at org.apache.flink.table.filesystem.FileSystemTableSink.<init&gt;(FileSystemTableSink.java:124) at org.apache.flink.table.filesystem.FileSystemTableFactory.createDynamicTableSink(FileSystemTableFactory.java:85)
Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.12.2 sql api 使用parquet格式报错

Luna Wong
https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/formats/parquet.html

太平洋 <[hidden email]> 于2021年4月1日周四 上午10:26写道:

>
> 使用 parquet 还需要手段添加其他相关的依赖吗?
>
>
> 环境和报错信息如下:
>
>
> Flink 版本: 1.12.2
> 部署方式: standalone kubernetes session
> 添加的相关依赖
>         &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<dependency&gt;
>         &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<groupId&gt;org.apache.flink</groupId&gt;
> &nbsp;&nbsp;            &nbsp;&nbsp;<artifactId&gt;flink-parquet_2.11</artifactId&gt;
> &nbsp;&nbsp;            &nbsp;&nbsp;<version&gt;1.12.2</version&gt;
>                 </dependency&gt;
>
>
>
> 错误信息:
> Caused by: org.apache.flink.table.api.ValidationException: Could not find any format factory for identifier 'parquet' in the classpath. at org.apache.flink.table.filesystem.FileSystemTableSink.<init&gt;(FileSystemTableSink.java:124) at org.apache.flink.table.filesystem.FileSystemTableFactory.createDynamicTableSink(FileSystemTableFactory.java:85)
Reply | Threaded
Open this post in threaded view
|

Re: Flink 1.12.2 sql api 使用parquet格式报错

Luna Wong
https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/formats/parquet.html
Parquet你要下这个Jar包放在你flink/lib目录的。

Luna Wong <[hidden email]> 于2021年4月1日周四 上午10:45写道:

>
> https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/formats/parquet.html
>
> 太平洋 <[hidden email]> 于2021年4月1日周四 上午10:26写道:
> >
> > 使用 parquet 还需要手段添加其他相关的依赖吗?
> >
> >
> > 环境和报错信息如下:
> >
> >
> > Flink 版本: 1.12.2
> > 部署方式: standalone kubernetes session
> > 添加的相关依赖
> >         &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<dependency&gt;
> >         &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<groupId&gt;org.apache.flink</groupId&gt;
> > &nbsp;&nbsp;            &nbsp;&nbsp;<artifactId&gt;flink-parquet_2.11</artifactId&gt;
> > &nbsp;&nbsp;            &nbsp;&nbsp;<version&gt;1.12.2</version&gt;
> >                 </dependency&gt;
> >
> >
> >
> > 错误信息:
> > Caused by: org.apache.flink.table.api.ValidationException: Could not find any format factory for identifier 'parquet' in the classpath. at org.apache.flink.table.filesystem.FileSystemTableSink.<init&gt;(FileSystemTableSink.java:124) at org.apache.flink.table.filesystem.FileSystemTableFactory.createDynamicTableSink(FileSystemTableFactory.java:85)