如何让FlinkSQL访问到阿里云MaxCompute上的表

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

如何让FlinkSQL访问到阿里云MaxCompute上的表

casel.chen
如何让FlinkSQL访问到阿里云MaxCompute上的表?
又或者是Confluent Schema Registry上那些带schema的kafka topic?
需要自己定义Catalog吗?有相关的教程和资料么?谢谢!
Reply | Threaded
Open this post in threaded view
|

回复: 如何让FlinkSQL访问到阿里云MaxCompute上的表

Lucas
Confluent Schema Registry参考这个
https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/formats/avro-confluent.html 



[hidden email]
 
发件人: 陈帅
发送时间: 2020-12-14 23:33
收件人: [hidden email]
主题: 如何让FlinkSQL访问到阿里云MaxCompute上的表?
如何让FlinkSQL访问到阿里云MaxCompute上的表?
又或者是Confluent Schema Registry上那些带schema的kafka topic?
需要自己定义Catalog吗?有相关的教程和资料么?谢谢!
Reply | Threaded
Open this post in threaded view
|

Re:回复: 如何让FlinkSQL访问到阿里云MaxCompute上的表

casel.chen
In reply to this post by casel.chen



CREATETABLEuser_behavior(user_idBIGINT,item_idBIGINT,category_idBIGINT,behaviorSTRING,tsTIMESTAMP(3))WITH('connector'='kafka','properties.bootstrap.servers'='localhost:9092','topic'='user_behavior','format'='avro-confluent','avro-confluent.schema-registry.url'='<a href="http://localhost:8081','avro-confluent.schema-registry.subject'='user_behavior'">http://localhost:8081','avro-confluent.schema-registry.subject'='user_behavior')

如上所示,我并不是想要知道如何在flink sql中连接confluent schema registry,而是想要通过catalog获取schema registry上对应topic的schema信息,以便我不需要手动输入那些fields字段,如同JdbcCatalog那样,直接使用已有表一样,我想直接使用topic,而不需要定义DDL











在 2020-12-15 00:34:03,"[hidden email]" <[hidden email]> 写道:

>Confluent Schema Registry参考这个
>https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/table/connectors/formats/avro-confluent.html 
>
>
>
>[hidden email]
>
>发件人: 陈帅
>发送时间: 2020-12-14 23:33
>收件人: [hidden email]
>主题: 如何让FlinkSQL访问到阿里云MaxCompute上的表?
>如何让FlinkSQL访问到阿里云MaxCompute上的表?
>又或者是Confluent Schema Registry上那些带schema的kafka topic?
>需要自己定义Catalog吗?有相关的教程和资料么?谢谢!