Apache Flink 中文用户邮件列表
Search
everywhere
only in this topic
Advanced Search
flink table Kafka 重新连接的问题
Classic
List
Threaded
♦
♦
Locked
4 messages
marble.zhong@coinflex.com.INVALID
Reply
|
Threaded
Open this post in threaded view
♦
♦
|
flink table Kafka 重新连接的问题
你好。
当connector连接kafka,如果某个message出现exception时,task就停了, 没有自动重新连接, 看了kafka
connector的配置,没有这方面的设置,这个有什么重连机制吗? Thanks.
--
Sent from:
http://apache-flink.147419.n8.nabble.com/
marble.zhong@coinflex.com.INVALID
Reply
|
Threaded
Open this post in threaded view
♦
♦
|
Re: flink table Kafka 重新连接的问题
自己顶一下, 有人给些建议吗?
--
Sent from:
http://apache-flink.147419.n8.nabble.com/
Paul Lam
Reply
|
Threaded
Open this post in threaded view
♦
♦
|
Re: flink table Kafka 重新连接的问题
具体是什么样的 exception?Kafka 的重连和 Task 重启是不同的事情。前者取决于 Kafka 的配置和异常的类型,后者取决于 Flink 的重启策略。
Best,
Paul Lam
> 2020年9月11日 11:42,
[hidden email]
<
[hidden email]
> 写道:
>
> 自己顶一下, 有人给些建议吗?
>
>
>
> --
> Sent from:
http://apache-flink.147419.n8.nabble.com/
Leonard Xu
Reply
|
Threaded
Open this post in threaded view
♦
♦
|
Re: flink table Kafka 重新连接的问题
In reply to
this post
by marble.zhong@coinflex.com.INVALID
HI
> 在 2020年9月9日,16:37,
[hidden email]
<
[hidden email]
> 写道:
>
> 如果某个message出现exception时
table的connector, 你用的format是什么?一般这种某条message解析异常引起的失败都是可以跳过,比如配置下json.ignore-parse-errors(json) 或
csv.ignore-parse-errors(csv)。
[1]
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/formats/json.html#json-ignore-parse-errors
<
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/formats/json.html#json-ignore-parse-errors
>
[2]
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/formats/csv.html#csv-ignore-parse-errors
<
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/formats/csv.html#csv-ignore-parse-errors
>
Free forum by Nabble
Edit this page