flink-cdc报错

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

flink-cdc报错

guoxb__123@sina.com
HI:
    大家好,我现在遇到了一个问题,flink在通过cdc的方式读取binlog的方式进行读取日志的时候报错,具体报错如下:

----------------------------------------------------------------------------------------------------------------------------------------------------    2021-01-13 15:45:21,920 INFO org.apache.kafka.connect.runtime.WorkerConfig [] - Worker configuration property 'internal.key.converter' is deprecated and may be removed in an upcoming release. The specified value 'org.apache.kafka.connect.json.JsonConverter' matches the default, so this property can be safely removed from the worker configuration.
2021-01-13 15:45:21,920 INFO org.apache.kafka.connect.runtime.WorkerConfig [] - Worker configuration property 'internal.value.converter' is deprecated and may be removed in an upcoming release. The specified value 'org.apache.kafka.connect.json.JsonConverter' matches the default, so this property can be safely removed from the worker configuration.
2021-01-13 15:45:28,936 ERROR io.debezium.connector.mysql.SnapshotReader [] - Failed due to error: Aborting snapshot due to error when last running 'UNLOCK TABLES': io.debezium.ddl.parser.mysql.generated.MySqlParser and io.debezium.ddl.parser.mysql.generated.MySqlParser$StringDataTypeContext disagree on InnerClasses attribute
org.apache.kafka.connect.errors.ConnectException: io.debezium.ddl.parser.mysql.generated.MySqlParser and io.debezium.ddl.parser.mysql.generated.MySqlParser$StringDataTypeContext disagree on InnerClasses attribute
    at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230) ~[yd-mysql-mysql.jar:?]
    at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207) ~[yd-mysql-mysql.jar:?]
    at io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:831) ~[yd-mysql-mysql.jar:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_192]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_192]
    at java.lang.Thread.run(Thread.java:748) [?:1.8.0_192]

----------------------------------------------------------------------------------------------------------------------------------------------------

不知有没有热心的朋友遇到类似的问题的,希望能够获取到一点建议,非常感谢


[hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: flink-cdc报错

r pp
hi~ io.debezium 包版本 是你自己配置的? 还是 官方的? 尝试的解决下,所以问的


[hidden email] <[hidden email]> 于2021年1月13日周三 下午4:32写道:

> HI:
>     大家好,我现在遇到了一个问题,flink在通过cdc的方式读取binlog的方式进行读取日志的时候报错,具体报错如下:
>
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>   2021-01-13 15:45:21,920 INFO
> org.apache.kafka.connect.runtime.WorkerConfig [] - Worker configuration
> property 'internal.key.converter' is deprecated and may be removed in an
> upcoming release. The specified value
> 'org.apache.kafka.connect.json.JsonConverter' matches the default, so this
> property can be safely removed from the worker configuration.
> 2021-01-13 15:45:21,920 INFO org.apache.kafka.connect.runtime.WorkerConfig
> [] - Worker configuration property 'internal.value.converter' is deprecated
> and may be removed in an upcoming release. The specified value
> 'org.apache.kafka.connect.json.JsonConverter' matches the default, so this
> property can be safely removed from the worker configuration.
> 2021-01-13 15:45:28,936 ERROR io.debezium.connector.mysql.SnapshotReader
> [] - Failed due to error: Aborting snapshot due to error when last running
> 'UNLOCK TABLES': io.debezium.ddl.parser.mysql.generated.MySqlParser and
> io.debezium.ddl.parser.mysql.generated.MySqlParser$StringDataTypeContext
> disagree on InnerClasses attribute
> org.apache.kafka.connect.errors.ConnectException:
> io.debezium.ddl.parser.mysql.generated.MySqlParser and
> io.debezium.ddl.parser.mysql.generated.MySqlParser$StringDataTypeContext
> disagree on InnerClasses attribute
>     at
> io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)
> ~[yd-mysql-mysql.jar:?]
>     at
> io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207)
> ~[yd-mysql-mysql.jar:?]
>     at
> io.debezium.connector.mysql.SnapshotReader.execute(SnapshotReader.java:831)
> ~[yd-mysql-mysql.jar:?]
>     at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_192]
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_192]
>     at java.lang.Thread.run(Thread.java:748) [?:1.8.0_192]
>
>
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>
> 不知有没有热心的朋友遇到类似的问题的,希望能够获取到一点建议,非常感谢
>
>
> [hidden email]
>


--
Best,
  pp