flink sql运行在阿里云k8s用oss作为checkpoint存储介质出错

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

flink sql运行在阿里云k8s用oss作为checkpoint存储介质出错

casel.chen
flink sql运行在阿里云k8s用oss作为checkpoint存储介质,在作业启动过程中出错,请问这个NoSuchKey是指什么?flink在获取checkpoint作restore吗?


2021-05-21 10:56:10,278 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TableSourceScan(table=[[default_catalog, default_database, kafka_source]], fields=[id, acct_seq_id, acct_date, log_id, sttl_date, acct_no, trans_type, dc_flag, trans_amt, acct_bal, avl_bal, frz_bal, cust_id, cust_id2, product_id, dept_id, trans_name, trans_obj, mer_order_id, pnr_id, gate_id, frt_txn_id1, frt_txn_id2, frt_txn_id3, frt_req_date, frt_req_id, sys_id, frt_req_dtl_id, intr_rgn_flag, acct_rgn_id, biz_type, trace_id, rsv1, rsv2, rsv3, ext_info, create_time, last_update_time]) -> DropUpdateBefore -> Calc(select=[id, acct_seq_id, acct_date, log_id, sttl_date, acct_no, trans_type, dc_flag, trans_amt, acct_bal, avl_bal, frz_bal, cust_id, cust_id2, product_id, dept_id, trans_name, trans_obj, mer_order_id, pnr_id, gate_id, frt_txn_id1, frt_txn_id2, frt_txn_id3, frt_req_date, frt_req_id, sys_id, frt_req_dtl_id, intr_rgn_flag, acct_rgn_id, biz_type, trace_id, rsv1, rsv2, rsv3, ext_info, create_time, last_update_time, _UTF-16LE'binlog2mongo' AS EXPR$38, (CAST(()) DATE_FORMAT _UTF-16LE'yyyyMMddHHmmssSSS') AS EXPR$39, _UTF-16LE'binlog2mongo' AS EXPR$40, (CAST(()) DATE_FORMAT _UTF-16LE'yyyyMMddHHmmssSSS') AS EXPR$41, _UTF-16LE'0' AS EXPR$42]) -> Sink: Sink(table=[default_catalog.default_database.mongo_table], fields=[id, acct_seq_id, acct_date, log_id, sttl_date, acct_no, trans_type, dc_flag, trans_amt, acct_bal, avl_bal, frz_bal, cust_id, cust_id2, product_id, dept_id, trans_name, trans_obj, mer_order_id, pnr_id, gate_id, frt_txn_id1, frt_txn_id2, frt_txn_id3, frt_req_date, frt_req_id, sys_id, frt_req_dtl_id, intr_rgn_flag, acct_rgn_id, biz_type, trace_id, rsv1, rsv2, rsv3, ext_info, create_time, last_update_time, EXPR$38, EXPR$39, EXPR$40, EXPR$41, EXPR$42]) (1/1) (e8c335fd6c7edf5fe941cf52f5042697) switched from DEPLOYING to RUNNING.

2021-05-21 10:56:12,881 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found

[ErrorCode]: NoSuchKey

[RequestId]: 60A7214CDB6FC83031C28EF9

[HostId]: null

2021-05-21 10:56:12,885 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found

[ErrorCode]: NoSuchKey

[RequestId]: 60A7214CDB6FC83031D58EF9

[HostId]: null

2021-05-21 10:56:12,895 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found

[ErrorCode]: NoSuchKey

[RequestId]: 60A7214CDB6FC83031E68EF9

[HostId]: null

2021-05-21 10:56:12,900 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found

[ErrorCode]: NoSuchKey

[RequestId]: 60A7214CDB6FC83031F08EF9

[HostId]: null

2021-05-21 10:56:12,925 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 1 (type=CHECKPOINT) @ 1621565772870 for job 9e968b0059199b6d2063c02d95b6f619.