Flink Checkpoint
2019-08-26 15:42:37 0 举报AI智能生成
flink checkpoint 源码跟踪，非常有效的方便记忆
作者其他创作
大纲/内容
CheckpointCoordinator
CheckpointCoordinatorDeActivator
startCheckpointScheduler
ScheduledTrigger（source端的）
triggerCheckpoint
CheckpointStorageLocation
PendingCheckpoint
execution.triggerCheckpoint
RpcTaskManagerGateway
triggerCheckpoint
TaskExecutor.triggerCheckpoint
Task.triggerCheckpointBarrier
invokable.triggerCheckpoint
StreamTask.performCheckpoint -> executeCheckpointing ->AsyncCheckpointRunnable 上传到jobmaster
StreamTask
performCheckpoint ->checkpointState-> executeCheckpointing
AsyncCheckpointRunnable -> reportCompletedSnapshotStates上报到jm
state.backend.local-recovery（默认false） mem不支持，only covers keyed state backends
JobMaster
checkpointCoordinatorGateway.acknowledgeCheckpoint
CheckpointCoordinator
receiveAcknowledgeMessage
completePendingCheckpoint -> finalizeCheckpoint
notifyCheckpointComplete
CheckpointBarrierHandler
BarrierBuffer
getNextNonBlocked
processBarrier
notifyCheckpoint
StreamTask
triggerCheckpointOnBarrier
CheckpointCoordinator 完成checkpoint过程
receiveAcknowledgeMessage SUCCESS
completePendingCheckpoint
pendingCheckpoint.finalizeCheckpoint()
completedCheckpointStore.addCheckpoint(completedCheckpoint)
rememberRecentCheckpointId
dropSubsumedCheckpoints
0 条评论
下一页
