Mongo diff 产品方案
2022-01-20 10:35:36 1 举报
数据同步链路中的后续核对方案，可以验证otter, mongo-sync工具的同步后不一致的地方。
作者其他创作
大纲/内容
Retry compare different by Sha2
Expands
Mongo Diff Node
Save retry PKs
Https Command
full task
Get unprocessed PKs from DB
datasource Validation
Batch Store PK by time and count
Task Configuration
OP
KMS
DB select
diff records
Data Authority
Compare each row differents by Sha2
Node 1
Configurations
incremental task
Menu authority
Diff compare module
Record diff detail datas
Node 2
sequence pick one
Compare Thread
Node management
-----
Commands Web Buttons
Audit
Stop
Mq Process Thread
Resume
Start
Authority&Security
datasource configuration
Commands Controller
CSMS
Diffdog Web Manager
Pick one unprocessed sub task
Save lastest PK value and batch data
Retry Compare Thread
Node 3
retry + 1
Okta
Change Stream
Change Stream Fetcher
Async trigger
Save poistion
Node pool
Get unprocessed retry PKs from DB
Insert Update Delete
Compare Total Sum different by Sha2
Query PKs from table where PK > lastest value
diff detail Show
0 条评论
回复 删除
下一页
