碎片文件处理
2021-08-03 14:33:09 1 举报碎片文件处理
作者其他创作
大纲/内容
launch by LoaderDaemon
KUDUEvent_ingesting
PARQevnet_ros
PARQparquet files + some meta
PARQevent_ros snapshots
BatchImporter
KafkaConsumer(mapper only)
moved
Merger(mapreduce)
Extractor
KuDuToParquet(mapreduce)
launch by scheduler
IMPALAevent
event = w0 +w1 +r
QuerEngine
kafkareal time data
HDFSImporter
LoaderDemon(daemon)
0 条评论
下一页
