实时日志分析系统
2016-03-16 17:11:30 111 举报
ELK log分析系统图
作者其他创作
大纲/内容
导入HDFS
Web UI
Flume-collector
WebSite Logs
Hive/Presto
query index
JSS log
log采集
数据仓库
JSS-Topic
ES2
MapReduce
APP Logs
LogstashClient 端
ElasticSearch Cluster
Log-Conllector
ES1
read
Storm/Spark
Logs
Realtime KafKa
send log msg
离线日志处理-offline
Msg-Producers
Flume-agent
send log msg
Log Producers(埋点)
Falcon-Topic
Falcon log
App-Producers
Job
Kibanna
数据分析
Show Data
Hour
LogstashServer 端
write
Service Logs
Date
实现日志处理-realtime
Service-Producers
HDFS
Host
Log -采集
N-Topic
0 条评论
下一页