samoa-storm
2015-08-01 14:35:24 2 举报
SAMOA-Storm类图
作者其他创作
大纲/内容
StormBoltStream
- outputCollector
+ setCollector(OutputCollector)+ put(ContentEvent)
IProcessingItem
+ getProcessor(): Processor
StormStream
+ outputStreamId:String+ inputStreamId:
+ put(ContentEvent)+ getOutputId()+ getInputId()
StormTopologyNode
+ addToTopology+ createStream+ getId
Stream代表了处理节点之间的连线,所以需要Input和output ID
StormEntranceProcessingItem
- piSpout:StormEntranceSpout+ attribute2:type- attribute3:type
StormProcessingItem
+ piBolt: ProcessingItemBolt+ piBoltDeclarer: BoltDeclarer
StormTopology
- builder: TopologyBuilder
+ addProcessingItem+ getStormBuilder
ProcessingItemBolt
- processor: Processor- streams: StormStream- collector: OutputCollector
StormEntranceSpout
- entranceProcessor: EntranceProcessor- outputStream: StormStream- collector: SpoutOutputCollector
BaseRichSpout
Samoa-storm Topology中的一个处理节点
接口
+ put(ContentEvent)+ getStreamId()+ setBatchSize()
将所有不同框架的Topology进行了抽象,实现了上层算法的统一
Topology
+ getTopologyName()+ setTopologyName(String)+ addEntranceProcessingItem(EPI)+ addProcessingItem(PI)+ addStream(Stream)
AbstractTopology
- topoName:String- streams: Set- processingItems:Set- entranceProcessingItems:Set
+add/get/set
AbstractEntranceProcessingItem
- processor EntranceProcessor- name String- outputStream Stream+ set/get
ProcessingItem
- connectInputShuffleStream(Stream) - connectInputKeyStream(Stream)- connectInputAllStream(Stream)- getParallelism
StormSpoutStream
AbstractProcessingItem
- name- parallelism- processor
0 条评论
下一页