数据平台架构

-- 数据平台架构------------------------------------------------------------------------------数据应用层 -------------------------------------------------------------------- Report API Query Zeppelin ------------------------------------------------------------------------------ ^ |数据共享层 -------------------------------------------------------------------- RDBMS Redis HBase[Kylin] ------------------------------------------------------------------------------ ^Sqoop |数据存储&分析层 ---------------------------------------------------------------OffLine: | OnLine： Hive|Spark Sql|Spark MLlib | Spark Streamin|Spark MLlib ----------------------------------------------------------------------------- {ZooKeeper} HDFS | - | Kafka ------------------------------------------------------------------------------ ^ Flume | Sqoop数据采集层 -------------------------------------------------------------------- Log RDBMS Http/Ftp Other ------------------------------------------------------------------------------