Kyligence 联合创始人兼 CTO 李扬为大家介绍了 Apache Kylin 代码模块的总体结构,随后,结合自身多年经验为大家分享了 Cube 构建的一系列话题,包括Cube构建过程的概述、Cube构建模块的可插拔设计、Cube构建相关的主要类、分工和代码入口等内容。

注脚

展开查看详情

1.| Li, Yang Co-founder & CTO info@kyligence.io

2.What’s Kylin kylin/ ˈkiːˈlɪn / --n. (in Chinese art) a mythical animal of composite form Extreme OLAP Engine for Big Data Kylin is an open source Distributed Analytics Engine from eBay that provides SQL interface and multi-dimensional analysis(OLAP) on Hadoop supporting extremely largedatasets • Open Sourced on Oct 1st, 2014 • Accepted as Apache Incubator Project on Nov 25th,2014 1 0, . ,

3.Feature – SQL Interface 1 0, . ,

4.Feature – BI Integration via ODBC, JDBC 1 0, . ,

5.Feature – Low Latency Dark-blue line: 90%tile queries Light-blue line: 95%tilequeries 90% query returns in 3 seconds 1 0, . ,

6.Feature – Scalable Throughput Linear scale out with more nodes 1 0, . ,

7.Features Highlights… Compression and Encoding Support Incremental Refresh of Cubes Approximate Query Capability for distinct count (HyperLogLog) Leverage HBase Coprocessor for query latency Job Management and Monitoring Security capability to set ACL at Cube/Project Level Support LDAP Integration Near Real-time Streaming 1 0, . ,

8.Kylin Technical Deep Dive 1 0, . ,

9.What is Apache Kylin 1 0, . ,

10.Why Kylin is Fast 1 0, . ,

11.How it works – Materialized View • A query may consider only 3 dimensions 1 0, . ,

12.Why Kylin is Fast 1 0, . ,

13.Kylin is about Precalculation 1 0, . ,

14.O(1) regardless of Data Size 1 0, . ,

15.

16.Multiple Sources 1 0, . ,

17.THANK YOU K Kyligence Kyligence 1 0, . ,

user picture
Kyligence (上海跬智信息技术有限公司)由首个来自中国的 Apache 软件基金会顶级开源项目 Apache Kylin 核心团队组建,是专注于大数据分析领域的数据科技公司,通过前沿数据技术的分析认知来加速用户关键商业决策是其使命。

相关文档