PingCAP-Infra-Meetup-97-shenli-What-is-New-in-TiDB-3.0

1 月 19 日,TiDB 发布 3.0 Beta 版,相比 2.1 版本,该版本对系统稳定性、优化器、统计信息以及执行引擎做了很多改进。申砾老师为大家分享了 TiDB 3.0 的新特性及未来的规划。
展开查看详情

1.What's New in TiDB 3.0

2. Data Diagnosis DM Master Migration Lightning Backup & Recovery TiDB Vision Monitoring Upstream DM Worker DM Worker KV Importer KV Dumper TiDB Insight Database Schrodinger TiKV TiKV Spark Driver TiDB MySQL Protocol Application via DistSQL API TiKV TiKV Worker TiDB DistSQL API Spark SQL KV API TiFlash TiFlash Worker ... TiDB ... Worker PD PD PD ... TiDB Binlog PD Cluster Spark Cluster Pump Pump Pump Downstream Database Drainer ... TiDB Operator TiDB Ansible PingCAP.com

3.Part I - Storage Engine

4.多线程 Raft 状态机(1/3)

5.多线程 Raft 状态机(2/3)

6.多线程 Raft 状态机(3/3)

7.Batch Message (1/3) ● gRPC ○ Google 出品 ○ 功能丰富 ○ 性能尚可 PingCAP.com

8.Batch Message (2/3) PingCAP.com

9.Batch Message (3/3) PingCAP.com

10.Titan ● 解决 RocksDB 写放大问题 ● 大 Value 移出 LSM Tree PingCAP.com

11.Titan (1/3)

12.Titan (2/3)

13.Titan (3/3)

14.Hibernate region ● Inactive regions can still consume a lot of CPU usages ○ tick, log gc routine ○ 220k regions PingCAP.com

15.Part II - SQL Layer

16.Parallel Operators

17.Query Execution Tracing

18.Query Plan Management

19.Others ● Roles Based Access Control (RBAC) ● Plugin Framework ● Table Partition:Range/Hash ○ Whitelist ○ Audit Log ● Restore Dropped Table ● Fast Analyze ● Slow Query ○ 300 million rows:7min 54s VS 6s ○ Log format ● Incremental Analyze ○ INFORMATION_SCHEMA.SLOW_QUERY ● Memory Tracking

20.Part III - Benchmarks

21.Sysbench: Point Query

22.Sysbench:Update Index

23.TPC-C

24.Part IV - TiFlash

25.TiFlash Architecture 0.5 Spark Cluster TiSpark TiSpark TiDB TiDB Worker Worker TiFlash Node 2 TiFlash Node 1 TiKV Node 1 TiKV Node 2 TiKV Node 3 Store 1 Store 2 Store 3 Region 1 Region 4 Region 2 Region 2 Region 3 Region 3 Region 3 Region 2 Region 4 Region 4 Region 1 Region 1 TiFlash Extension Cluster TiKV Cluster

26.TiFlash Architecture 1.0 SELECT AVG(s.price) FROM prod p, sales s TiDB WHERE p.pid = s.pid / AND p.batch_id = ‘B1328’; TiSpark Index Scan(batch_id = B1328) TableScan(price,pid) TiFlash Node 2 TiFlash Node 1 TiKV Node 1 TiKV Node 2 TiKV Node 3 Store 1 Store 2 Store 3 Region 1 Region 4 Region 2 Region 2 Region 3 Region 3 Region 3 Region 2 Region 4 Region 4 Region 1 Region 1 TiFlash Extension Cluster TiKV Cluster

27.Thank You! Any Questions ? 关注 PingCAP 官方微信 了解更多技术干货

TiDB 是一款定位于在线事务处理/在线分析处理( HTAP: Hybrid Transactional/Analytical Processing)的融合型数据库产品,实现了一键水平伸缩,强一致性的多副本数据安全,分布式事务,实时 OLAP 等重要特性。