Deep dive#5 Milvus 如何实现实时查询

1 .Milvus Deep Dive #5 How milvus enables real-time queries 

2 .Speaker bio Xi Ge Software Engineer Milvus2.0 & Arctern contributer • Education: Master, Huazhong University of Science and Technology • Homepage: https://github.com/xige-16/xige-16.github.io • Interests: Reading/Running 

3 .Agenda • Data insertion and data storage process review • Load data into query node • Real-time data query • Q&A 

4 .Data insertion and data storage process review 

5 .Milvus Architecture Overview Separation of storage and calculation 

6 .Milvus insert and storage process ① ② ③ ④ ⑤ 

7 .Milvus Reliability • Data in log broker (streaming) + Data in storage (batch) = Full Data • With the support of log brokers and storage, query nodes can query in real time 

8 .Load data into query nodes 

9 .Data management in Log broker 

10 .Data management in Object storage 

11 .Flowcharts of load collection 

12 .Historical data management on query node Index can only be loaded into the sealed segment Load balance Query node down 

13 .Incremental data management on query node Flow graph insert data into growing segment 

14 .Real-time data query 

15 .Query request l Service Timestamp: All data inserted before service ts can be queried, updated by tsafe l Travel Timestamp: Only messages inserted before (service ts – travel ts) are queried l Guarantee Timestamp: start doing query after service ts >= guarantee ts 

16 .Query execute process on query node 

17 .Global reduce on proxy 

18 .Thank You https://milvus.io https://github.com/milvus-io/milvus 扫码加入直播交流群 关注 Milvus 视频号 https://twitter.com/milvusio 与讲师实时QA 直播视频早知道