Alluxio Architecture and Performance

Alluxio架构以及对大场景的一些优化
刘嘉承
2017年哥伦比亚大学计算机科学硕士毕业。2019年加入Alluxio开发团队,负责Alluxio和云场景相关及部分核心组件的开发工作

展开查看详情

1.

2. 刘嘉承 工程师

3.▪ ▪

4.

5.

6. Alluxio Job Master Master Job Job Job Worker Worker Worker Worker Worker Worker Fuse Fuse Fuse Proxy Proxy Proxy Process Process Process

7. Alluxio Job Master Master • Job Job Job Worker Worker Worker • Worker Worker Worker Fuse • Fuse Fuse Proxy Proxy Proxy • Process Process Process

8. • Alluxio Job Master Master • • Job Job Job Worker Worker Worker Worker Worker Worker Fuse Fuse Fuse Proxy Proxy Proxy Process Process Process

9. Alluxio Job Master Master • Job Job Job Worker Worker Worker Worker Worker Worker Fuse • Fuse Fuse Proxy Proxy Proxy • Process Process Process

10. Alluxio Job • Master Master • Job Job Job Worker Worker Worker Worker Worker Worker Fuse Fuse Fuse Proxy Proxy Proxy Process Process Process

11. • Alluxio Job • Master Master • • Job Job Job Worker Worker Worker Worker Worker Worker Fuse Fuse Fuse Proxy Proxy Proxy Process Process Process

12. Alluxio Job • Master Master • Job Job Job Worker Worker Worker Worker Worker Worker Fuse Fuse Fuse Proxy Proxy Proxy Process Process Process

13.

14.

15.

16.▪ • • • ▪ • • ▪ • •

17.Before UFS • • •

18.After UFS • • •

19.Before Client Client Alluxio Client Worker UFS Client • • •

20.After Client Client Alluxio Client Worker UFS Client • • •

21.Before Alluxio Client UDB Catalog • •

22.After Alluxio Client UDB Catalog • •

23.Before MEM SSD HDD • • •

24.After MEM SSD HDD • • •

25.Before Client Data Local Cache Disk • • •

26.After Client Data Local Cache Disk • •

27.

Alluxio,世界上第一个将分离的异构存储整合到统一平台,并提供近乎内存访问速度的中间件,广泛用于企业和混合云的商业数据分析加速。