Mailchimp Scale:a MySQL Perspective

下载 0

晚吟

发布于

5253

人观看

#信息技术

除了中小企业和企业外，mailchimp已经从一家小公司成长为服务于数以百万计的微型企业。对于MySQL，我们有一个相当普通的方法，但是现在我们运行了数百个，可能很快就会有数千个MySQL实例。我们现在的状态要归功于强大的全栈工程团队合作。这是一个让mailchimp滴答作响的一瞥。提示，这不仅仅是技术。这是关于“动力”和“实用主义”，并为我们赋予弱势群体权力的使命创造了一个伟大的成果。

展开查看详情

1 . Mailchimp Scale: A MySQL Perspective John Scott Mailchimp

2 .What is Mailchimp’s secret sauce? Hint: It’s not much of a secret. 2

3 .Focus on the small business “Empowering the Underdog” 3

4 . “We give marketers production-ready software designed to help them grow…” Mailchimp Engineering Mission Statement https://mailchimp.com/culture/how-our-engineering-team-found-its-mission-statement/

5 .5

6 .Another way to say it “We SCALE through togetherness, momentum, and pragmatism.” 6

7 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance

8 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance “I’m a DevOps DBA”

9 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance

10 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance “I help other departments work with databases”

11 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance

12 .Old Mentality: The 3 Disciplines of Data Administration ● OPS / KTLO ● Support ● Performance “over the fence”

13 .New Mentality: “Ops is product”

14 .Ops is Product “If you improve database performance resulting in 10% reduction in churn, you would create an additional <big revenue number>.”

15 .Ops is Product “Developer Enablement” New paradigm “looking at ops through the lens of product” --Tyler Treat ● https://bravenewgeek.com/operations-in-the-world-of-developer-enablement/ ● https://www.youtube.com/watch?v=JUy3GYkPfto OR in the case of Mailchimp, ops actually developing software, too.

16 .Developer Enablement Product Enablement In most organizations “Product enablement” is sales term with the “four Ps” ● Positioning ● Pitch ● Play ● Program

17 .Developer Enablement Product Enablement 1000 employees 350+ engineers 0 salespeople

18 .Mailchimp “Board Room”

19 .

20 . Sounds great. But what does that mean for a database engineer?

21 .#togetherness in action MySQL log analysis based on pt-query-digest and Elasticsearch / Kibana resulted in a Top 20 table activity graph

22 .End of story? “Toss it over the wall.” “Not my problem.” “I don’t have commit rights.”

23 .This is Mailchimp Engineering “We succeed through togetherness, Momentum, and Pragmatism”

24 .We identified an N+1 pattern and fixed it, together.

25 .But wait....

26 .What was the impact to the user experience?

27 .265 billion queries per week 247 thousand unique query fingerprints 2200 Instances of mysql

28 .Old Mentality: Effective Slow Query Log Analysis Across The Infrastructure FTW! “Query Macroeconomics” https://johnscott.net/2018/08/03/query-macroeconomics/ ● Prioritize query fixes by how much DB capacity you get back ○ MySQL not stressed with contention equals what? ■ A pretty innodb status? ■ Nice looking graphs?

29 .Old Mentality: Effective Slow Query Log Analysis Across The Infrastructure FTW! “Query Macroeconomics” https://johnscott.net/2018/08/03/query-macroeconomics/ ● Prioritize query fixes by how much DB capacity you get back ○ MySQL not stressed with contention equals what? ■ A pretty innodb status? ■ Nice looking graphs?

8点赞

3收藏

0下载