通过腾讯案例研究深入了解 Cluster API

1 .Cluster API Deep Dive With a Tencent Case Study 

2 .闵峰　Feng Min 洪志国　Zhiguo Hong Staff Software Engineer at Google Software Architect at Tencent Cloud. Kubernetes team. 

3 . Agenda • What’s Cluster API • Upgrade as example • Bootstrapping • How to deploy • Demo 

4 .Where we are ● Cluster Management is a hard job. ● Fragmented tooling and ecosystem. ● Too many tools to choose from. ● Reinventing wheels. 

5 .What’s Cluster API? ● Cluster Declarative API ● Machine ● Machine Set + Machine Deployment ● Machine Lifecycle (incl. Provisioning) Common Logic ● Machine Upgrade ● Infrastructure platform (vSphere, GCP, AWS, etc.) Pluggable Architecture ● Support for various Operating Systems ● Cluster Bootstrapping, Upgrade Tooling, Services ● Auto-scaling, Repair, Node Auto-provisioning 

6 .What’s Cluster API Cluster Config with Declarative API 

7 . What is configured? apiVersion: "cluster-api.k8s.io/v1alpha1" ● Cluster-level Configuration kind: Cluster ○ Network metadata: • Machine setup name: kubecon-demo • # of machines? spec: • Platform-specific clusterNetwork: configuration services: • GCP project, machine type cidrBlocks: ["10.96.0.0/12"] • Software on those machines pods: • Kubelet Version cidrBlocks: ["192.168.0.0/16"] • Control Plane serviceDomain: "cluster.local" 

8 . What is configured? apiVersion: "cluster.k8s.io/v1alpha1" ● Cluster-level Configuration kind: MachineSet ○ Network metadata: • Machine setup name: my-first-machineset • # of machines? spec: • Platform-specific replicas: 3 configuration template: • GCP project, machine type metadata: • Software on those machines spec: • Kubelet Version ... • Control Plane roles: - Node 

9 . What is configured? apiVersion: "cluster.k8s.io/v1alpha1" ● Cluster-level Configuration kind: Machine ○ Network metadata: • Machine setup name: gce-master-kubecon • # of machines? spec: • Platform-specific providerConfig: > configuration { • GCP project, machine type "project": "gke-kubecon", • Software on those machines "zone": "us-central1-f", • Kubelet Version "machineType": "n1-standard-2", • Control Plane "image": "/path/to/ubuntu-1604-lts" } 

10 . What is configured? apiVersion: "cluster.k8s.io/v1alpha1" ● Cluster-level Configuration kind: Machine ○ Network metadata: • Machine setup name: gce-master-kubecon • # of machines? spec: • Platform-specific providerConfig: { configuration ... • GCP project, machine type } • Software on those versions: machines kubelet: 1.7.4 • Kubelet Version controlPlane: 1.7.4 • Control Plane 

11 .What’s Cluster API Tooling, YAML, CRDs, Controllers 

12 .Logical Flow - YAML to Objects 

13 .Logical Flow - Objects to Machines 

14 .Case Study: Upgrade How do we upgrade K8s Cluster using Cluster API? 

15 .Upgrade MachineDeployment - replicas: 3 - nodes: MyNodes - maxSurge: 1 - maxUnavailable: 0 - version: v1.8.3 

16 .Upgrade MachineDeployment - replicas: 3 - nodes: MyNodes - maxSurge: 1 - maxUnavailable: 0 - version: v1.9.3 

17 . Upgrade MachineSet - replicas: 3 - version: v1.8.3 - selector: - nodes: MyNodes 

18 . Upgrade MachineSet MachineSet - replicas: 3 - replicas: 0 - version: v1.8.3 - version: v1.9.3 - selector: - selector: - nodes: MyNodes - nodes: MyNodes 

19 . Upgrade MachineSet MachineSet - replicas: 3 - replicas: 1 - version: v1.8.3 - version: v1.9.3 - selector: - selector: - nodes: MyNodes - nodes: MyNodes 

20 . Upgrade MachineSet MachineSet - replicas: 2 - replicas: 2 - version: v1.8.3 - version: v1.9.3 - selector: - selector: - nodes: MyNodes - nodes: MyNodes 

21 . Upgrade MachineSet MachineSet - replicas: 1 - replicas: 3 - version: v1.8.3 - version: v1.9.3 - selector: - selector: - nodes: MyNodes - nodes: MyNodes 

22 . Upgrade MachineSet MachineSet - replicas: 0 - replicas: 3 - version: v1.8.3 - version: v1.9.3 - selector: - selector: - nodes: MyNodes - nodes: MyNodes 

23 .Bootstrapping How to get cluster api components up and running? 

24 .Bootstrapping - 10 km view CLI User Local Temporary Control External Cluster Plane 

25 .Bootstrapping - 10 km view CLI User Local Temporary Control External Cluster Plane Machine Controller Cluster Controller 

26 .Bootstrapping - 10 km view CLI User Local Temporary Control External Cluster Plane Machine Machine A Controller Cluster Cluster A Controller 

27 .Bootstrapping - 10 km view Control CLI User Cluster Plane Local Temporary Control External Cluster Plane Machine Machine A Controller Cluster Cluster A Controller 

28 .Bootstrapping - 10 km view Control CLI User Cluster Plane Machine A Local Temporary Control External Cluster Plane Cluster A Machine Machine A Controller Cluster Cluster A Controller 

29 .Bootstrapping - 10 km view Control CLI User Cluster Plane Machine Machine A Controller Local Temporary Control External Cluster Plane Cluster Cluster A Machine Controller Machine A Controller Cluster Cluster A Controller