71 lines
1.9 KiB
Text
71 lines
1.9 KiB
Text
|
title: ungleich production cluster #1
|
||
|
|
---
|
||
|
|
pub_date: 2021-07-05
|
||
|
|
---
|
||
|
|
author: ungleich
|
||
|
|
---
|
||
|
|
twitter_handle: ungleich
|
||
|
|
---
|
||
|
|
_hidden: no
|
||
|
|
---
|
||
|
|
_discoverable: no
|
||
|
|
---
|
||
|
|
abstract:
|
||
|
|
In this blog article we describe our way to our first production
|
||
|
|
kubernetes cluster.
|
||
|
|
---
|
||
|
|
body:
|
||
|
|
|
||
|
|
## Introduction
|
||
|
|
|
||
|
|
This article is WIP to describe all steps required for our first
|
||
|
|
production kubernetes cluster and the services that we run in it.
|
||
|
|
|
||
|
|
## Setup
|
||
|
|
|
||
|
|
### Bootstrapping
|
||
|
|
|
||
|
|
* All nodes are running [Alpine Linux](https://alpinelinux.org)
|
||
|
|
* All nodes are configured using [cdist](https://cdi.st)
|
||
|
|
* Mainly installing kubeadm, kubectl, crio *and* docker
|
||
|
|
* At the moment we try to use crio
|
||
|
|
* The cluster is initalised using **kubeadm init --config
|
||
|
|
k8s/c2/kubeadm.yaml** from the [ungleich-k8s repo](https://code.ungleich.ch/ungleich-public/ungleich-k8s)
|
||
|
|
|
||
|
|
### CNI/Networking
|
||
|
|
|
||
|
|
* Calico is installed using **kubectl apply -f
|
||
|
|
cni-calico/calico.yaml** from the [ungleich-k8s
|
||
|
|
repo](https://code.ungleich.ch/ungleich-public/ungleich-k8s)
|
||
|
|
* Installing calicoctl using **kubectl apply -f
|
||
|
|
https://docs.projectcalico.org/manifests/calicoctl.yaml**
|
||
|
|
* Aliasing calicoctl: **alias calicoctl="kubectl exec -i -n kube-system calicoctl -- /calicoctl"**
|
||
|
|
* All nodes BGP peer with our infrastructure using **calicoctl create -f - < cni-calico/bgp-c2.yaml**
|
||
|
|
|
||
|
|
### Persistent Volume Claim support
|
||
|
|
|
||
|
|
* Provided by rook
|
||
|
|
* Using customized manifests to support IPv6 from ungleich-k8s
|
||
|
|
|
||
|
|
```
|
||
|
|
for yaml in crds common operator cluster storageclass-cephfs storageclass-rbd toolbox; do
|
||
|
|
kubectl apply -f ${yaml}.yaml
|
||
|
|
done
|
||
|
|
```
|
||
|
|
|
||
|
|
### Flux
|
||
|
|
|
||
|
|
Starting with the 2nd cluster?
|
||
|
|
|
||
|
|
|
||
|
|
## Follow up
|
||
|
|
|
||
|
|
If you are interesting in continuing the discussion,
|
||
|
|
we are there for you in
|
||
|
|
**the #kubernetes:ungleich.ch Matrix channel**
|
||
|
|
[you can signup here if you don't have an
|
||
|
|
account](https://chat.with.ungleich.ch).
|
||
|
|
|
||
|
|
Or if you are interested in an IPv6 only kubernetes cluster,
|
||
|
|
drop a mail to **support**-at-**ungleich.ch**.
|