root@hogwarts-706b037afa5e:~# kubeadm init --kubernetes-version=v1.28.1 -v5
I0831 21:34:13.353431 25921 initconfiguration.go:117] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0831 21:34:13.353871 25921 interface.go:432] Looking for default routes with IPv4 addresses
I0831 21:34:13.353884 25921 interface.go:437] Default route transits interface "eth0"
I0831 21:34:13.354063 25921 interface.go:209] Interface eth0 is up
I0831 21:34:13.354134 25921 interface.go:257] Interface "eth0" has 2 addresses :[172.17.56.126/20 fe80::216:3eff:fe38:884b/64].
I0831 21:34:13.354149 25921 interface.go:224] Checking addr 172.17.56.126/20.
I0831 21:34:13.354207 25921 interface.go:231] IP found 172.17.56.126
I0831 21:34:13.354249 25921 interface.go:263] Found valid IPv4 address 172.17.56.126 for interface "eth0".
I0831 21:34:13.354286 25921 interface.go:443] Found active IP 172.17.56.126
I0831 21:34:13.354334 25921 kubelet.go:196] the value of KubeletConfiguration.cgroupDriver is empty; setting it to "systemd"
[init] Using Kubernetes version: v1.28.1
[preflight] Running pre-flight checks
I0831 21:34:13.359258 25921 checks.go:563] validating Kubernetes and kubeadm version
I0831 21:34:13.359285 25921 checks.go:168] validating if the firewall is enabled and active
I0831 21:34:13.368798 25921 checks.go:203] validating availability of port 6443
I0831 21:34:13.369058 25921 checks.go:203] validating availability of port 10259
I0831 21:34:13.369090 25921 checks.go:203] validating availability of port 10257
I0831 21:34:13.369136 25921 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I0831 21:34:13.369153 25921 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I0831 21:34:13.369169 25921 checks.go:280] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I0831 21:34:13.369188 25921 checks.go:280] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I0831 21:34:13.369205 25921 checks.go:430] validating if the connectivity type is via proxy or direct
I0831 21:34:13.369256 25921 checks.go:469] validating http connectivity to first IP address in the CIDR
I0831 21:34:13.369280 25921 checks.go:469] validating http connectivity to first IP address in the CIDR
I0831 21:34:13.369295 25921 checks.go:104] validating the container runtime
I0831 21:34:13.400312 25921 checks.go:639] validating whether swap is enabled or not
I0831 21:34:13.400534 25921 checks.go:370] validating the presence of executable crictl
I0831 21:34:13.400627 25921 checks.go:370] validating the presence of executable conntrack
I0831 21:34:13.400692 25921 checks.go:370] validating the presence of executable ip
I0831 21:34:13.400755 25921 checks.go:370] validating the presence of executable iptables
I0831 21:34:13.400818 25921 checks.go:370] validating the presence of executable mount
I0831 21:34:13.400882 25921 checks.go:370] validating the presence of executable nsenter
I0831 21:34:13.400940 25921 checks.go:370] validating the presence of executable ebtables
I0831 21:34:13.401004 25921 checks.go:370] validating the presence of executable ethtool
I0831 21:34:13.401045 25921 checks.go:370] validating the presence of executable socat
I0831 21:34:13.401091 25921 checks.go:370] validating the presence of executable tc
I0831 21:34:13.401132 25921 checks.go:370] validating the presence of executable touch
I0831 21:34:13.401182 25921 checks.go:516] running all checks
I0831 21:34:13.415273 25921 checks.go:401] checking whether the given node name is valid and reachable using net.LookupHost
I0831 21:34:13.415523 25921 checks.go:605] validating kubelet version
I0831 21:34:13.477084 25921 checks.go:130] validating if the "kubelet" service is enabled and active
I0831 21:34:13.489051 25921 checks.go:203] validating availability of port 10250
I0831 21:34:13.489141 25921 checks.go:329] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0831 21:34:13.489223 25921 checks.go:329] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0831 21:34:13.489261 25921 checks.go:203] validating availability of port 2379
I0831 21:34:13.489310 25921 checks.go:203] validating availability of port 2380
I0831 21:34:13.489362 25921 checks.go:243] validating the existence and emptiness of directory /var/lib/etcd
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0831 21:34:13.489490 25921 checks.go:828] using image pull policy: IfNotPresent
I0831 21:34:13.527469 25921 checks.go:846] image exists: registry.k8s.io/kube-apiserver:v1.28.1
I0831 21:34:13.559188 25921 checks.go:846] image exists: registry.k8s.io/kube-controller-manager:v1.28.1
I0831 21:34:13.590399 25921 checks.go:846] image exists: registry.k8s.io/kube-scheduler:v1.28.1
I0831 21:34:13.620338 25921 checks.go:846] image exists: registry.k8s.io/kube-proxy:v1.28.1
W0831 21:34:13.652109 25921 checks.go:835] detected that the sandbox image "registry.k8s.io/pause:3.6" of the container runtime is inconsistent with that used by kubeadm. It is recommended that using "registry.k8s.io/pause:3.9" as the CRI sandbox image.
I0831 21:34:13.682690 25921 checks.go:846] image exists: registry.k8s.io/pause:3.9
I0831 21:34:13.712533 25921 checks.go:846] image exists: registry.k8s.io/etcd:3.5.9-0
I0831 21:34:13.747988 25921 checks.go:846] image exists: registry.k8s.io/coredns/coredns:v1.10.1
[certs] Using certificateDir folder "/etc/kubernetes/pki"
I0831 21:34:13.748068 25921 certs.go:112] creating a new certificate authority for ca
[certs] Generating "ca" certificate and key
I0831 21:34:13.913871 25921 certs.go:519] validating certificate period for ca certificate
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [hogwarts-706b037afa5e kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 172.17.56.126]
[certs] Generating "apiserver-kubelet-client" certificate and key
I0831 21:34:14.476006 25921 certs.go:112] creating a new certificate authority for front-proxy-ca
[certs] Generating "front-proxy-ca" certificate and key
I0831 21:34:14.634221 25921 certs.go:519] validating certificate period for front-proxy-ca certificate
[certs] Generating "front-proxy-client" certificate and key
I0831 21:34:15.134402 25921 certs.go:112] creating a new certificate authority for etcd-ca
[certs] Generating "etcd/ca" certificate and key
I0831 21:34:15.288927 25921 certs.go:519] validating certificate period for etcd/ca certificate
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [hogwarts-706b037afa5e localhost] and IPs [172.17.56.126 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [hogwarts-706b037afa5e localhost] and IPs [172.17.56.126 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
I0831 21:34:15.857845 25921 certs.go:78] creating new public/private key files for signing service account users
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0831 21:34:16.120023 25921 kubeconfig.go:103] creating kubeconfig file for admin.conf
[kubeconfig] Writing "admin.conf" kubeconfig file
I0831 21:34:16.311396 25921 kubeconfig.go:103] creating kubeconfig file for kubelet.conf
[kubeconfig] Writing "kubelet.conf" kubeconfig file
I0831 21:34:16.477828 25921 kubeconfig.go:103] creating kubeconfig file for controller-manager.conf
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0831 21:34:16.627616 25921 kubeconfig.go:103] creating kubeconfig file for scheduler.conf
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0831 21:34:16.923834 25921 local.go:65] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
I0831 21:34:16.923889 25921 manifests.go:102] [control-plane] getting StaticPodSpecs
I0831 21:34:16.924147 25921 certs.go:519] validating certificate period for CA certificate
I0831 21:34:16.924231 25921 manifests.go:128] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I0831 21:34:16.924242 25921 manifests.go:128] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
I0831 21:34:16.924256 25921 manifests.go:128] [control-plane] adding volume "etc-pki" for component "kube-apiserver"
I0831 21:34:16.924268 25921 manifests.go:128] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I0831 21:34:16.924280 25921 manifests.go:128] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
I0831 21:34:16.924298 25921 manifests.go:128] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
I0831 21:34:16.925223 25921 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
I0831 21:34:16.925246 25921 manifests.go:102] [control-plane] getting StaticPodSpecs
I0831 21:34:16.925495 25921 manifests.go:128] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I0831 21:34:16.925506 25921 manifests.go:128] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
I0831 21:34:16.925516 25921 manifests.go:128] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"
I0831 21:34:16.925525 25921 manifests.go:128] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I0831 21:34:16.925533 25921 manifests.go:128] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I0831 21:34:16.925546 25921 manifests.go:128] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I0831 21:34:16.925557 25921 manifests.go:128] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
I0831 21:34:16.925568 25921 manifests.go:128] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
I0831 21:34:16.926423 25921 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[control-plane] Creating static Pod manifest for "kube-scheduler"
I0831 21:34:16.926444 25921 manifests.go:102] [control-plane] getting StaticPodSpecs
I0831 21:34:16.926662 25921 manifests.go:128] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
I0831 21:34:16.927685 25921 manifests.go:157] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
I0831 21:34:16.927719 25921 kubelet.go:67] Stopping the kubelet
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
I0831 21:34:17.439009 25921 waitcontrolplane.go:83] [wait-control-plane] Waiting for the API server to be healthy
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[apiclient] All control plane components are healthy after 11.002744 seconds
I0831 21:34:28.444520 25921 uploadconfig.go:112] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0831 21:34:28.477006 25921 uploadconfig.go:126] [upload-config] Uploading the kubelet component config to a ConfigMap
[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0831 21:34:28.491073 25921 uploadconfig.go:131] [upload-config] Preserving the CRISocket information for the control-plane node
I0831 21:34:28.491093 25921 patchnode.go:31] [patchnode] Uploading the CRI Socket information "unix:///var/run/containerd/containerd.sock" to the Node API object "hogwarts-706b037afa5e" as an annotation
[upload-certs] Skipping phase. Please see --upload-certs
[mark-control-plane] Marking the node hogwarts-706b037afa5e as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[mark-control-plane] Marking the node hogwarts-706b037afa5e as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]
[bootstrap-token] Using token: w59mog.e78apeadrc9laykh
[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0831 21:34:29.537632 25921 clusterinfo.go:47] [bootstrap-token] loading admin kubeconfig
I0831 21:34:29.538191 25921 clusterinfo.go:58] [bootstrap-token] copying the cluster from admin.conf to the bootstrap kubeconfig
I0831 21:34:29.538457 25921 clusterinfo.go:70] [bootstrap-token] creating/updating ConfigMap in kube-public namespace
I0831 21:34:29.541495 25921 clusterinfo.go:84] creating the RBAC rules for exposing the cluster-info ConfigMap in the kube-public namespace
I0831 21:34:29.548708 25921 kubeletfinalize.go:90] [kubelet-finalize] Assuming that kubelet client certificate rotation is enabled: found "/var/lib/kubelet/pki/kubelet-client-current.pem"
[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0831 21:34:29.549630 25921 kubeletfinalize.go:134] [kubelet-finalize] Restarting the kubelet to enable client certificate rotation
[addons] Applied essential addon: CoreDNS
[addons] Applied essential addon: kube-proxy
Your Kubernetes control-plane has initialized successfully!
To start using your cluster, you need to run the following as a regular user:
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config
Alternatively, if you are the root user, you can run:
export KUBECONFIG=/etc/kubernetes/admin.conf
You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
https://kubernetes.io/docs/concepts/cluster-administration/addons/
Then you can join any number of worker nodes by running the following on each as root:
kubeadm join 172.17.56.126:6443 --token w59mog.e78apeadrc9laykh \
--discovery-token-ca-cert-hash sha256:df6e08b7435f088f8bb73bb711377172b0d19aa58e775e7665b4da7f55600cee