kube/proxmox-csi

proxmox-csi

1. create role in pve if it doesn't exist
2. create user and assign permissions, preferrably at resource pool level

   pveum user add ks-kubernetes-csi@pve
   pveum aclmod /pool/kspace_pool -user ks-kubernetes-csi@pve -role CSI
   pveum user token add ks-kubernetes-csi@pve cs -privsep 0
   

   save the token!
3. apply proxmox-csi-plugin.yml and storage-class.yaml, delete proxmox-csi default storage classes from kube.
4. add the token from pve to config.yaml and create the secret: kubectl -n csi-proxmox create secret generic proxmox-csi-plugin --from-file=config.yaml
5. label the nodes according to allocation:

   kubectl --kubeconfig ~/.kube/k-space label nodes worker1.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve1 --overwrite
   kubectl --kubeconfig ~/.kube/k-space label nodes worker2.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve2 --overwrite
   kubectl --kubeconfig ~/.kube/k-space label nodes worker3.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve8 --overwrite
   kubectl --kubeconfig ~/.kube/k-space label nodes worker4.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve9 --overwrite
   
   kubectl --kubeconfig ~/.kube/k-space label nodes master1.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve1 --overwrite
   kubectl --kubeconfig ~/.kube/k-space label nodes master2.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve2 --overwrite
   kubectl --kubeconfig ~/.kube/k-space label nodes master3.kube.k-space.ee topology.kubernetes.io/region=pve-cluster topology.kubernetes.io/zone=pve8 --overwrite