Fine-Tuning Mistral 7B using QLoRA with PyTorch pt. 2: K8s & GKE | ML Engineering & MLOps
Hi All Continuing from Part 1, this post details the Kubernetes and Observability configs of the project. The full source is available here . Let's break the code down shall we. 1. K3's Server Config ( infra/server-config.yaml ) write-kubeconfig-mode: "0644" * Sets file permissions for kubeconfig file (readable by all users in the group) * 0644 means owner can read/write, group and others can only read disable: - traefik - servicelb - local-storage - metrics-server * Disables default k3s components that we'll replace with better alternatives. Components Disabled: * _traefik: Replaced with ingress-nginx for better control * _servicelb: Replaced with MetalLB or cloud load balancer * _local-storage: Replaced with Longhon for dynamic provisioning * _metrics-server: Replaced with Prometheus for better monit...