π€ AI Summary
This work addresses significant cost inefficiencies in Kubernetes arising from resource over-provisioning and the limitations of existing autoscaling mechanisms, which often exhibit delayed responses and may obscure critical issues such as memory leaks. The authors propose a container vertical resource optimization approach grounded in a five-layer safety pipeline that introduces gating mechanisms prior to scaling decisions, with memory leak detection serving as a pivotal blocking criterion. The framework integrates SLA monitoring, circuit breakers, policy engines, and human-in-the-loop approval to ensure system reliability. Memory leaks are identified through a combination of linear regression (using RΒ² scores) and percentile-based analysis, while scaling recommendations are generated via Holt-Winters forecasting and multi-objective Pareto optimization. The solution also incorporates conflict detection between Horizontal Pod Autoscaler (HPA) and Pod Disruption Budget (PDB) policies. Evaluated on Google Kubernetes Engine, the method achieves 20β40% cost savings, demonstrates 83% accuracy in memory leak detection, and validates reliability through 1,118 test cases covering 80.3% of the system.
π Abstract
Kubernetes is the standard platform for orchestrating containerized applications, yet resource management remains difficult. To stay safe, engineers over-provision CPU and memory, leaving reserved but unused capacity that is the main source of wasted cost. The built-in Horizontal and Vertical Pod Autoscalers are reactive: they act only after a threshold is crossed, which causes lag, over-provisioning, and can mask software defects by granting a leaking workload more memory. Predictive autoscalers focus on improving forecasting accuracy or run inside proprietary infrastructure, and anomaly detection is used only to alert, never to block a harmful action. The Intelligent Cluster Optimizer is an open-source Kubernetes operator that right-sizes container workloads with safety as a first-class concern. Its central contribution is a five-layer safety pipeline where a memory-leak detector, based on linear regression with R^2 scoring, acts as a blocking gate: if a leak is detected the recommendation is rejected, so the optimizer never hides a bug by enlarging a broken container. The pipeline combines SLA monitoring, a circuit breaker, HPA/PDB conflict detection, and a policy engine, with rollback and dry-run mode for human approval. Recommendations are produced by percentile analysis and Holt-Winters forecasting, balanced through multi-objective Pareto optimization at the per-container level. We validated the system with 1118 automated tests at 80.3% coverage and a live deployment on Google Kubernetes Engine, where right-sizing produced estimated cost savings of 20--40% in what-if projections and the leak gate reached 83% detection accuracy.