Performance and Cost-Aware Cache Provisioning

2026-08-10

AI Summary

This work addresses the challenge of minimizing cache capacity while meeting a specified service-level objective (SLO) hit rate in edge–cloud协同 environments. To this end, the authors propose an SLO-driven dynamic hybrid segmented caching strategy that leverages historical access patterns to adaptively adjust segment proportions within the cache. By dynamically reallocating cache space based on observed workload characteristics, the approach ensures the target hit rate is consistently achieved while substantially reducing both required storage capacity and computational overhead. Experimental evaluation using both real-world and synthetic workload traces demonstrates that, compared to conventional fixed-capacity caching configurations, the proposed strategy effectively lowers cache requirements across diverse load conditions without compromising performance, thereby achieving joint optimization of storage efficiency and system responsiveness.

Abstract

While traditional cache policy evaluations fix capacity - often at 0.1% of the dataset - and measure the resulting hit rate, practical edge-cloud deployments require balancing both storage and computational overhead as billed resources. Consequently, system operators frequently focus on a different objective: determining the minimum cache size needed to satisfy a specific Service-Level Objective (SLO) hit-rate. This paper explores this SLO-centric paradigm by analyzing the minimum capacity and execution time each policy requires to hit a defined target. Additionally, we show that dynamically adjusting the segment ratio in segmented policies based on historical workload patterns enhances efficiency. Through evaluations across real-world and synthetic traces, we present a novel hybrid segmented policy that reduces capacity requirements while keeping processing costs low.

Problem

• cache provisioning
• Service-Level Objective
• edge-cloud
• storage overhead
• computational overhead

Innovation

• SLO-aware caching
• cache provisioning
• segmented cache policy
• dynamic segment ratio
• cost-performance tradeoff