HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models
为解决长上下文推理中GPU内存消耗大、生成吞吐量低的问题,提出HeadWiseKV框架,通过压缩全局KV缓存并分配静态多级历史窗口来优化缓存需求。
为解决长上下文推理中GPU内存消耗大、生成吞吐量低的问题,提出HeadWiseKV框架,通过压缩全局KV缓存并分配静态多级历史窗口来优化缓存需求。
This study addresses the ambiguous empirical effectiveness and underlying mechanisms of green finance in facilitating urban low-carbon transitions, particularly the lack of systematic analysis on heterogeneity and regional disparities. Leveraging a dataset covering 285 Chinese cities, the authors integrate econometric and machine learning approaches to evaluate the impact of green finance on carbon intensity and its transmission channels through energy structure optimization and industrial upgrading. The findings reveal that the carbon-mitigation effects of green finance are more pronounced in cities characterized by weaker technological capabilities, higher industrial dependence, and greater coal consumption shares. Green bonds and green investments exhibit the strongest efficacy and generate significant spatial spillovers, with tier-four and tier-five cities deriving the greatest benefits. These results provide empirical support for designing a multi-tiered and differentiated green finance system.
为解决长上下文推理中GPU内存消耗大、生成吞吐量低的问题,提出HeadWiseKV框架,通过压缩全局KV缓存并分配静态多级历史窗口来优化缓存需求。
This study addresses the ambiguous empirical effectiveness and underlying mechanisms of green finance in facilitating urban low-carbon transitions, particularly the lack of systematic analysis on heterogeneity and regional disparities. Leveraging a dataset covering 285 Chinese cities, the authors integrate econometric and machine learning approaches to evaluate the impact of green finance on carbon intensity and its transmission channels through energy structure optimization and industrial upgrading. The findings reveal that the carbon-mitigation effects of green finance are more pronounced in cities characterized by weaker technological capabilities, higher industrial dependence, and greater coal consumption shares. Green bonds and green investments exhibit the strongest efficacy and generate significant spatial spillovers, with tier-four and tier-five cities deriving the greatest benefits. These results provide empirical support for designing a multi-tiered and differentiated green finance system.