Client-side transparent caching for remote ROOT data analysis

📅 2026-08-31
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
为解决高能物理分析中远程数据读取的网络延迟问题,本文提出uCache,一种客户端透明缓存方法,利用本地存储减少I/O和解压缩开销。
📝 Abstract
High-energy physics analyses often process the same data as physicists refine algorithms and test new ideas. With data increasingly read from remote storage, each iteration is subject to network latency and depends on network bandwidth and shared-storage throughput, which can vary substantially under load. We present uCache (xrd-ucache), a transparent client-side cache implemented as an XRootD client plugin that requires neither server-side deployment nor changes to analysis code. It uses local storage on the analysis machine as a cache layer between the network and memory. The cache stores only the data actually read by an analysis. It can also rebuild cached data into a branch-aligned, recompressed form, eliminating most of the input/output and decompression costs of subsequent passes. We benchmark the cache using the Analysis Grand Challenge top quark pair analysis on public CMS Open Data compressed with zlib and LZMA. Filling the cache adds essentially no overhead compared with a direct read. Subsequent passes are 1.6-8.8 times faster from the byte cache and 2.1-15.7 times faster from the recompressed cache. For a typical analysis, a 1 TB cache suffices for datasets of 10-20 TB. The largest improvements occur when the remote data source is heavily loaded or geographically distant.
Problem

Research questions and friction points this paper is trying to address.

high-energy physics
remote data analysis
network latency
bandwidth dependency
storage throughput
Innovation

Methods, ideas, or system contributions that make the work stand out.

client-side caching
transparent cache
XRootD plugin
branch-aligned recompression
remote data analysis
🔎 Similar Papers
D
Dmytro Kovalskyi
Massachusetts Institute of Technology, Cambridge, MA, USA
J
Jan Eysermans
Massachusetts Institute of Technology, Cambridge, MA, USA; CERN, Geneva, Switzerland
M
Mariarosaria D'Alfonso
Massachusetts Institute of Technology, Cambridge, MA, USA
C
Christoph Paus
Massachusetts Institute of Technology, Cambridge, MA, USA