Synchronizing Probabilities in Model-Driven Lossless Compression
This work addresses a critical yet previously unformalized issue in model-driven lossless compression: decoding failures caused by inconsistencies between the probability predictions of the encoder and decoder. To resolve this prediction mismatch problem, the authors propose PMATIC, a model-agnostic fault-tolerant encoding algorithm that introduces a bounded prediction bias tolerance mechanism. This approach maintains theoretical correctness while substantially reducing computational and compression overhead. PMATIC is designed as a drop-in replacement for conventional arithmetic coders and is compatible with any probabilistic prediction model, including deep neural networks. Empirical evaluations on textual data demonstrate that PMATIC achieves superior compression ratios compared to state-of-the-art tools, even in the presence of non-negligible prediction discrepancies.