Federated Inference: Toward Privacy-Preserving Collaborative and Incentivized Model Serving
This work proposes Federated Inference (FI) as a complementary paradigm to federated learning, enabling secure collaboration among private models during inference without sharing data or model parameters. The study introduces the first unified abstraction framework for FI, articulating two core objectives: preserving privacy during inference and achieving performance gains through collaboration. Building upon secure multi-party computation, the authors design a privacy-preserving collaborative inference architecture that integrates ensemble learning and incentive mechanisms. Systematic modeling and empirical analysis are conducted under non-IID data distributions and stringent privacy constraints. Experimental results reveal critical trade-offs among privacy, collaboration efficacy, and incentive alignment, underscoring the necessity of designing FI systems independently from conventional training-centric paradigms.