🤖 AI Summary
Existing container orchestrators lack dynamic SR-IOV virtual network device configuration aligned with application bandwidth requirements and offer insufficient fine-grained control over RDMA virtualization interfaces. To address this, we propose ConRDMA—a novel SR-IOV extension control plane that integrates container orchestration APIs, a customized RDMA driver, and a bandwidth-aware scheduling algorithm. ConRDMA enables configurable, fine-grained allocation of container-level RDMA virtual devices and optimizes cross-node communication paths. It realizes bandwidth-driven dynamic resource scheduling while preserving RDMA’s high-performance communication capabilities and significantly reducing virtualization overhead. Experimental evaluation demonstrates that ConRDMA improves RDMA bandwidth utilization by over 35% and supports optimal node scheduling tailored to application-specific communication demands.
📝 Abstract
Single Root Input/Output Virtualization (SR-IOV) is a standard technology for forking a single PCI express device and providing it to applications while ensuring performance isolation. It enables container orchestrators to share a limited number of physical network interfaces without incurring significant virtualization overhead. The allocation of virtualized network devices to containers, however, needs to be more configurable based on the bandwidth needs of running applications. Moreover, container orchestrators’ network control over the virtualized interfaces is limited by the abilities of SR-IOV. We explore the design considerations for a system with controlled SR-IOV virtualization and present ConRDMA, a novel architecture that enables fine control of RDMA virtualization for containers. Our evaluation shows that ConRDMA enables containers to use RDMA allocated bandwidth more efficiently and to select best-suited nodes to meet their varying communication requirements.