Kolmogorov Arnold Networks and Multi-Layer Perceptrons: A Paradigm Shift in Neural Modelling
This study addresses the longstanding trade-off between accuracy and efficiency in conventional neural networks by systematically comparing Kolmogorov–Arnold Networks (KANs) with Multilayer Perceptrons (MLPs). Built upon the Kolmogorov representation theorem, KANs employ learnable spline-based activation functions within a grid-structured architecture, achieving both high accuracy and low computational cost. Experimental results across diverse tasks—including nonlinear function approximation, time series forecasting, and multivariate classification—demonstrate that KANs consistently outperform MLPs in predictive performance while significantly reducing floating-point operations (FLOPs). These findings position KANs as an interpretable, efficient, and accurate alternative architecture, particularly well-suited for resource-constrained and real-time applications.