🤖 AI Summary
To address insufficient prediction accuracy of video frame forecasting in critical applications such as weather forecasting and autonomous driving, this paper proposes a hybrid deep architecture integrating an autoencoder with spatiotemporal modeling networks. We systematically evaluate the performance of autoencoders cascaded with RNNs, 3D CNNs, and ConvLSTMs, identifying the autoencoder–3D CNN–ConvLSTM pipeline as optimal for real-world grayscale videos. Using SSIM as a unified evaluation metric, we validate our approach on three heterogeneous video datasets, achieving an average SSIM improvement from 0.69 to 0.82—significantly outperforming single-model baselines. Our work elucidates the synergistic gains arising from multi-stage feature compression and sequential modeling, and establishes a reproducible, high-fidelity benchmark framework for video prediction in complex dynamic scenes.
📝 Abstract
In recent years, advances in Artificial Intelligence have significantly impacted computer science, particularly in the field of computer vision, enabling solutions to complex problems such as video frame prediction. Video frame prediction has critical applications in weather forecasting or autonomous systems and can provide technical improvements, such as video compression and streaming. Among Artificial Intelligence methods, Deep Learning has emerged as highly effective for solving vision-related tasks, although current frame prediction models still have room for enhancement. This paper evaluates several hybrid deep learning approaches that combine the feature extraction capabilities of autoencoders with temporal sequence modelling using Recurrent Neural Networks (RNNs), 3D Convolutional Neural Networks (3D CNNs), and related architectures. The proposed solutions were rigorously evaluated on three datasets that differ in terms of synthetic versus real-world scenarios and grayscale versus color imagery. Results demonstrate that the approaches perform well, with SSIM metrics increasing from 0.69 to 0.82, indicating that hybrid models utilizing 3DCNNs and ConvLSTMs are the most effective, and greyscale videos with real data are the easiest to predict.