HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning
This study addresses the challenges of high cost, limited spatial coverage, and susceptibility to adverse weather that plague conventional in situ coastal wave observation methods, which hinder efficient acquisition of wave parameters. To overcome these limitations, the authors propose a deep learning framework that leverages monocular coastal video to jointly estimate five key wave parameters—significant wave height, maximum wave height, peak period, zero-crossing period, and wave direction—under data-scarce conditions. The approach integrates a self-supervised V-JEPA vision transformer, a SlowFast dual-stream temporal encoder, and Farneback optical flow, while incorporating Airy dispersion relation constraints to enforce physical consistency. Validated with only six annotated scenes and accelerated via high-performance computing, the model achieves Pearson correlation coefficients ranging from 0.451 to 0.832 across all five parameters, demonstrating both feasibility and strong cross-site generalization capability.