Machine learning methods for solving partial differential equations (PDEs) significantly improve computational efficiency over traditional numerical solvers such as finite element method (FEM). However, PDE dynamics inherently span both local and global dynamics: disturbances propagate and decay gradually through the domain, while global coupling effects can influence the whole system simultaneously. Capturing both types of dynamics with a low complexity model remains a key challenge. To address this, we propose the Spatial-Spectral Fusion Network (SSF-Net), built around a dual-branch Spatial-Spectral Fusion (SSF) block comprising a spatial branch and a spectral branch. The spatial branch employs a multi-directional Mamba, which mitigates its inherent causal, single-direction scanning bias and capture local interactions with reduced directional bias at linear complexity. The spectral branch leverages a Fourier transform with a block-diagonal MLP to efficiently capture global spectral features with reduced parameter count and complexity. The SSF block is embedded in a multiresolution convolutional encoder-decoder, which extracts multi-scale features. We evaluate SSF-Net on a comprehensive PDE benchmark spanning multiple task types and assess its long-horizon stability. Compared with attention-based and convolution-based baselines, SSF-Net achieves lower prediction error with fewer parameters while retaining near-linear asymptotic complexity in the number of spatial tokens.
Spatial-Spectral Fusion (SSF) Block
- Spatial branch: employs a multi-directional Mamba, mitigating inherent causal, single-direction scanning bias and capturing local interactions with reduced directional bias at linear complexity.
- Spectral branch: leverages a Fourier transform with a block-diagonal MLP to efficiently capture global spectral features with reduced parameter count and complexity.
- Architecture integration: the SSF block is embedded in a multiresolution convolutional encoder-decoder to extract multi-scale features.
Evaluation and Results
- Benchmarks: comprehensive PDE benchmark spanning multiple task types; include long-horizon stability assessment.
- Comparisons: against attention-based and convolution-based baselines.
- Findings: SSF-Net achieves lower prediction error with fewer parameters while retaining near-linear asymptotic complexity in the number of spatial tokens.
Summary: SSF-Net, built around a dual-branch SSF block embedded in a multiresolution convolutional encoder-decoder, captures local and global PDE dynamics with reduced directional bias, fewer parameters, and near-linear asymptotic complexity, outperforming attention-based and convolution-based baselines on a multi-task PDE benchmark while maintaining long-horizon stability.