Sequence-Informed Geometric Evaluation of RNA 3D Structures
为解决RNA三维结构评估问题,提出SIRGE方法,结合序列信息与几何模型,通过预训练语言模型增强结构评价准确性。
为解决RNA三维结构评估问题,提出SIRGE方法,结合序列信息与几何模型,通过预训练语言模型增强结构评价准确性。
This work addresses the challenge that pre-trained PDE foundation models typically require dense solution data—often unavailable—for effective transfer to unseen systems. To overcome this limitation, the authors propose an unsupervised fine-tuning framework that leverages PDE residuals and boundary conditions to construct a physics-informed objective, enabling efficient adaptation without ground-truth solutions. A key innovation is the introduction of NSLoRA, which incorporates Newton–Schulz orthogonalization into low-rank adaptation (LoRA) to mitigate imbalanced learning of physical quantities inherent in standard LoRA. Experimental results demonstrate that the proposed method achieves performance on par with supervised LoRA fine-tuning across diverse, heterogeneous multidimensional PDE benchmarks, significantly outperforming existing neural operators and PDE foundation models.
为解决RNA三维结构评估问题,提出SIRGE方法,结合序列信息与几何模型,通过预训练语言模型增强结构评价准确性。
This work addresses the challenge that pre-trained PDE foundation models typically require dense solution data—often unavailable—for effective transfer to unseen systems. To overcome this limitation, the authors propose an unsupervised fine-tuning framework that leverages PDE residuals and boundary conditions to construct a physics-informed objective, enabling efficient adaptation without ground-truth solutions. A key innovation is the introduction of NSLoRA, which incorporates Newton–Schulz orthogonalization into low-rank adaptation (LoRA) to mitigate imbalanced learning of physical quantities inherent in standard LoRA. Experimental results demonstrate that the proposed method achieves performance on par with supervised LoRA fine-tuning across diverse, heterogeneous multidimensional PDE benchmarks, significantly outperforming existing neural operators and PDE foundation models.