Elite-Weighted Supervised Fine-tuning for Goal-Directed Molecular Optimization
为解决分子生成器优化问题,提出Elite-Weighted Supervised Fine-tuning方法,通过奖励选择高分分子并用预训练损失更新模型。
为解决分子生成器优化问题,提出Elite-Weighted Supervised Fine-tuning方法,通过奖励选择高分分子并用预训练损失更新模型。
针对时空图数据删除问题,提出IsleNet方法,通过空间熵引导的分区创建子图并用虚拟边连接,实现高效准确的数据移除。
为解决时空图中数据删除难题,提出CallosumNet框架,通过重建子图虚拟边和轻量级元图集成层恢复依赖关系,实现高效数据删除。
This work proposes Pretrained Embedding Distance (PED), a general and tuning-free molecular similarity metric that leverages distances in the embedding space of pretrained molecular models. Traditional similarity measures often rely on handcrafted features or incur high computational costs, while existing deep learning approaches typically require task-specific supervision or large amounts of labeled data, limiting their generalizability. In contrast, PED eliminates the need for both manual feature engineering and task-specific fine-tuning. It effectively ranks active compounds in virtual screening and successfully guides goal-directed molecular generation. Experimental results demonstrate that PED exhibits strong correlation with conventional similarity metrics across multiple tasks, while offering superior scalability and practical utility.
To address the challenge that single-reward signals in foundation model fine-tuning struggle to balance multiple, often conflicting, optimization objectives, this paper proposes MR-ITF—a Multi-Reward Iterative Tuning Framework grounded in reinforcement learning. MR-ITF jointly models heterogeneous structured reward signals (e.g., text fluency, bioactivity, molecular properties), dynamically coordinating gradient updates across objectives in each iteration, and provides theoretical convergence analysis and characterization of training dynamics. Unlike existing RLHF approaches, MR-ITF eliminates the need for manual reward weighting or scalarization, naturally supporting diverse, non-commensurable rewards. Empirically, it achieves state-of-the-art performance across three distinct generative tasks—text generation, protein sequence design, and small-molecule generation—demonstrating superior Pareto-front coverage in multi-objective evaluation and competitive or better single-objective performance. These results validate MR-ITF’s dual advantages in generation quality and objective balancing.
为解决分子生成器优化问题,提出Elite-Weighted Supervised Fine-tuning方法,通过奖励选择高分分子并用预训练损失更新模型。
针对时空图数据删除问题,提出IsleNet方法,通过空间熵引导的分区创建子图并用虚拟边连接,实现高效准确的数据移除。
为解决时空图中数据删除难题,提出CallosumNet框架,通过重建子图虚拟边和轻量级元图集成层恢复依赖关系,实现高效数据删除。
This work proposes Pretrained Embedding Distance (PED), a general and tuning-free molecular similarity metric that leverages distances in the embedding space of pretrained molecular models. Traditional similarity measures often rely on handcrafted features or incur high computational costs, while existing deep learning approaches typically require task-specific supervision or large amounts of labeled data, limiting their generalizability. In contrast, PED eliminates the need for both manual feature engineering and task-specific fine-tuning. It effectively ranks active compounds in virtual screening and successfully guides goal-directed molecular generation. Experimental results demonstrate that PED exhibits strong correlation with conventional similarity metrics across multiple tasks, while offering superior scalability and practical utility.
To address the challenge that single-reward signals in foundation model fine-tuning struggle to balance multiple, often conflicting, optimization objectives, this paper proposes MR-ITF—a Multi-Reward Iterative Tuning Framework grounded in reinforcement learning. MR-ITF jointly models heterogeneous structured reward signals (e.g., text fluency, bioactivity, molecular properties), dynamically coordinating gradient updates across objectives in each iteration, and provides theoretical convergence analysis and characterization of training dynamics. Unlike existing RLHF approaches, MR-ITF eliminates the need for manual reward weighting or scalarization, naturally supporting diverse, non-commensurable rewards. Empirically, it achieves state-of-the-art performance across three distinct generative tasks—text generation, protein sequence design, and small-molecule generation—demonstrating superior Pareto-front coverage in multi-objective evaluation and competitive or better single-objective performance. These results validate MR-ITF’s dual advantages in generation quality and objective balancing.