Institution profile

Shanghai Innovation Institution

Academic institutionasia · cn
Research library2linked papers
Opportunities0open roles
Selected work

Representative Papers

LigBench: A Unified and Human-Aligned Benchmark for LLM-based Research Idea Generation

Aug 13, 2026

This work addresses the lack of a unified, objective, and human-aligned evaluation standard for scientific idea generation by large language models. To this end, the authors propose LigBench—an automated, fine-grained evaluation benchmark—and introduce the PAIR-IQ dataset to train pairwise idea judgment models, enabling consistent and interpretable assessment across diverse generation distributions. The framework pioneers a shift from subjective scoring to structured comparative learning, substantially improving alignment with expert judgments. Experimental results demonstrate that LigBench outperforms existing methods in evaluation stability and interpretability, with models trained on PAIR-IQ achieving superior performance in ranking accuracy and robustness.

0 citationsRead paper
Recent publications

Latest Papers

LigBench: A Unified and Human-Aligned Benchmark for LLM-based Research Idea Generation

Aug 13, 2026

This work addresses the lack of a unified, objective, and human-aligned evaluation standard for scientific idea generation by large language models. To this end, the authors propose LigBench—an automated, fine-grained evaluation benchmark—and introduce the PAIR-IQ dataset to train pairwise idea judgment models, enabling consistent and interpretable assessment across diverse generation distributions. The framework pioneers a shift from subjective scoring to structured comparative learning, substantially improving alignment with expert judgments. Experimental results demonstrate that LigBench outperforms existing methods in evaluation stability and interpretability, with models trained on PAIR-IQ achieving superior performance in ranking accuracy and robustness.

0 citationsRead paper