Grounding AI Ideation: Multi-Objective RLCF for Feasible Scientific Discovery
A method that introduces a multi-objective comparison-based GRPO framework, combining scientific impact with a feasibility reward model trained on retracted and successfully reproduced papers.
Time
Compute level
Resources
What the paper used
Prerequisites
Scope
The Gap
The ideation capability of Scientific Thinker is optimized solely for potential citation impact and evaluated by LLM-as-a-judge. The training objective lacks constraints on the physical, financial, or computational feasibility of the proposed experiments.
“Future work could explore broader formulations of scientific taste such as assessing the feasibility of experimental designs and better recognizing distinctive and diverse research ideas.”
Limitation
Generated ideas, while potentially high-impact in theory, may be experimentally unfeasible or practically impossible to execute in a real-world setting.
Proposed Solution
Implement a multi-objective Comparison-Based GRPO framework. Train an auxiliary reward model specifically on experimental feasibility using a dataset of retracted/failed papers versus successfully reproduced papers. Use a weighted combination of the 'Scientific Judge' (impact) and 'Feasibility Judge' (practicality) to steer the Scientific Thinker.
The paper’s authors list this direction as future work, so they may already be pursuing it.
Why This Matters
Ensures that the AI-generated research proposals are not just theoretically popular but actually executable in real-world labs, bridging the gap between automated ideation and physical execution.
How to Get Started
How to test it: Test the hypothesis that multi-objective Comparison-Based GRPO combining SciJudge with a Feasibility Judge (trained on reproduced vs. retracted/failed papers) yields more executable ideas than single-objective SciThinker-4B/30B without sacrificing impact. Evaluate on the 200 in-domain and 200 out-of-domain 2025 seed papers using LLM-ensemble impact win rates and expert-graded or execution-based feasibility scores, stopping if impact win rate drops significantly without measurable feasibility gains.
- Curate a dataset of retracted or failed research papers versus successfully reproduced and implemented papers to capture feasibility signals.
- Train an auxiliary feasibility reward model using the curated dataset to classify experimental practicality.
- Integrate the feasibility reward alongside the existing scientific impact reward within a Comparison-Based GRPO framework.
- Benchmark the multi-objective ideation system against single-objective baselines for feasibility and novelty.
Code linked to this paper on Hugging Face: github.com/tongjingqi/AI-Can-Learn-Scientific-Taste
Suggested by AI. Adapt it to your setup.
Has This Been Done?
The listed papers discuss agentic browsing and adversarial paper-review dynamics, but none implement a multi-objective Comparison-Based GRPO framework using failed versus reproduced papers to balance impact and feasibility.
We searched OpenAlex for “A method that introduces a multi-objective comparison-based GRPO framework, combining scientific impact with a feasibility reward model trained on retracted and successfully reproduced papers.” and “Grounding AI Ideation: Multi-Objective RLCF for Feasible Scientific Discovery” and an AI compared the idea with the top 2 results. A small search can miss relevant work.
Source Paper
AI Can Learn Scientific TasteJingqi Tong, Mingzhe Li, Hangcheng Li +20 more · 2026
This paper explores whether AI models can develop 'scientific taste' to evaluate and propose high-impact research ideas. The authors propose Reinforcement Learning from Community Feedback (RLCF) to train models using large-scale citation data, successfully creating an AI that generates research proposals with higher potential impact than baseline models.
Related Ideas
- Retrieval-Augmented Soundness Verification Against External LiteraturePaperCritic: Training AI Reviewers to Assess the Soundness of Papers🔴Hard
- Towards Theoretical AI Scientists: Abstracting Empirical Findings into Formal Mathematical FrameworksEvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery🔴Hard
- Constraint-Grounded Feasibility Verifiers for Idea GenerationProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows🟠Medium
- Automated Reproducibility Auditing for AI-Generated Scientific BaselinesEvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery🟡Fairly easy
- Meta-Analytic Agents with Verification-Aware AggregationProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows🟡Fairly easy