Skip to content
AI-generated research idea🟡Fairly easy🔧Minor TweakNo close match found

Aligning Cross-Lingual Difficulty: Upgrading English Trajectory Synthesis

Upgrade the English training data generation pipeline with stricter entity obfuscation and larger subgraph sizes to match the high difficulty of the Chinese set.

Time

1 to 2 weeks covering upgraded English QA generation, dual-criteria rejection sampling, denoised trajectory rollouts, a single SFT run, and evaluation.

Compute level

Multiple GPUs

Resources

Access to the ~68GB English web corpus, teacher and summarizer LLM inference compute to synthesize and verify ~10.3k long-horizon English trajectories (averaging ~46+ tool calls and ~76k tokens per sample) with live web search API calls, plus 1 node of 8x H100/H200 (80GB+) GPUs for 256k-context SFT on Qwen3-30B-A3B-Thinking-2507.

What the paper used

Hardware is not stated in the paper; the authors report using ~68GB English and ~9GB Chinese web data to synthesize 11.7k samples (10.3k English, 1.4k Chinese) and running a single SFT trial on Qwen3-30B-A3B-Thinking-2507 (30B total, 3B active parameters) with a 256k context window and max 200 tool calls (evaluating BrowseComp on a 200-sample subset).

Prerequisites

basic ML knowledge

Scope

large-scale data collection

The Gap

In Section 4 Data Statistics Analysis, the authors note that the English dataset has not been updated to the latest QA standards. This results in the English data having lower average token counts and tool calls compared to the more challenging Chinese dataset.

“Due to resource constraints, our English data has not yet been updated to the latest QA standards, resulting in slightly lower difficulty compared to the Chinese data (see Figure 5).”
From the paper, Section 4.2, page 10. Matched against the PDF text.

Limitation

The English training data is artificially less complex than the Chinese data, creating an imbalance in cross-lingual reasoning capabilities and limiting the model's performance optimization on English benchmarks like BrowseComp-EN.

Proposed Solution

Re-run the Fact-Grounded Scalable Controllable QA Synthesis pipeline specifically on the English web corpus using the upgraded difficulty parameters (larger subgraph size and stricter entity obfuscation) applied to the Chinese set. Retrain the model on this aligned, high-difficulty dataset.

The paper’s authors list this direction as future work, so they may already be pursuing it.

Why This Matters

This will harmonize the difficulty across languages and is highly likely to yield immediate, significant improvements on English-language search agent benchmarks, providing a more balanced open-source model.

How to Get Started

How to test it: Hypothesis: re-synthesizing the 10.3k English training trajectories using the upgraded Chinese QA difficulty settings (larger subgraph size k and stricter entity obfuscation) will improve English search reasoning over OpenSeeker-v1-30B-SFT. Measure BrowseComp accuracy, WideSearch-EN item F1, and BrowseComp-ZH accuracy (plus avg tool calls/tokens); stop if the retrained model fails to beat 29.5% on BrowseComp and 59.4% on WideSearch-EN by at least 1.5 points or regresses on BrowseComp-ZH.

  1. Extract the Fact-Grounded Scalable Controllable QA Synthesis generation script from the paper codebase or recreate its logic.
  2. Modify the English text pipeline parameters to enforce larger subgraphs and multi-step reasoning structures.
  3. Synthesize a new English dataset split and verify token count distributions against the Chinese benchmarks.
  4. Fine-tune the model on the newly aligned dataset and evaluate on complex QA tasks.

Code linked to this paper on Hugging Face: github.com/rui-ye/OpenSeeker

Suggested by AI. Adapt it to your setup.

Has This Been Done?

No close match in 10 results

None of the listed papers discuss rerunning a specific Fact-Grounded Scalable Controllable QA Synthesis pipeline on an English web corpus with upgraded difficulty parameters.

We searched OpenAlex and arXiv for “Upgrade the English training data generation pipeline with stricter entity obfuscation and larger subgraph sizes to match the high difficulty of the Chinese set.” and “Aligning Cross-Lingual Difficulty: Upgrading English Trajectory Synthesis” and an AI compared the idea with the top 10 results. A small search can miss relevant work.

Source Paper

OpenSeeker: Democratizing Frontier Search Agents by Fully Open-Sourcing Training Data

Yuwen Du, Rui Ye, Shuo Tang +4 more · 2026

The paper introduces OpenSeeker, the first fully open-source search agent that achieves frontier-level performance comparable to proprietary industrial models. By open-sourcing both the high-quality training data and model weights, it aims to democratize the development of autonomous search agents.

Related Ideas

Is this a good idea?

Share onXLinkedIn