Skip to content

Research Ideas

Fresh research opportunities generated by AI from trending papers. Click on any idea to explore it in detail.

95 ideas match

Stratified Minute-Scale Rollout Distillation and Self-Resampled Base Stabilization for 60s+ Generation

Extend self-rollout distillation to minute-scale multi-event horizons via stratified late-window supervision and scheduled-sampling base tuning so both base and fast generators remain stable.

MovieRoll: A Systematic Framework for Rolling Out Long-Form Videos
🔴Hard💡Moderate InnovationLarge clusterRelated work found#Generative media#Training

Duration-Conditioned and Shot-Triggered Rolling-Window Pretraining with Finer Chunk Granularity

Condition rolling-window video models on total duration, shot-boundary triggers, and finer chunk steps so long-form generation avoids short-clip pacing bias and handles multi-shot transitions.

MovieRoll: A Systematic Framework for Rolling Out Long-Form Videos
🔴Hard🔬Significant ResearchLarge clusterRelated work found#Generative media#Training

Meta-Recursive Co-Evolution of Improver Stage Instructions and Composition Rules

Co-evolve the meta-prompt rules and composition heuristics using retrospective edit-attribution logs so an agent improves how it edits, not just its stored examples.

Harness^2: Recursive Agent Harnessing for an Open World
🔴Hard🔬Significant ResearchSingle GPU or lessClosely matching work found#Agents#LLMs

Invariant Relational Graph Networks for Cross-Sensor Array Generalization

A relational graph neural network that encodes normalized inter-sensor kinetic ratios to achieve generalization across individual sensor array variations and manufacturing batches.

Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose
🟠Medium💡Moderate InnovationSingle GPU or lessNo close match found#Training#AI for science

Demographic Confounder Disentanglement for Breathomic Diagnostic Biomarkers

A multimodal disentangled representation learning method that isolates genuine volatile metabolic breath signatures from age and sex confounders to eliminate false diagnostic predictive signals.

Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose
🟠Medium🔬Significant ResearchSingle GPU or lessNo close match found#AI for science#Safety & alignment

Adversarial and Continuous Time-Conditioned Adaptation for eNose Sensor Drift

Train domain-adversarial and continuous time-conditioned neural networks to align drifting sensor feature representations across deployment weeks and prevent temporal accuracy degradation.

Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose
🟡Fairly easy💡Moderate InnovationSingle GPU or lessRelated work found#Training#AI for science

Differentiable Relaxation of Written Associative Memories for Few-Shot Fine-Tuning

A differentiable relaxation of discrete hash tables and concept weights that allows gradient descent to fine-tune human-readable written weights on low-data regimes.

Weight-Space Programming Doesn't Need Transformers
🟡Fairly easy💡Moderate InnovationSingle GPU or lessNo close match found#Training#Efficiency

Token-Normalized and Convergence-Controlled Evaluation of VLM Scaling Laws in Robotics

Isolate visual token count, convergence training budgets, and subset-only normalization to measure the true contribution of backbone parameter scale in robotic manipulation policies.

ScaleVLA: Scaling Vision-Language-Action Models to 552 Billion Parameters
🟡Fairly easy🔧Minor TweakLarge clusterNo close match found#Data & evaluation#Robotics

Parameter-Efficient Action Adaptation and Multi-Layer Feature Readout for Frontier VLMs

Adapt frozen frontier vision-language backbones via parameter-efficient fine-tuning and multi-layer feature aggregation to improve robot performance on out-of-distribution objects and contact-rich dexterous assembly.

ScaleVLA: Scaling Vision-Language-Action Models to 552 Billion Parameters
🔴Hard💡Moderate InnovationLarge clusterNo close match found#Robotics#Multimodal

Dynamic Routing and Branch Dropout for Asymmetric Multi-Branch Transformers

Implement dynamic token-level branch routing and branch dropout to allow token-adaptive parallel compute and mitigate runtime imbalances during branch execution.

Multi-Branch Transformer
🟠Medium💡Moderate InnovationMultiple GPUsRelated work found#LLMs#Efficiency

Dual-Axis KV Sharing: Integrating Joint-KV with Cross-Layer and Prefix-Shared Attention

Combine branch-wise KV sharing with cross-layer KV caching to eliminate redundant key-value memory traffic across both network depth and parallel architectural branches.

Multi-Branch Transformer
🟠Medium💡Moderate InnovationMultiple GPUsRelated work found#LLMs#Efficiency

Joint Inter-DP and Intra-Sequence Layout Optimization for Multi-Document Sparse Attention

A method that unifies inter-data-parallel sample dispatch and intra-sequence query-key block folding to balance computational load during long-context sparse attention pretraining.

TeleChat to Xing4: Advancing Frontier Agentic Models on Domestic Chips and Frameworks
🟠Medium💡Moderate InnovationMultiple GPUsRelated work found#Efficiency#Training

Token-Level Importance-Weighted Off-Policy Correction for Asynchronous Agent RL

A method that applies token-level off-policy importance weighting to partial rollout trajectories to avoid discarding entire query groups during asynchronous multi-turn agent reinforcement learning.

TeleChat to Xing4: Advancing Frontier Agentic Models on Domestic Chips and Frameworks
🟠Medium💡Moderate InnovationMultiple GPUsClosely matching work found#Reinforcement learning#Agents

Automated Ablation Study for Component Isolation

A method that systematically decouples and tests individual memory architectural components to isolate their exact performance contributions.

MIRIX-2.0: Multi-Agent Memory System
🟡Fairly easy🔧Minor TweakSingle GPU or lessNo close match found#Data & evaluation#Training

Coordinate-Independent Relative Pose and Scale Representation

A method that replaces absolute coordinate regression with relative graph-based embeddings to eliminate distance-from-origin accumulation errors in long-sequence reconstructions.

Ï€^4: A Foundation Model for 4D Scene Geometry and Motion
🔴Hard🔬Significant ResearchLarge clusterRelated work found#Vision#Training

Controlled Block-Level Comparison of Content-Gated Recurrent Depth Readers

Benchmark recurrent residual readers at block granularity with content-dependent gating and matched heads to isolate when fixed-size memory can rival explicit history attention.

Loopback Transformer: Towards a Unified View of Residual Looped Transformers
🟡Fairly easy💡Moderate InnovationMultiple GPUsRelated work found#Training#Efficiency

Token-Conditioned Input Injection and Adaptive Update Budgets in Loopback Residuals

Replace fixed input weights and static depth queries with lightweight token-conditioned gates so shared layers dynamically balance original inputs and new updates.

Loopback Transformer: Towards a Unified View of Residual Looped Transformers
🟠Medium💡Moderate InnovationMultiple GPUsNo close match found#Training#LLMs

Variable-Visit Training and Depth-Relative Query Routing for Test-Time Loop Scaling

Train parameter-shared transformers with randomized loop counts and depth-relative attention queries so extra inference iterations improve predictions instead of degrading accuracy.

Loopback Transformer: Towards a Unified View of Residual Looped Transformers
🟡Fairly easy💡Moderate InnovationMultiple GPUsRelated work found#Training#Reasoning

Hybrid Sliding-Window and Fixed-State Depth Memory for Deeply Looped Transformers

Compress older layer updates into a fixed-size recurrent state while keeping recent updates explicit to cut memory traffic and latency in parameter-shared transformers.

Loopback Transformer: Towards a Unified View of Residual Looped Transformers
🔴Hard🔬Significant ResearchMultiple GPUsNo close match found#Efficiency#Training

Single-Pass Visual Dependence Estimation to Eliminate Dual-Pass Target Scoring

Estimate token-level visual dependence from a single target forward pass via hidden-state shifts or attention statistics to eliminate the extra no-image scoring pass.

MMFlash: Faster Speculative Decoding for Vision-Language Models
🟡Fairly easy💡Moderate InnovationMultiple GPUsNo close match found#Training#Efficiency

Intra-Block Causal Conditioning and Uncertainty-Triggered Visual Refetching for Visually Grounded Spans

Add lightweight intra-block causal conditioning and uncertainty-triggered visual cross-attention to parallel diffusion drafters so tokens within visually grounded spans condition on earlier predictions.

MMFlash: Faster Speculative Decoding for Vision-Language Models
🔴Hard🔬Significant ResearchMultiple GPUsNo close match found#Multimodal#Efficiency

End-to-End Market Encoder Adaptation via Low-Rank Reinforcement Learning

Fine-tune frozen temporal market foundation models using low-rank adaptation during group-relative reinforcement learning to align market representations directly with portfolio objectives.

AllocFlow: End-to-End Portfolio Trading Action Generation from Raw Market Data
🟠Medium💡Moderate InnovationMultiple GPUsNo close match found#LLMs#Training

Closed-Loop State-Conditioned Flow-Matching Portfolio Policy

Incorporate real-time portfolio state embeddings into the flow-matching velocity network to enable closed-loop, transaction-cost-aware rebalancing.

AllocFlow: End-to-End Portfolio Trading Action Generation from Raw Market Data
🟡Fairly easy💡Moderate InnovationSingle GPU or lessNo close match found#Reinforcement learning#Efficiency

Attention-Guided Temporal Credit Assignment for Segment-Based Online Reinforcement Learning

Replace static exponential discount weights with an attention-based credit assignment mechanism that weights segment advantages using cross-attention attribution scores.

Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agent
🟠Medium💡Moderate InnovationLarge clusterNo close match found#Reinforcement learning#Training