Force-Aware Policy for Contact-Rich Interactions
Augment robotic policy observation spaces with wrist force-torque sensor readings and modify reward functions to support contact-rich tasks.
Time
Compute level
Resources
What the paper used
Prerequisites
Scope
The Gap
The current policy reward function optimizes kinematic pose error d(o_t, g) exclusively. The authors note the policy is 'environment-blind' and cannot guarantee functional completion for high-force tasks like hammering, where force modulation is required.
“While our approach can track tool-use goal sequences, it does not guarantee functional task completion, especially for high-force interactions.”
Limitation
The policy treats moving a tool through free space the same as applying force to a surface. It lacks impedance control or force-awareness, leading to potential bounces, inadequate pressure, or instability during forceful contact.
Proposed Solution
Augment the observation space to include wrist force-torque sensor readings and modify the reward function to include force-tracking objectives. Enhance the procedural generation in simulation to include 'resistance tasks' (e.g., sliding against high-friction surfaces) to train the policy to maintain specific contact forces while tracking poses.
Why This Matters
Transforms the system from a 'pose shower' to a true 'tool user,' enabling tasks like scrubbing, cutting, or writing where contact force is the primary success metric.
How to Get Started
How to test it: Hypothesis: Augmenting observations with wrist force-torque data and adding force-tracking reward terms will stabilize forceful contact tasks. Baseline: Standard pose-tracking policy without force feedback. Metric: Force-tracking error (N) and task completion rate on surface contact tasks. Stopping criteria: Stable force regulation within +/- 2N without surface bounce or dropping contact.
- Configure a physics simulator such as Isaac Gym or Mujoco to include realistic force-torque sensor noise and tactile feedback.
- Design procedural generation tasks that require maintaining contact resistance, such as sliding objects against high-friction surfaces.
- Modify the policy reward function to incorporate a force-tracking objective alongside the standard kinematic pose error.
- Train and evaluate the force-aware policy on physical hardware equipped with a wrist force-torque sensor.
Code linked to this paper on Hugging Face: github.com/tylerlum/simtoolreal
Suggested by AI. Adapt it to your setup.
Has This Been Done?
Safe Learning for Contact-Rich Robot Tasks: A Survey From Classical Learning-Based Methods to Safe Foundation Models and Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning discuss contact-rich tasks, force awareness, and robot learning broadly. However, they do not specifically explore the proposed combination of force-tracking objectives, resistance tasks in procedural simulation, and wrist force-torque sensor augmentation as outlined in the proposal.
- Safe Learning for Contact-Rich Robot Tasks: A Survey From Classical Learning-Based Methods to Safe Foundation Models · 2025 · 15 citations
- Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning · 2026 · 5 citations
We searched OpenAlex for “Augment robotic policy observation spaces with wrist force-torque sensor readings and modify reward functions to support contact-rich tasks.” and “Force-Aware Policy for Contact-Rich Interactions” and an AI compared the idea with the top 6 results. A small search can miss relevant work.
Source Paper
SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool ManipulationKushal Kedia, Tyler Ga Wei Lum, Jeannette Bohg +1 more · 2026
This paper presents SimToolReal, a framework for achieving zero-shot dexterous tool manipulation in the real world using a single Reinforcement Learning policy trained entirely in simulation. By training on procedurally generated "primitive" objects (simple combinations of handles and heads) to track random goal poses, the policy generalizes to diverse real-world tools and tasks (like hammering or sweeping) by conditioning on a coarse geometric abstraction rather than visual appearance.
Related Ideas
- Action-Conditioned Counterfactual Synthesis for Embodied Physical PlanningV-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations🟠Medium
- Bimanual and Multi-Fingered Compliant Harness for Cooperative ManipulationForceHarness: Turning Force into Action and Physics for Frozen Frontier Models🟠Medium
- High-Dimensional Articulated Control in Latent World ModelsWorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling🔴Hard
- Automated Synthesis of Force Primitives and Physics Estimators via Code GenerationForceHarness: Turning Force into Action and Physics for Frozen Frontier Models🟠Medium
- Dual-Rate Hierarchical Control with Closed-Loop Residual Correction for Contact-Rich Bimanual ManipulationScaleVLA: Scaling Vision-Language-Action Models to 552 Billion Parameters🔴Hard