Tag
36 items · newest first

manipulation

Hands, grippers, tactile sensing and the policies that use them.

#
18 Sep

Robotic lab sets up and runs optics experiments on demand (5 minute read)

MIT researchers have built a reconfigurable robotic optics laboratory: a seven-jointed arm picks up lenses and mirrors held in QR-coded 3D-printed housings with magnetic bases, while a Wi-Fi fine-adjustment tool turns their knobs. In a demonstration it assembled a functional tabletop laser cavity through 50 autonomous maneuvers within 30 minutes, and readjusted components to maintain the laser's intensity when parts were moved. The team presents the system at IROS this month.

— news.mit.edumanipulation
#
17 Sep

ForwardDLO: Model-Based Bimanual Shape Matching of Unconstrained Deformable Linear Objects (paper · 15 minute read)

ForwardDLO, a recurrent latent dynamics model for two arms reshaping an unfixated rope, predicts per-segment displacements, making batched evaluation cheap. Its open-loop error on real rope motion is 13% below the strongest baseline, and in a fixed time budget it scores 8 to 22 times more candidate actions than comparably accurate models. On a simulated routing task at 30Hz, that yields 98% success versus at most 30% for baselines.

— cs.RO updates on arXiv.orgmanipulation
#
15 Sep

Does Scaling Web-Video Pre-Training Help Real Robots Do Real Work? (13 minute read)

Larger pre-trained video models consistently yield better robot policies, and the trend still holds at the largest size tested, the authors report from a scaling study of Direct Video-Action models pre-trained on web video. More pre-training compute improves policies at every amount of robot data tested, with the largest gains when robot data is scarce. The findings rest on over 200 hours of real-robot evaluation on an industrial bearing-unpacking task.

— rhoda.aimanipulation
#
14 Sep

FoldNet++: a Large-Scale Synthetic Dataset for Robotic T-Shirt Folding and Unfolding (paper · 15 minute read)

FoldNet++ spans 6 robotic embodiments, 1K T-shirts, 1K environmental assets and 120K episodes with rich annotations. It generates physically simulatable T-shirts with annotated semantic keypoints, from which a unified rule-based framework produces demonstrations for each embodiment. The authors report that visuomotor policies trained solely on this synthetic data achieve over 90% end-to-end task success when deployed directly to unseen real-world environments and previously unseen T-shirts.

— cs.RO updates on arXiv.orgdatasets-benchmarksmanipulation
#
8 Sep

AgiBot says GE-Act 2.0 keeps improving as its training data scales 100× (6 minute read)

GE-Act 2.0 trains every parameter from random initialisation on embodied manipulation data, rather than adding action prediction to a pretrained video generator. AgiBot reports that scaling the corpus from 300 to 30,000 hours lifted zero-shot success on its G1-OP evaluation from 17.1% to 44.1%, and the number of tasks with any success from 39 to 76, with towel-folding and pen-recapping appearing only at the larger scales. It says performance had not saturated at 30,000 hours.

#
7 Sep

ContextFlow: In-Context Flow Matching for Robot Manipulation (paper · 15 minute read)

ContextFlow learns robot manipulation from demonstrations held in context, using conditional flow matching rather than the next-token prediction that discretises actions and compounds early errors. Perceiver-style compressors distil visual, proprioceptive and action sequences into compact latents, so several demonstrations can be carried at once. On LIBERO it beats ICRT by 35 percentage points on unseen task configurations and matches a fine-tuned π0 without any fine-tuning of its own.

— arXivmanipulation
#
4 Sep

SmoothRL: Efficient Online RL with Asynchronous Execution (video · 3 min)

Astribot's SmoothRL runs online reinforcement learning while the robot keeps moving, learning from the actions actually executed in the world. The company reports dynamic tossing rising from 39% to 94%, pen capping from 8% to 83% and box opening from 30% to 90%. Astribot calls it the first reinforcement learning validated on real-world, high-dynamic tossing, and has published uncut footage alongside a technical report.

— Astribotmanipulation
#
4 Sep

GPT-6 Astra on robot arms (4 minute read)

A follow-up to an earlier test of Claude Fable 5 and 5.1 gives OpenAI's GPT-6 Astra control of the same YAM arms under the same agent policy. Astra placed a block in a bowl in 19 of 20 trials, against 8 for Fable 5.1 and 1 for Fable 5, in 2.5 minutes a trial and at about $0.94 a run. On a puzzle-piece insertion it matched Fable 5.1's 2 successes in 20, stalling at the same final step.

— openai.robocurve.orgmanipulationvla-foundation-models
#
2 Sep

Innovation at Agility: Digit Redecorates (video · 3 min)

Agility's Digit rearranges a full room of objects, each a different size, weight and grip. The company presents this as the same generalised manipulation Digit uses for mixed loads and changing layouts on a real warehouse floor. It is posted as a short video demonstration, with no new hardware and no customer deployment attached.

#
20 Aug

Keeping the Franka Emika Panda alive: a ROS 2 stack with a reliable position interface (paper · 15 minute read)

The Franka Emika Panda's external position interface has been unreliable for years, and this paper traces the vibrations and protective stops to the timing of the external control loop and sampling jitter rather than to the robot. The open-source stack decouples real-time communication from the ROS 2 control loop and adds rate matching and position-domain reference generation. It is validated across motion planning, compliance control, position-controlled manipulation and haptic teleoperation, on two independent Panda platforms.

#
17 Aug

LimX Dynamics' TRON 2 patrols an underground utility tunnel on its own (video · 3 min)

LimX Dynamics' TRON 2, fitted with an autonomous mobile manipulation kit, maps and patrols underground utility tunnels, adjusting its posture to reach inspection points at different heights. It detects anomalies, performs light tasks and returns to its charging dock on its own for long unattended shifts. LimX presents the deployment as evidence that partners can build embodied AI applications for city infrastructure and industrial inspection on the platform.

— LimX Dynamics Korealocomotionmanipulation
#
14 Aug

DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation (paper · 15 minute read)

DreamX-Phi 1.0 predicts the frames that follow a prescribed sequence of end-effector poses and gripper states, with per-arm geometric encoding so each arm follows its commanded path, and a depth branch and object masks to keep the scene consistent. It took first place on Track 1 and second on Track 2 of the WorldArena 2.0 Challenge; the model and code are to be released.

#
13 Aug

Northrop’s robot space mechanic is a new way to keep satellites at work longer (3 minute read)

Northrop Grumman's Mission Extension Vehicle has undocked from an Optus communications satellite after more than a year holding it in position. Four replacement spacecraft launched in July, among them a Mission Robotic Vehicle carrying two robotic arms. The Mission Robotic Vehicle's two arms were developed by DARPA; the other three craft are Mission Extension Pods, smaller modular units.

— Robotics News | TechCrunchhardwaremanipulation
#
12 Aug

DecisionFacts publishes a sample of its SO-101 arm teleoperation data (dataset · 1 minute read)

Data vendor DecisionFacts has published an evaluation sample of its SO-101 arm teleoperation data: human-teleoperated manipulation episodes filmed from two cameras at 30 fps, with joint states and actions in LeRobot v3.0 format, and failure and recovery episodes labelled alongside the successes. The sample is licensed CC BY-NC 4.0 for research only; the full catalogue is licensed separately.

#
11 Aug

Flex-π: A Multi-Stream World-Action Model with Compute Flexibility (paper · 15 minute read)

Flex-π, a 6B-parameter world-action model, is supervised on 3D pointmaps and DINO semantics as well as RGB, all encoded by the same frozen video VAE, and one checkpoint runs on any subset of those streams. The authors report gains of up to 2–7x over the strongest baselines on real bimanual tasks, running faster than π0.5.

#
11 Aug

TLabel – A unified annotation format and converter for tactile robotics datasets (tool · 3 minute read)

TLabel is a cross-sensor annotation schema for tactile manipulation data, producing 14-dimensional semantic annotations that different sensor types can all emit. Each adapter declares which dimensions it can and cannot annotate, so results from different tactile sensors become comparable rather than sensor-specific. Compliance levels L1 to L4 let each sensor participate at whatever information density it can actually support.

#
11 Aug

Robot Recycler Salvages Parts From Broken Machines (4 minute read)

Researchers at the Karlsruhe Institute of Technology have built a system that predicts the defect in a broken product and disassembles it while protecting the valuable parts. With more than 4 million industrial robots in use worldwide and over 16 million forecast by 2030, the article argues the industry should prepare to dismantle, recycle and rebuild what it makes.

— IEEE Spectrummanipulationhardware
#
11 Aug

RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance (paper · 15 minute read)

RynnValue is an open-source value model for robot manipulation trained on temporal distance to the goal, which timestamps supply for free, over more than 7,000 hours of clips. It beats the preference-supervised state of the art on RBM-EVAL-OOD, 0.675 to 0.655, and as a dense reward lifts real-world policy success from 52.5% to 72.5% online.

#
10 Aug

A ‘5-in-1’ seed-sized surgical robot (4 minute read)

A team at Nanyang Technological University built a 4.4 mm magnetically controlled robot that performs five surgical functions — moving, cutting tissue, releasing drugs, gripping samples and generating heat — and switches between them in under a second. The work is published in Advanced Materials. Led by Associate Professor Lum Guo Zhan, the robot deploys a blade to cut tissue or emits heat to a target area, relevant to the heat-based cancer treatments under study.

#
7 Aug

Video to Data: NVIDIA's robot dexterity task library and dataset (dataset · 1 minute read)

NVIDIA has released 1,215 human manipulation demonstrations from the TACO dataset, retargeted to bimanual Sharpa hands, with 121,500 robot episodes generated from them by its Video to Data pipeline. The 924.8 GB set, in Parquet and LeRobot v3 format under CC-BY-4.0, is meant to show what the pipeline outputs and to let users try its grounding step or downstream training.

#
4 Aug

Beyond VLAs: How World Action Models Reshape Robot Manipulation (5 minute read)

NVIDIA argues that a vision-language backbone learns to describe the world rather than predict how it evolves, which is exactly what a robot needs when a task depends on anticipating change. The post sets out world action models as the replacement for that backbone. NVIDIA researcher Jim Fan set out the shift in his Robotics' End Game talk, later condensed to the line that VLAs are dead.

— Robotics – NVIDIA Technical Blogvla-foundation-modelsworld-modelsmanipulation
#
4 Aug

CaryX AI releases 116 annotated episodes of everyday two-handed tasks (dataset · 1 minute read)

CaryX AI has released 116 episodes of five people doing ten household tasks, recorded with an iPhone Pro's LiDAR, with metric depth, camera pose, MANO hand pose, per-hand object contact, masks and time-aligned language on every frame. It comes in LeRobot v3.0 format under a non-commercial CC-BY-NC-SA-4.0 licence, built for method development rather than broad generalisation claims.

#
4 Aug

Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data (paper · 15 minute read)

Ego2Robot turns egocentric videos of people handling objects into robot training data by retargeting their actions, rendering robot arms into the footage and filtering for quality: 18,561 hours across 15 robot morphologies, which the authors call the largest such dataset. Pretraining on it alongside robot data improved out-of-distribution generalisation, including on real robots.

#
3 Aug

Sharpa's Wave hand served as verification hardware for Gemini Robotics 2 (2 minute read)

Sharpa's Wave dexterous hand, mounted on Apptronik's Apollo 2, served as verification hardware for Google DeepMind's Gemini Robotics 2. The demonstration covered multi-finger tasks including tying trash bags, unscrewing light bulbs and sealing resealable bags. Gemini Robotics 2 extends control from the upper body to the whole humanoid, feet to fingertips, and in a recorded demo guided Apollo across a room to shelve a watering can while avoiding obstacles.

#
3 Aug

Demystifying When and Why VLAs Fail in Contact-Rich Tasks and How to Fix Them (paper · 15 minute read)

The authors trace the failures of vision-language-action models in contact-rich manipulation to two causes: precision failures, from a mismatch in how flow-matching policies are trained, and force failures, from the structure of force signals. FACT combines a targeted fix for each and reaches a 66% average success rate on five contact-rich tasks, against 41% for the best prior baseline, over almost 2,500 real-world rollouts.