DexForce leverages contact forces, measured during kinesthetic demonstrations, to compute force-informed actions.

We use DexForce demonstrations to learn policies for6 tasksand evaluate each rollout according to the following criteria:

slide cube

success

failure

reorient smiley

success

partial success

failure

open AirPods

success

partial success

failure

grasp battery

success

partial success

failure

unscrew nut

success

partial success

failure

flip box

success

partial success

failure

Hardware

We instrument an Allegro hand with a wrist-mounted Intel RealSense D435 camera (+ fisheye lens attachment) and two CoinFT six-axis force-torque sensors.

Hardware setup

To re-create our setup:
Fisheye RealSense: We have open-sourced our camera and fisheye lens mounting parts. Get the instructions and partshereand pleasecite usif you find these useful!
CoinFT: The developers of CoinFT plan to release the sensor design soon!

Supplementary video