Grasp Recognition and Manipulation with the Tango

International Symposium on Experimental Robotics - July 2006
We describe an interface that uses a graspable device called the Tango, which looks like a ball but measures contact pressures on its surface at 256 tactual elements (taxels) at a high rate (100 Hz). The acceleration of the device is also measured. The key idea is to use this information to recognize the shape and movement of the user's hand grasping the object, with the vision that such a system would make it much easier to program interaction with 3D objects. We describe a new rotationally invariant algorithm for recognizing hand configuration, by using examples of previous interaction collected with motion capture. The recognition method is sufficiently fast for interactive manipulation. We also describe examples of 3D interaction using our system, in which the user interacts with 3D virtual objects using a hand avatar. Using this interface, the user can grasp an object, rotate it in 3D, transport it to a different location, and place it, with the ease and simplicity approaching that of handling a simple mouse. In the future, such tangible interfaces could be used for programming robots by demonstration or for model-based telerobotics.

Images and movies


BibTex references

  author       = "Kry, Paul and Pai, Dinesh",
  title        = "Grasp Recognition and Manipulation with the Tango",
  booktitle    = "International Symposium on Experimental Robotics",
  month        = "July",
  year         = "2006",
  url          = ""

Other publications in the database

» Paul Kry : in lab LJK base , in team EVASION base
» Dinesh Pai : in lab LJK base , in team EVASION base