A software for camera-projector interaction was developed by Juan Roldan, Ushakiran Soutapalli, Julien Faucher, and Jan Wedekind at the Microsystem & Machine Vision Laboratory (MMVL) at Sheffield Hallam University, UK.
The software makes use of a low cost off-the shelf webcam that is calibrated against a standard projector screen (note that at the moment the new video for linux standard version 2 (V4L2) is not supported yet). The webcam is used to determine the position of physical pointer (e.g. a pen) which is then used to virtually move the X11 pointer. Point-and-click functionality has also been implemented.
The wizard allows you to take a reference picture showing the pointer. You then have to select the region in the image for generating a reference histogram. If you are using a projector, make sure that the desktop has a bright background. Otherwise the pointer will be illuminated differently and it will not be recognized any more.
Donnie Bhayangkara has built a package of mando-1.6 for openSuSE 10.3 which can be downloaded here:
For a video see
Mando now has a new project page at Sourceforge:
New releases at: http://sourceforge.net/project/showfiles.php?group_id=220882
Git access: git clone git://mando.git.sourceforge.net/gitroot/mando mando
Discussion Forum: http://sourceforge.net/forum/?group_id=220882