not logged in. (login)


Region-based Deformable Appearance Models


The aim of this project is to develop methods for tracking deforming objects. A mesh model is used to model the object's shape and deformations, and a color texture map is used to model the object's color appearance. Photometric variations are also modeled. Nonrigid shape registration and motion tracking are achieved by posing the problem in terms of an energy-based, robust minimization procedure, which provides robustness to occlusions, wrinkles, shadows, and specular highlights. The algorithms run at frame-rate, and are tailored to take advantage of texture mapping hardware available in many workstations, PC's, and game consoles. The Active Blobs framework is one result of this effort.

Personnel:
  • John Isidoro
  • Marco La Cascia
  • Stan Sclaroff
  • Saratendu Sethi
  • Matheen Siddiqui

  • For more information, see this project's webpage.

    Related Publications

    title year

    Stan Sclaroff and John Isidoro , "Active Blobs: Region Based Deformable Appearance Models," Computer Vision and Image Understanding (CVIU), Vol. 89, pp 197--225, 2003.
    2003

    John Isidoro and Stan Sclaroff , "Stochastic Refinement of the Visual Hull to Satisfy Photometric and Silhouette Consistency Constraints," Proceedings of the International Conference on Computer Vision (ICCV), pp 1335--1342, 2003.
    2003

    John Isidoro and Stan Sclaroff , "Stochastic Mesh-Based Multiview Reconstruction ," Symposium on 3D Data Processing Visualization and Transmission (3DPVT), pp 568-577, 2002.
    2002

    Matheen Siddiqui and Stan Sclaroff , "Surface reconstruction from multiple views using rational B-splines and knot insertion," Symposium on 3D Data Processing Visualization and Transmission (3DPVT), pp 372-378, 2002.
    2002

    Matheen Siddiqui and Stan Sclaroff , "Surface reconstruction from multiple views using rational B-splines," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), No. Technical Sketches, 2001.
    2001

    Jonathan Alon and Stan Sclaroff , "Recursive Estimation of Motion and Planar Structure," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 550-556, 2000.
    2000

    M. La Cascia, S. Sclaroff and V. Athitsos , "Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models," IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 22, No. 4, pp 322-336, 2000.
    2000

    Jonathan Alon and Stan Sclaroff , "Recovery of piece-wise planar and piece-wise rigid models from nonrigid motion," Proc. SPIE, Three-Dimensional Imaging, Optical Metrology, and Inspection V, Vol. 3835, pp 72-83, 1999.
    1999

    Marco La Cascia and Stan Sclaroff , "Fast, reliable head tracking under varying illumination," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. I, pp 604-610, 1999.
    1999

    Marco La Cascia, John Isidoro and Stan Sclaroff , "Head tracking via robust registration in texture map images," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 508-514, 1998.
    1998

    Marco La Cascia, Saratendu Sethi and Stan Sclaroff , "Combining textual and visual cures for content-based image retrieval on the world wide web," Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, pp 24-29, 1998.
    1998

    John Isidoro and Stan Sclaroff , "Active Voodoo Dolls," Proc. IEEE Conf. on Computer Animation, pp 137-143, 1998.
    1998

    S. Sclaroff , "Deformable prototypes for encoding shape categories in image databases," Pattern Recognition, Vol. 30, No. 4, pp 627-642, 1997.
    1997