not logged in. (login)


Human Pose Estimation


The goal of this effort is to develop algorithms for articulated structure and motion estimation, from one or more video streams. Articulated motion is exhibited by jointed structures like the human body and hands, as well as linkages more generally. In this project, 3D articulated structure and motion estimation algorithms are being developed that can automatically initialize themselves, estimate multiple plausible interpretations along with their likelihood, and provide reliable performance over extended sequences. To achieve these objectives, concepts from machine learning, graphical models, multiple view geometry, and structure from motion are employed. The current research effort is focused in two main areas: (1) 3D articulated pose estimation given video obtained from uncalibrated cameras, (2) statistical learning models that capture the dynamics of articulated motion. This project also investigates detection and segmentation methods for use in localizing the articulated structure in the image.

This work is supported by the National Science Foundation under Grant Nos. 0713168 and 0202067. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

Personnel:
  • Vassilis Athitsos
  • Rui Li
  • Romer Rosales
  • Stan Sclaroff
  • Tai-Peng Tian
  • Quan Yuan


    • Related Publications

    title year

    Rui Li, Tai-Peng Tian, Stan Sclaroff and Ming-Hsuan Yang , "3D Human Motion Tracking with a Coordinated Mixture of Factor Analyzers," International Journal of Computer Vision (IJCV), Vol. (preprint, DOI 10.1007/s11263-009-0283-4), 2009.
    		 2009

    Nazli Ikizler-Cinbis, R. Gokberk Cinbis, Stan Sclaroff , "Learning Actions From The Web," International Conference on Computer Vision (ICCV), 2009.
    		 2009

    Alexandra Stefan , "Indexing Methods For Efficient Multiclass Recognition," BU CS Technical Report, No. 2008-018, 2008.
    		 2008

    Daniel Gutchess, Vitaly Ablavsky, Ashwin Thangali, Stan Sclaroff and Magnus Snorrason , "Video Surveillance of Pedestrians and Vehicles," Proc. SPIE Conf. on Tracking, Pointing, and Laser Systems Technologies XXI, Vol. 6569, 2007.
    		 2007

    Vassilis Athitsos, Alexandra Stefan, Quan Yuan and Stan Sclaroff , "ClassMap: Efficient Multiclass Recognition via Embeddings," International Conference on Computer Vision (ICCV), 2007.
    		 2007

    Rui Li, Tai-Peng Tian and Stan Sclaroff , "Simultaneous Learning of Nonlinear Manifold and Dynamical Models for High-dimensional Time Series," International Conference on Computer Vision (ICCV), 2007.
    		 2007

    Jonathan Alon , "Spatiotemporal Gesture Segmentation," BU CS Technical Report, No. 2006-024, 2006.
    		 2006

    Rui Li,Ming-Hsuan Yang,Stan Sclaroff and Tai-Peng Tian , "Monocular Tracking of 3D Human Motion with a Coordinated Mixture of Factor Analyzers," Proceedings of the European Conference on Computer Vision (ECCV), pp 137-150, 2006.
    		 2006

    Tai-Peng Tian, Rui Li and Stan Sclaroff , "Articulated Pose Estimation in a Learned Smooth Space of Feasible Solutions," Proceedings of IEEE Workshop on Learning in Computer Vision and Pattern Recognition, 2005.
    		 2005

    Kevin Law and Stan Sclaroff , "Foreground Object Segmentation from Binocular Stereo Video," Proc. SPIE Conf., Intelligent Robots and Computer Vision: Algorithms, Techniques, and Active Vision, No. XXIII, pp (to appear), 2005.
    		 2005

    Stan Sclaroff, Margrit Betke, George Kollios, Jonathan Alon, Vassilis Athitsos, Rui Li, John Magee and Tai-peng Tian , "Tracking, Analysis, and Recognition of Human Gestures in Video," Proc. International Conf. on Document Analysis and Retrieval (ICDAR), pp 806-810, 2005.
    		 2005

    Tai-Peng Tian and Stan Sclaroff , "Handsignals Recognition From Video Using 3D Motion Capture Data," Proc. IEEE Workshop on Motion and Video Computing , pp 189-194, 2005.
    		 2005

    Leonid Sigal, Stan Sclaroff and Vassilis Athitsos , "Skin color-based video segmentation under time-varying illumination," IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 26, No. 7, pp 862-877, 2004.
    		 2004

    Vassilis Athitsos, Jonathan Alon, Stan Sclaroff and George Kollios , "BoostMap: A Method for Efficient Approximate Similarity Rankings," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 268-275, 2004.
    		 2004

    Romer Rosales and Stan Sclaroff , "A framework for heading-guided recognition of activity," Computer Vision and Image Understanding (CVIU), Vol. 91, No. 3, pp 335-367, 2003.
    		 2003

    Vassilis Athitsos and Stan Sclaroff , "Database Indexing Methods for 3D Hand Pose Estimation," Proc. of the Gesture Workshop, 2003.
    		 2003

    Vassilis Athitsos and Stan Sclaroff , "Estimating 3D Hand Pose From a Cluttered Image ," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2, pp 432-439, 2003.
    		 2003

    Jonathan Alon, Stan Sclaroff, George Kollios and Vladimir Pavlovic , "Discovering Clusters in Motion Time-Series Data," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 1, pp 375-381, 2003.
    		 2003

    Vassilis Athitsos and Stan Sclaroff , "An Appearance-Based Framework for 3D Hand Shape Classification and Camera Viewpoint Estimation ," Proc. IEEE International Conf. on Automatic Face and Gesture Recogntion (FG), pp 45-50, 2002.
    		 2002

    Romer Rosales and Stan Sclaroff , "Algorithms for inference in specialized maps for recovering 3D hand pose," Proc. IEEE International Conf. on Automatic Face and Gesture Recogntion (FG), pp 143-148, 2002.
    		 2002

    Vassilis Athitsos and Stan Sclaroff , "3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views," Proc. IEEE Workshop on Cues in Communication, 2001.
    		 2001

    Romer Rosales, Matheen Siddiqui , Jonathan Alon and Stan Sclaroff , "Estimating 3D body pose using uncalibrated cameras," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 1, pp 821-827, 2001.
    		 2001

    Romer Rosales, Vassilis Athitsos, Leonid Sigal and Stan Sclaroff , "3D hand pose reconstruction using specialized mappings," Proceedings of the International Conference on Computer Vision (ICCV), Vol. 1, pp 378-385, 2001.
    		 2001

    Romer Rosales and Stan Sclaroff , "Learning body pose via specialized maps," Neural Information Processing Systems (NIPS), Vol. 14, pp 1263-1270, 2001.
    		 2001

    Romer Rosales and Stan Sclaroff , "Learning and synthesizing human body motion and posture," Proc. IEEE International Conf. on Automatic Face and Gesture Recogntion (FG), pp 506-511, 2000.
    		 2000

    Romer Rosales and Stan Sclaroff , "Inferring body pose without tracking body parts," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 506-511, 2000.
    		 2000

    Leonid Sigal, Stan Sclaroff and Vassilis Athitsos , "Estimation and prediction of evolving color distributions for skin segmentation under varying illumination," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 152-159, 2000.
    		 2000

    Romer Rosales and Stan Sclaroff , "Specialized mapping and the estimation of human body pose from a single image," Proc. IEEE Workshop on Human Motion, pp 19-24, 2000.
    		 2000

    Romer Rosales and Stan Sclaroff , "3D trajectory recovery for tracking multiple objects and trajectory gu;ided recognition of actions," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 117-121, 1999.
    		 1999