Model-based 3D Hand Tracking with on-line Shape Adaptation

Alexandros Makris and Antonis Argyros

Abstract

One of the shortcomings of the existing model-based 3D hand tracking methods is the fact that they consider a fixed hand model, i.e. one with fixed shape parameters. In this work we propose an online model-based method that tackles jointly the hand pose tracking and the hand shape estimation problems. The hand pose is estimated using a hierarchical particle filter. The hand shape is estimated by fitting the shape model parameters over the observations in a frame history. The candidate shapes required by the fitting framework are obtained by optimizing the shape parameters independently in each frame. Extensive experiments demonstrate that the proposed method tracks the pose of the hand and estimates its shape parameters accurately, even under heavy noise and inaccurate shape initialization.

Session

Poster 1

Files

PDF iconExtended Abstract (PDF, 447K)
PDF iconPaper (PDF, 802K)
ZIP iconSupplemental Materials (ZIP, 5M)

DOI

10.5244/C.29.77
https://dx.doi.org/10.5244/C.29.77

Citation

Alexandros Makris and Antonis Argyros. Model-based 3D Hand Tracking with on-line Shape Adaptation. In Xianghua Xie, Mark W. Jones, and Gary K. L. Tam, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 77.1-77.12. BMVA Press, September 2015.

Bibtex

@inproceedings{BMVC2015_77,
	title={Model-based 3D Hand Tracking with on-line Shape Adaptation},
	author={Alexandros Makris and Antonis Argyros},
	year={2015},
	month={September},
	pages={77.1-77.12},
	articleno={77},
	numpages={12},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.77},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.77}
}