پروژه 24

عنوان مقاله فارسی: نشانگر مبتنی بر اینترنت - حرکت کم‌تر در صحنه‌های بیرونی و درونی ثبت می‌شود.

عنوان مقاله لاتین: MARCOnI—ConvNet-Based MARker-Less Motion Capture in Outdoor and Indoor Scenes

نویسندگان: A. Elhayek; E. de Aguiar; A. Jain; J. Thompson; L. Pishchulin; M. Andriluka; C. Bregler; B. Schiele; C. Theobalt

تعداد صفحات: 13

سال انتشار: 2017

زبان: لاتین

Abstract:

Marker-less motion capture has seen great progress, but most state-of-the-art approaches fail to reliably track articulated human body motion with a very low number of cameras, let alone when applied in outdoor scenes with general background. In this paper, we propose a method for accurate marker-less capture of articulated skeleton motion of several subjects in general scenes, indoors and outdoors, even from input filmed with as few as two cameras. The new algorithm combines the strengths of a discriminative image-based joint detection method with a model-based generative motion tracking algorithm through an unified pose optimization energy. The discriminative part-based pose detection method is implemented using Convolutional Networks (ConvNet) and estimates unary potentials for each joint of a kinematic skeleton model. These unary potentials serve as the basis of a probabilistic extraction of pose constraints for tracking by using weighted sampling from a pose posterior that is guided by the model. In the final energy, we combine these constraints with an appearance-based model-to-image similarity term. Poses can be computed very efficiently using iterative local optimization, since joint detection with a trained ConvNet is fast, and since our formulation yields a combined pose estimation energy with analytic derivatives. In combination, this enables to track full articulated joint angles at state-of-the-art accuracy and temporal stability with a very low number of cameras. Our method is efficient and lends itself to implementation on parallel computing hardware, such as GPUs. We test our method extensively and show its advantages over related work on many indoor and outdoor data sets captured by ourselves, as well as data sets made available to the community by other research labs. The availability of good evaluation data sets is paramount for scientific progress, and many existing test data sets focus on controlled indoor settings, do not feature much variety i...