Informace o publikaci

Benchmarking Search and Annotation in Continuous Human Skeleton Sequences

Autoři

SEDMIDUBSKÝ Jan ELIÁŠ Petr ZEZULA Pavel

Druh Článek ve sborníku
Konference International Conference on Multimedia Retrieval (ICMR)
Fakulta / Pracoviště MU

Fakulta informatiky

Citace
Doi http://dx.doi.org/10.1145/3323873.3325013
Klíčová slova motion capture dataset;continuous 3D skeleton sequence;stream-based processing;benchmark;subsequence search;action detection;mining
Popis Motion capture data are digital representations of human movements in form of 3D trajectories of multiple body joints. To understand the captured motions, similarity-based processing and deep learning have already proved to be effective, especially in classifying pre-segmented actions. However, in real-world scenarios motion data are typically captured as long continuous sequences, without explicit knowledge of semantic partitioning. To make such unsegmented data accessible and reusable as required by many applications, there is a strong requirement to analyze, search, annotate and mine them automatically. However, there is currently an absence of datasets and benchmarks to test and compare the capabilities of the developed techniques for continuous motion data processing. In this paper, we introduce a new large-scale LSMB19 dataset consisting of two 3D skeleton sequences of a total length of 54.5 hours. We also define a benchmark on two important multimedia retrieval operations: subsequence search and annotation. Additionally, we exemplify the usability of the benchmark by establishing baseline results for these operations.
Související projekty: