Understanding behaviors in videos through behavior-specific dictionaries

Research output: Working paperPreprintResearch

Standard

Understanding behaviors in videos through behavior-specific dictionaries. / Ren, Huamin; Liu, Weifeng; Olsen, Søren Ingvor; Escalera, Sergio; Moeslund, Thomas B.

Researchgate.net, 2020.

Research output: Working paperPreprintResearch

Harvard

Ren, H, Liu, W, Olsen, SI, Escalera, S & Moeslund, TB 2020 'Understanding behaviors in videos through behavior-specific dictionaries' Researchgate.net. https://doi.org/10.13140/RG.2.2.14147.02089

APA

Ren, H., Liu, W., Olsen, S. I., Escalera, S., & Moeslund, T. B. (2020). Understanding behaviors in videos through behavior-specific dictionaries. Researchgate.net. https://doi.org/10.13140/RG.2.2.14147.02089

Vancouver

Ren H, Liu W, Olsen SI, Escalera S, Moeslund TB. Understanding behaviors in videos through behavior-specific dictionaries. Researchgate.net. 2020. https://doi.org/10.13140/RG.2.2.14147.02089

Author

Ren, Huamin ; Liu, Weifeng ; Olsen, Søren Ingvor ; Escalera, Sergio ; Moeslund, Thomas B. / Understanding behaviors in videos through behavior-specific dictionaries. Researchgate.net, 2020.

Bibtex

@techreport{873e42e62b1d4ba892646cc83f4c9737,
title = "Understanding behaviors in videos through behavior-specific dictionaries",
abstract = "Understanding behaviors is the core of video content analysis, which is highlyrelated to two important applications: abnormal event detection and action recognition. Dictionary learning, as one of the mid-level representations, is animportant step to process a video. It has achieved state-of-the-art performancein both applications, and gained more and more attention since its success.Despite the progress of dictionary learning for these two applications, a dictionary built for one task is hard to apply on the other, which not only hampers the applicability of the algorithm, but also fails to meet scalability needs: A dictionary aimed at an abnormality detection purpose may misdetect normal behavior, which rarely happens in training datasets even though it may be very common in daily life. In contrast, a dictionary aimed at action recognition may misclassify a newcoming action category as an existing action. Therefore, our Behavior-Specific Dictionaries (BSDs) are constructed to solve these two applications through a unified framework. To the best of our knowledge, this is the first generalized dictionary algorithm that successfully handle with action recognition and abnormality detection. For abnormality detection, our BSD algorithm outperforms the state-of-the-art methods on the UCSD dataset using strict pixel-level evaluation by 10% AUC promotion. On the AAU Anomaly Stairs Dataset, we achieve a state-of-the-art average true positive rate, while obtaining the lowest average false positive rate. On action recognition, our BSD algorithm outperforms state-of-the-art on the UCF YouTube Action dataset. Furthermore, we achieve competitive results on the UCF50 dataset.",
author = "Huamin Ren and Weifeng Liu and Olsen, {S{\o}ren Ingvor} and Sergio Escalera and Moeslund, {Thomas B.}",
year = "2020",
doi = "10.13140/RG.2.2.14147.02089",
language = "English",
publisher = "Researchgate.net",
type = "WorkingPaper",
institution = "Researchgate.net",

}

RIS

TY - UNPB

T1 - Understanding behaviors in videos through behavior-specific dictionaries

AU - Ren, Huamin

AU - Liu, Weifeng

AU - Olsen, Søren Ingvor

AU - Escalera, Sergio

AU - Moeslund, Thomas B.

PY - 2020

Y1 - 2020

N2 - Understanding behaviors is the core of video content analysis, which is highlyrelated to two important applications: abnormal event detection and action recognition. Dictionary learning, as one of the mid-level representations, is animportant step to process a video. It has achieved state-of-the-art performancein both applications, and gained more and more attention since its success.Despite the progress of dictionary learning for these two applications, a dictionary built for one task is hard to apply on the other, which not only hampers the applicability of the algorithm, but also fails to meet scalability needs: A dictionary aimed at an abnormality detection purpose may misdetect normal behavior, which rarely happens in training datasets even though it may be very common in daily life. In contrast, a dictionary aimed at action recognition may misclassify a newcoming action category as an existing action. Therefore, our Behavior-Specific Dictionaries (BSDs) are constructed to solve these two applications through a unified framework. To the best of our knowledge, this is the first generalized dictionary algorithm that successfully handle with action recognition and abnormality detection. For abnormality detection, our BSD algorithm outperforms the state-of-the-art methods on the UCSD dataset using strict pixel-level evaluation by 10% AUC promotion. On the AAU Anomaly Stairs Dataset, we achieve a state-of-the-art average true positive rate, while obtaining the lowest average false positive rate. On action recognition, our BSD algorithm outperforms state-of-the-art on the UCF YouTube Action dataset. Furthermore, we achieve competitive results on the UCF50 dataset.

AB - Understanding behaviors is the core of video content analysis, which is highlyrelated to two important applications: abnormal event detection and action recognition. Dictionary learning, as one of the mid-level representations, is animportant step to process a video. It has achieved state-of-the-art performancein both applications, and gained more and more attention since its success.Despite the progress of dictionary learning for these two applications, a dictionary built for one task is hard to apply on the other, which not only hampers the applicability of the algorithm, but also fails to meet scalability needs: A dictionary aimed at an abnormality detection purpose may misdetect normal behavior, which rarely happens in training datasets even though it may be very common in daily life. In contrast, a dictionary aimed at action recognition may misclassify a newcoming action category as an existing action. Therefore, our Behavior-Specific Dictionaries (BSDs) are constructed to solve these two applications through a unified framework. To the best of our knowledge, this is the first generalized dictionary algorithm that successfully handle with action recognition and abnormality detection. For abnormality detection, our BSD algorithm outperforms the state-of-the-art methods on the UCSD dataset using strict pixel-level evaluation by 10% AUC promotion. On the AAU Anomaly Stairs Dataset, we achieve a state-of-the-art average true positive rate, while obtaining the lowest average false positive rate. On action recognition, our BSD algorithm outperforms state-of-the-art on the UCF YouTube Action dataset. Furthermore, we achieve competitive results on the UCF50 dataset.

U2 - 10.13140/RG.2.2.14147.02089

DO - 10.13140/RG.2.2.14147.02089

M3 - Preprint

BT - Understanding behaviors in videos through behavior-specific dictionaries

PB - Researchgate.net

ER -

ID: 287075204