Temporal super resolution using variational methods
Publikation: Bidrag til bog/antologi/rapport › Bidrag til bog/antologi › Forskning › fagfællebedømt
Standard
Temporal super resolution using variational methods. / Keller, Sune Høgild; Lauze, Francois Bernard; Nielsen, Mads.
High-quality visual experience: creation, processing and interactivity of high-resolution and high-dimensional video signals. red. / Marta Mrak; Mislav Grgic; Murat Kunt. Bind Part III Springer, 2010. s. 275-296 (Signals and Communication Technology).Publikation: Bidrag til bog/antologi/rapport › Bidrag til bog/antologi › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - CHAP
T1 - Temporal super resolution using variational methods
AU - Keller, Sune Høgild
AU - Lauze, Francois Bernard
AU - Nielsen, Mads
PY - 2010
Y1 - 2010
N2 - Temporal super resolution (TSR) is the ability to convert video from one frame rate to another and is as such a key functionality in modern video processing systems. A higher frame rate than what is recorded is desired for high frame rate displays, for super slow-motion, and for video/film format conversion (where also lower frame rates than recorded is sometimes required). We discuss and detail the requirements imposed by the human visual system (HVS) on TSR algorithms, of which the need for (apparent) fluid motion, also known as the phi-effect, is the principal one. This problem is typically observed when watching video on large and bright displays where the motion of high contrast edges often seem jerky and unnatural. A novel motion compensated (MC) TSR algorithm using variational methods for both optical flow calculation and the actual new frame interpolation is presented. The flow and intensities are calculated simultaneously in a multiresolution setting. A frame doubling version of our algorithm is implemented and in testing it, we focus on making the motion of high contrast edges to seem smooth and thus reestablish the illusion of motion pictures.
AB - Temporal super resolution (TSR) is the ability to convert video from one frame rate to another and is as such a key functionality in modern video processing systems. A higher frame rate than what is recorded is desired for high frame rate displays, for super slow-motion, and for video/film format conversion (where also lower frame rates than recorded is sometimes required). We discuss and detail the requirements imposed by the human visual system (HVS) on TSR algorithms, of which the need for (apparent) fluid motion, also known as the phi-effect, is the principal one. This problem is typically observed when watching video on large and bright displays where the motion of high contrast edges often seem jerky and unnatural. A novel motion compensated (MC) TSR algorithm using variational methods for both optical flow calculation and the actual new frame interpolation is presented. The flow and intensities are calculated simultaneously in a multiresolution setting. A frame doubling version of our algorithm is implemented and in testing it, we focus on making the motion of high contrast edges to seem smooth and thus reestablish the illusion of motion pictures.
U2 - 10.1007/978-3-642-12802-8_11
DO - 10.1007/978-3-642-12802-8_11
M3 - Book chapter
SN - 978-3-642-12801-1
VL - Part III
T3 - Signals and Communication Technology
SP - 275
EP - 296
BT - High-quality visual experience
A2 - Mrak, Marta
A2 - Grgic, Mislav
A2 - Kunt, Murat
PB - Springer
ER -
ID: 19663130