Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution

S. McCarthy

doi:10.1117/12.2043090

25 February 2014 Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution

S. McCarthy

Author Affiliations +

Proceedings Volume 9014, Human Vision and Electronic Imaging XIX; 90140O (2014) https://doi.org/10.1117/12.2043090
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

This paper describes the theory and application of a perceptually-inspired video processing technology that was recently incorporated into professional video encoders now being used by major cable, IPTV, satellite, and internet video service providers. We will present data that show that this perceptual video processing (PVP) technology can improve video compression efficiency by up to 50% for MPEG-2, H.264, and High Efficiency Video Coding (HEVC). The PVP technology described in this paper works by forming predicted eye-tracking attractor maps that indicate how likely it might be that a free viewing person would look at particular area of an image or video. We will introduce in this paper the novel model and supporting theory used to calculate the eye-tracking attractor maps. We will show how the underlying perceptual model was inspired by electrophysiological studies of the vertebrate retina, and will explain how the model incorporates statistical expectations about natural scenes as well as a novel method for predicting error in signal estimation tasks. Finally, we will describe how the eye-tracking attractor maps are created in real time and used to modify video prior to encoding so that it is more compressible but not noticeably different than the original unmodified video.

Citation Download Citation

S. McCarthy "Theory and practice of perceptual video processing in broadcast encoders for cable, IPTV, satellite, and internet distribution", Proc. SPIE 9014, Human Vision and Electronic Imaging XIX, 90140O (25 February 2014); https://doi.org/10.1117/12.2043090

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available