Felix Lee HPC I 28102013 Realtime Live Panoramic Video OMNICAM realtime acquisition warping amp stitching blending and rendering of 6 HD video streams one panoramic video of 7k x 2k ID: 540086
Download Presentation The PPT/PDF document "Format-agnostic Approach for Production,..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media
Felix Lee
HPC I
28.10.2013Slide2
Real-time Live Panoramic VideoOMNICAM
real-time acquisition
warping & stitching
blending and rendering of 6 HD video streamsone panoramic video of 7k x 2k resolutionon a single PC exploiting GPU processingSlide3
Scene Acquisition (1)
OMNICAM
ARRI Alexa
HD Broadcast cameraSlide4
Scene Acquisition (2)
Soundfield®
Stereo pair
Gun mics
Eigenmike®Slide5
FootballPremier League GameChelsea FC – Wolverhampton Wanderers (London, October 2010)
Dance Performance
Carmen Suite
Berlin Philharmonic Orchestra conducted by Sir Simon Rattle & Dance Compagnie Sasha Waltz (Berlin, May 2012)ConcertBBC Proms (London, August 2012)
Three Demo Productions (so far)Slide6
Saliency Map
Center-surround model
inspired from biological models of human visual sensory system
Center-surround featuresPixel intensity
Color chromatic opponents RG and BY
Saliency map for still images
Slide7
Saliency Detection
Image pyramid based saliency map
Create image pyramid: blur and shrink the image
Build the image differences
Add the image differencesSlide8
Spatio-temporal Saliency
Histograms
Spatiotemporal saliency model
Split image into grid cells (cell size: e.g. 20x20 pixels for HD)
Compute histogram of pyramid differences for each cell
Compare histograms
Current histogram vs. average of histograms from past second
Distance function: earth mover distance
Region of interest (ROI)
Convert high salient regions into rectangles
Application: automatic view selection
Demo video