Makeup Lamps: Live Augmentation of Human Faces via Projection
We propose the first system for live dynamic augmentation of human faces. Using projector-based illumination, we alter the appearance of human performers during novel performances. The key challenge of live augmentation is latency — an image is generated according to a specific pose, but is displayed on a different facial configuration by the time it is projected. Therefore, our system aims at reducing latency during every step of the process, from capture, through processing, to projection. Using infrared illumination, an optically and computationally aligned high-speed camera detects facial orientation as well as expression. The estimated expression blendshapes are mapped onto a lower dimensional space, and the facial motion and non-rigid deformation are estimated, smoothed and predicted through adaptive Kalman filtering. Finally, the desired appearance is generated interpolating precomputed offset textures according to time, global position, and expression. We have evaluated our system through an optimized CPU and GPU prototype, and demonstrated successful low latency augmentation for different performers and performances with varying facial play and motion speed. In contrast to existing methods, the presented system is the first method which fully supports dynamic facial projection mapping without the requirement of any physical tracking markers and incorporates facial expressions.
Link to publication page:
1 view
343
99
6 months ago 00:00:12 1
¿Cómo utilizar el láser para hacer el interruptor de movimiento manual WS08CR-S4-WW para espejo LED?
6 months ago 00:04:16 1
Conton Candy - もっと [Official Video]
6 months ago 00:04:48 1
Kovacs & Till Lindemann - Child Of Sin (Official Video)
6 months ago 00:05:49 1
De Staat - KITTY KITTY (Official Video)
6 months ago 00:03:57 1
Tom Odell - I Know (Official Video)
7 months ago 00:05:32 1
Luciano Pavarotti & Lucio Dalla - Caruso
7 months ago 00:05:18 1
Как круто сфотографировать макияж? Что выбрать визажисту: кольцевую лампу или видеосвет?
7 months ago 00:13:02 1
How to Quickly Improve Kpop Dance Skills | Top 5 Tips for Beginners/Self-taught | Learn Kpop at Home
7 months ago 00:13:43 1
Demi Crochet Lace Sleeves Part 1 of 3 Easy for Beginners with Charts
7 months ago 00:04:56 1
Sagan cover - Nightwish (MoonSun)
7 months ago 00:04:26 1
Eva - Nightwish Cover (MoonSun)
7 months ago 00:04:37 1
Last Ride of the Day - Nightwish cover (MoonSun)
7 months ago 00:04:55 1
Alpenglow - Nightwish Cover (MoonSun)
7 months ago 00:04:47 1
Élan Cover - Nightwish (MoonSun)
7 months ago 00:04:29 1
MoonSun - Dark Chest of Wonders Nightwish cover
7 months ago 00:04:07 1
Nemo - Nightwish Cover (MoonSun)
7 months ago 00:04:11 1
Sleeping Sun cover - Nightwish (by MoonSun)
7 months ago 00:04:29 1
Ever Dream Cover - Nightwish (MoonSun)
7 months ago 00:05:16 1
LUCIO DALLA @ CARUSO
7 months ago 00:03:12 9
Rectum Raiders - Satisfaction (Benny Benassi Metal Cover)
7 months ago 00:04:27 1
The Bardcall - Van Canto cover by MoonSun
7 months ago 00:03:51 1
Makeup Lamps: Live Augmentation of Human Faces via Projection
7 months ago 00:03:21 1
Meltt - Within You, Within Me (Official Video)
8 months ago 00:09:03 1
Как правильно и красиво снимать макияж с использованием видеосвета Yongnuo YN 300 YN160 III.