post
Compositing human eyes onto puppet faces
After Effects compositing
Definition
Composited human eyes is a stop-motion visual-effects technique in which a live actor's own eyes are filmed separately and digitally composited, frame by frame, onto an already-animated puppet's face, so the character's gaze carries a level of subtlety -- focus, micro-movement, a genuine emotional read -- that hand-animated puppet eyes cannot reproduce on their own. It is a post-production craft, not a puppet-fabrication one: the puppet is built, animated and shot as normal, and the human performance is added afterward as a separate, precisely tracked layer.
Overview
Madame Tutli-Putli (Clyde Henry Productions / National Film Board of Canada, 2007, directed by Chris Lavis and Maciek Szczerbowski) is the technique's defining documented case. Portrait painter Jason Walker, working with the production, filmed actress Laurie Maher performing only the character's eye and eyebrow movements after the puppet's full-body performance had already been animated and shot on set, on a roughly 15-inch silicone-and-wire puppet at 24 frames per second, with no CGI used anywhere in the finished shots.
The central difficulty was spatial rather than photographic. Walker explained that "the eyes not only need to be orientated at the correct angle but they need to transition from one orientation to the next at the right time," and that both eyes had to converge on the same point in space for the gaze to read as a single, believable act of looking. To solve it, he built a colour-coded timeline system nicknamed the "Wunderbar" that decoded each puppet head's frame-by-frame orientation, then used it to choreograph, rehearse and time Maher's live-action eye performance so it would match the puppet's movement precisely.
Once the eye footage was shot, Walker selected individual frames from among multiple takes, then positioned, painted, re-timed and composited them onto the puppet's face in Adobe After Effects -- matching not just the puppet's head angle but the lighting and shadow passes established on the physical set, and the puppet, camera and (in several key shots) train's residual motion. The National Film Board's own retrospective coverage of the film describes the resulting making-of interview as a four-part masterclass in exactly this process. The technique is specific to post-production craft: it changes nothing about how the puppet itself is built or animated, and depends entirely on treating the live-action eye plates as a separate performance layer synchronized after the fact.
The technique sits alongside rig removal and CG face-replacement systems such as the UV-ink tracking used on The Girl Who Cried Pearls as one of several distinct answers to the same problem: a puppet face's expressive range is mechanically limited, and different productions close that gap at different points in the pipeline -- fabrication, animation, or here, compositing. Because only one production has published its method at this level of detail, this page treats composited human eyes as Madame Tutli-Putli's own bespoke solution rather than a standardized industry technique; a second sourced example would strengthen that claim considerably.
Workflow
- 1. Animate and shoot the puppet's full-body performance first, on the normal stop-motion stage, with no allowance yet made for the eyes.
- 2. Analyse the shot puppet footage frame by frame to chart each head's changing orientation -- Walker's project used a dedicated colour-coded timeline (the "Wunderbar") for this step.
- 3. Cast and film a live actor performing only eye and eyebrow movement, choreographed and timed against that orientation chart so the human gaze matches the puppet's head angle at every frame.
- 4. Shoot multiple takes of the eye performance to allow selection later, since not every take reads correctly once composited.
- 5. Select, position, colour-match, re-time and composite the chosen eye frames onto the puppet's face frame by frame, matching the set's lighting and shadow passes and any residual camera or rig motion, in a compositing package (After Effects on Madame Tutli-Putli).