Rotoscoping & Masking

Green screen is wonderful when you can plan for it, but plenty of shots can't be — you're on a real location, you didn't have a screen, or you need to isolate something that was filmed in the wild. That's what rotoscoping solves. Rotoscoping is manually drawing a mask around a subject and animating that mask so it follows the subject through the shot, effectively cutting it out of its background by hand instead of by key. Want to put an actor filmed on the street in front of a new sky, place a graphic behind a moving person, or apply an effect to only one object in the frame? Roto is how. It has a reputation as tedious grunt work — and honestly, that reputation is earned; it's the closest VFX gets to manual labor. But it's also completely learnable, requires no special footage, and gives you total control, which makes it one of the most useful skills in your kit. The goal isn't to avoid roto; it's to do it efficiently.

How rotoscoping actually works

The workflow, and the tricks that make it bearable:

• Draw a spline mask. Trace the outline of your subject with a bezier/spline shape on one frame. Use as few points as you can get away with — more points means more to adjust on every frame.
• Break it into parts. Don't roto a whole person with one shape. Separate shapes for the head, torso, each arm — because parts that move independently are far easier to animate separately than as one writhing outline.
• Keyframe on twos or threes. You rarely need to adjust the mask on every single frame. Set the shape on every second or third frame and let it interpolate between, then only fix the frames that drift.
• Let tracking help. Attach your mask to a motion track (from last chapter) so it follows the gross movement automatically, and you only hand-correct the deformation. This can cut roto time dramatically.
• Feather for motion blur. Real moving edges are soft and blurred. A crisp, hard roto edge looks cut-out; feather the mask and match the natural motion blur so it blends.

Working smart, not just hard

The difference between a beginner who dreads roto and a pro who dispatches it quickly isn't willpower — it's strategy about what to roto and how. First, avoid it when you can: a well-planned green screen, a clean plate, or a locked shot often removes the need entirely, which is one more reason the on-set discipline from earlier chapters pays off. When you must roto, be ruthless about scope — do you need the whole figure, or just the edge where it overlaps something? Roto only what the shot actually requires; a partial mask is a fraction of the work. Use the machine where you can: modern tools increasingly offer AI-assisted or auto-roto features that get you a rough matte to clean up rather than starting from a blank frame, and even a rough automatic start can save an hour of tracing. And manage your energy — roto is fatiguing, and tired roto is sloppy roto, so break long shots into chunks and take breaks, because a clean mask done in three focused sittings beats a wobbly one done in a single exhausted marathon. Above all, keep perspective on quality versus time: a background that's soft or briefly on screen needs far less precision than a hero shot the audience stares at, so spend your roto hours where the eye will actually land. Rotoscoping will never be the fun part of VFX, but it's the skill that means nothing is impossible — no green screen, no problem, because you can always cut it out by hand. That completes the core craft; from here the course moves into putting these skills to work on specific effects, starting with one of the most impressive things you can do on a budget: extending your set into a whole world.