Industrial Light & Magic's Computer Vision Pipeline for Movie Making


jueves febrero 27, 2014 - 07:30:00


Bluewater Tech Talk
1220 Charleston Rd
Mountain View,CA 94043


Ronald Mallet, Chris Bregler, Jeff Saltzman
Industrial Light & Magic


7:30 Networking & Snacks
8:00 Presentation


Mermaids and pirates, the Hulk and Iron Man! This talk will describe the behind-the-scenes technology of ILM\'s match-moving and 3D capture system used in recent movies, including The Avengers, Pirates of the Caribbean, and Battleship, as well as new sub-pixel tracking of entire natural environments in Avatar, Star Trek, and The Lone Ranger to create the latest 3D visual effects.

While Motion Capture is the predominant technology used by film studios, ILM has moved beyond such studio-based technology to do special effects without markers and without multiple high-speed IR cameras. Instead, many scenes are shot on-site, outdoors, and in challenging environments with the benefit of new interactive computer vision techniques.

Ronald and Chris will discuss the research and development of the new ILM system, and Jeff will demonstrate its use in production.


Ronald Mallet is a senior research & development engineer at Industrial Light & Magic, leading the computer vision research area. His work focuses around 3d data extraction from 2d footage, ranging from camera 3d tracking to full body on-set motion capture. Prior to ILM, he was a lead engineer and product manager at Realviz, working on popular products like MatchMover, ImageModeler and Stitcher.

Chris Bregler is working with Lucasfilm\'s Advanced Development Group and with Industrial Light & Magic on new vision based tracking systems. He\'s also a Professor of Computer Science at NYU. Prior to NYU he was on the faculty at Stanford University and worked for several companies including Hewlett Packard, Interval, and Disney Feature Animation. Besides his ILM work, his projects helped doctors analyze movement disorders; detecting terrorists in surveillance videos; and producing the world\'s largest real-time motion capture game, He was the chair for the SIGGRAPH Electronic Theater and Animation Festival in 2004. He has been named Stanford Joyce Faculty Fellow, Terman Fellow, and Sloan Research Fellow. He received the Olympus Prize for achievements in computer vision and pattern recognition and was awarded the IEEE Longuet-Higgins Prize for \"Fundamental Contributions in Computer Vision that have withstood the test of time\". His work has also been featured in mainstream media such as the New York Times, Scientific American, National Geographic, WIRED, Business Week, ABC, CBS, NBC, CNN, and many other outlets.

Jeff Saltzman has worked as an artist at Industrial Light & Magic for the last 16 years, dealing with all manner of camera and 3D tracking issues on over two dozen feature films. Jeff helped to build and deploy ILM\'s proprietary Zeno/Mars computer vision tools, using them to develop new techniques and devices for matchmoving, lens calibration, and stereoscopic imaging. Before ILM, Jeff was technical director at Chimera Digital Imaging (now TurboSquid) in New Orleans and received an engineering degree from Brown University.

More Info

For more information on Movie-Making Pipelines, check out SIGGRAPH University - \"The Digital Production Pipeline\"


Suggested donation of $5 for non-paid members to pay for food.
Memberships are $20 per year or free for students with valid ID.

Event Photos