Lantern Slides: Camera and slide test within an environment of scanned objects. (Unity3D)
We are crossing a technological boundary. The 3D scanning technique known as photogrammetry is becoming increasingly accessible. Utilising (many,many) photographs to create high resolution 3D meshes via specialised software and services. I have noticed its use with increased frequency in larger productions over the past year. It is also seems to be gaining popularity among smaller independent game developers and 3D artists.
youtube Cyberpunk 2077
The static character in the CyberPunk 2077 trailer though reworked, augmented and relit, is essentially the original scan that originated from a studio like Infinite Realities. Taking that model to the next level of an animated character is a considerable amount of specialist toil. As the grim but well realised Witcher trailer shows, what works well as a still can resist a photorealistic transformation to full-motion. Photogrammetry at this moment is suited to the representation of static worlds. Which makes it seem like an ideal solution for environment objects, props, statues, terrain and so on.
youtube The Witcher 3 : Wild Hunt
This will most likely get some media attention. The new easy-CG-wizard-magic that will once again nerf the labour value of 3D artists everywhere is here. Modellers should watch out this time. Just as motion capture scattered the aspirations of thousands of trained animators like a torrent of reflective ping pong balls over a capture studios floor. Of course It turns out that didn’t happen, in fact it broadened the capability of animators. These technologies always augment our skill-sets and have many applications as a method to each project’s needs.
Get Even -
What does the interested artist require? Enough photography experience to ensure you are capturing usable images. A half-decent camera and lens, though any modern dSLR will do. Time to explore the world looking for suitable subjects in suitable lighting. Time to process the resulting photographs for processing and time to let the software create the model. Then repeat as you learn what works and what does not.
Source photographs for a tree. No twigs or branches creating noise. A low-frequency detailed shape in soft light so will scan very well. Though the background will require masking out. (Adobe Lightroom)
http://www.agisoft.ru/products/photoscan - Agisoft PhotoScan. Very powerful photogrammetry software. Excellent results. I am currently learning this for use on Lantern Slides.
What is suitable for scanning? Rougher surfaces with a lack of specular highlights. A shape or volume of low or medium frequency detail, and all in diffuse or consistent lighting. No glass! Metal can be risky as the shifting highlights and reflections confuse the image matching stage. Windows can resolve to curious looking portals that contain their reflections. If you need to scan that shiny object, consider if you are wiling to spray paint it to a matte & mottled finish. Then re-create the material in the renderer.
Tree stump object, material and lighting test.
Once the hours of processing are complete photogrammetry doesn’t directly give you anything you can use in a realtime renderer. The raw mesh is too dense and the textures too wasteful. Best to think of it as a replacement for that high resolution sculpting stage, there is the usual amount of optimisation work to do. The mesh needs a low-polygon UV unwrapped counterpart. The diffuse, specular and normal textures are still to be baked out and edited. The odd hole or artefact in mesh or texture patched up. Then the satisfying work begins. Import these objects into your art package or game engine of choice and with the careful application of materials, lights and special FX begin to make them part of your world.
Creation of diffuse, specular and normal maps from a photo source.
A realtime 3D ready facade of an old building. (Blender)
Lantern Slides: terrain and scanned object landscape lighting test. (Unity3D)
Lantern Slides’ object testing environment. Checking materials created using Marmoset Skyshop. (Unity3D)