Every day technologies are opening space in each field and photography is no exception, now you can transform a photo into 3d scene with this new Nvidia tool, its name is Instant NeRF.
Nvidia’s AI model is pretty impressive: a tool that quickly turns a collection of 2D snapshots into a 3D scene.
The tool is called Instant NeRF, referring to “neural radiance fields”.
Today, AI researchers are working on the opposite: turning a collection of still images into a digital 3D scene in a matter of seconds.
What Is a NeRF?
NeRFs use neural networks to represent and render realistic 3D scenes based on an input collection of 2D images.
Collecting data to feed a NeRF is a bit like being a red carpet photographer trying to capture a celebrity’s outfit from every angle
the neural network requires a few dozen images taken from multiple positions around the scene, as well as the camera position of each of those shots.
If there’s too much motion during the 2D image capture process, the AI-generated 3D scene will be blurry.
The technology could be used to train robots and self-driving cars to understand the size and shape of real-world
objects by capturing 2D images or video footage of them.
environments that creators can modify and build on.
Beyond NeRFs, NVIDIA researchers are exploring how this input encoding technique might be used to accelerate multiple AI challenges
including reinforcement learning, language translation and general-purpose deep learning algorithms.
Image principal taking of channel youtube NVIDIA Developer