Every day technologies are opening space in each field and photography is no exception, now you can transform a photo into 3d scene with this new Nvidia tool, its name is Instant NeRF.

Nvidia’s AI model is pretty impressive: a tool that quickly turns a collection of 2D snapshots into a 3D scene.

The tool is called Instant NeRF, referring to “neural radiance fields”.

When the first instant photo was taken 75 years ago with a Polaroid camera, it was groundbreaking to rapidly capture the 3D world in a realistic 2D image.

Today, AI researchers are working on the opposite: turning a collection of still images into a digital 3D scene in a matter of seconds.

Taking form Nvidia video of youtube
Image from youtube channel of Nvidia

What Is a NeRF?

NeRFs use neural networks to represent and render realistic 3D scenes based on an input collection of 2D images.

Collecting data to feed a NeRF is a bit like being a red carpet photographer trying to capture a celebrity’s outfit from every angle

the neural network requires a few dozen images taken from multiple positions around the scene, as well as the camera position of each of those shots.

In a scene that includes people or other moving elements, the quicker these shots are captured, the better.

If there’s too much motion during the 2D image capture process, the AI-generated 3D scene will be blurry.

The technology could be used to train robots and self-driving cars to understand the size and shape of real-world

objects by capturing 2D images or video footage of them.

car with ai with tecnology 3d scene
Image from Instagram @nvidia
It could also be used in architecture and entertainment to rapidly generate digital representations of real

environments that creators can modify and build on.

Beyond NeRFs, NVIDIA researchers are exploring how this input encoding technique might be used to accelerate multiple AI challenges

including reinforcement learning, language translation and general-purpose deep learning algorithms.

Image principal taking of channel youtube NVIDIA Developer

Tap to Call