New Way To Create A Selfie By Using Deep Learning 3D Technique

                                Researchers from the University of Nottingham and Kingston University developed easy method for reconstructing the 3D depth information from a single 2D facial image. This method, which works on any 2D face, is the first step in generating 3D selfies.We can this in your smart phones. 

We heard previously the idea of 3d image  — constructing the 3D model of your face. Sure, one can use Microsoft Kinect’s 3D depth sensor to scan the face and construct a 3D model out of it. But the problem that the computer scientists of University of Nottingham and Kingston University tried  to reconstruct the 3D image from a single 2D input image. 

For example, when we take selfies, the 3D depth information of our face is lost; In Black and White photography, both the depth and colour information are lost; In out-of-focus/blurred images

Researchers, named  Aaron Jackson, a PhD student from the University of Nottingham, have developed a new kind of Convolutional Neural Network(CNN) called as Volumetric Regression Network(VRN). VRN essentially maps   each facial feature from the 2D image to a 3D vertex.

They trained this mode with a dataset of over 60,000 2D-3D image pairs so that the model learns to map the common facial features, and therefore works on any given input face. This is an important breakthrough, especially for VR and AR applications.

As is the norm of Deep Learning research, the authors have open sourced their code in Github.  Remember in the above image  how Barack Obama’s face was 3D scanned using 50 custom LED lights and 8 GoPro cameras? This research can make it with a few snapshots of his face from his public appearances.

Also Read : 12 Android Oreo Hidden Features You Can Try