Google’s ‘Frankenphone’ Helped Gather Training Data for Portrait Mode on the Pixel 3

When it comes to exclusive photographic phones, there is just no competitor near and above of Google Pixel phones. These leading photography series smartphones have introduced a new era of camera technologies such as HDR+, Night Camera, AI Portrait Mode and more to this youth, energetic generation always searching for something more.

As the search engine giant has introduced the new and improved series of Pixel (Pixel 3 & Pixel 3XL) recently, both the flagship smartphones from Google have WOWED users with some drastically new developments to its AI Portrait mode algorithm and the addition of spectacular features such as Super Res Zoom and Night Sight.

Well, Google is not famous to leak its secret juice to others. But, Marc Levoy, one of  Google’s distinguished research lab engineer recently explained in a press release the under wrap detail of these newly introduced technologies and how they get developed. Marc explained – “To produce a perfect AI based realistic blur that can compete with DSLR accurate details such as the zone of depth and sharp focus, we need to train the neural network which is very efficient once it’s up and running. We built a specialised rig or a ‘Frankenphone’ that contains five Pixel 3 phones along with a Wi-Fi-based solution to capture pictures from all of the phones simultaneously. The ‘Frankenphone’ rig helped our engineers to compute high-quality depth from photos using multi-view stereo and structure from motion. The data captured by ‘Frankenphone’ rig has trained the neural network used in Pixel 3 to receive best ever depth dynamic scenes and accurate depth estimation.

Pixel 3
Image credit: Google

Well, we can assure you this much that you don’t need the ‘Frankenphone’ rig to capture picture-perfect portraits as a single Pixel 3 is just enough to capture your best memorable shots.

Show More

David Paterson

David composes books, taking into consideration why you’re reading through this, makes ideal sense. A person better recognized for composing science fiction. He likewise writes non-fiction, regarding topics varying from personalized financing to stargazing. Politics and world news are at the top of that list.

Related Articles