Watch Out 2017, Here Comes Facebook
What first looked to be a demonstration of a minor product update– a way to put filters over videos–by Facebook’s chief technology officer Mike Schroepfer at Web Summit, quickly turned to a breakthrough in technology.
The “style transfer” feature allows you to stylize videos to look like Van Gogh paintings. Facebook has managed to add AI into its app, which allows people to add filters to their videos in real-time, meaning that computing tasks that once required large data centers can now be done on the mobile device.
“This is one application of AI on the device, it’s one of the first. But the real breakthrough here is being able to train and build models on a big server…and deploy them directly to your pocket so you can run them in real time wherever you are. That is the exciting future of AI,” Schroepfer said during a keynote speech reported by CNBC.
What makes the stylized videos in the app possible is Caffe2Go, a new “deep-learning” platform. It’s a marriage between two technologies: the Caffe2Go runtime and style transfer models.
“By condensing the size of the AI model used to process images and videos by 100X, we’re able to run various deep neural networks with high efficiency on both iOS and Android.” Facebook wrote in a blog post.
AI developments at Facebook also link to its effort in virtual reality (VR).
“In VR, image and video processing software powered by computer vision is improving immersive experiences and helping to support hardware advances. Earlier this year we announced a new stabilization technology for 360 videos, powered by computer vision. And computer vision software is enabling inside-out tracking to help usher in a whole new category of VR beyond PC and mobile, as we announced at Oculus Connect 3 last month. This will help make it possible to build high-quality, standalone VR headsets that aren’t tethered to a PC,” Schroepfer wrote in a blog post.
You learn more about the Caffe2Go technology here.