360 video stabilization: A new algorithm for smoother 360 video viewing
360 video is rapidly becoming more widespread. There are dozens of devices for capturing 360 video, from professional rigs to consumer handheld cameras, all with different specs and quality outputs. As these types of cameras become more prevalent, the range and volume of 360 content are also expanding, with people shooting 360 video in a variety of situations and environments. It’s not always easy to keep the camera steady and avoid shaking, particularly when filming motion (like a mountain bike ride or a walking tour) with a handheld camera. To help solve this, Facebook developed a new stabilization technology custom-designed for 360 video. In this talk, we explain the tech behind our new approach, including the new “deformed-rotation” motion model and a new hybrid 3D-2D technique for optimizing the model parameters to make shaky 360 videos incredibly smooth.