报告题目：Street View Interpolation and Navigation
报告人： Hanqiu Sun（Associate Professor, The Chinese University of Hong Kong）
Wide-baseline street image interpolation is useful but very challenging. Existing approaches either rely on heavyweight 3D reconstruction or computationally intensive deep networks. We present a lightweight and efficient method which uses simple homography computing and refining operators to estimate piecewise smooth homographies between input views. To achieve the goal, we show how to combine homography fitting and homography propagation together based on reliable and unreliable superpixel discrimination. Such a combination, other than using homography fitting only, dramatically increases the accuracy and robustness of the estimated homographies. We then integrate the concepts of homography and mesh warping, and propose a novel homography constrained warping formulation which enforces smoothness between neighboring homographies by utilizing the first-order continuity of the warped mesh. This further eliminates small artifacts of overlapping, stretching, etc. The proposed method is lightweight and flexible, allows wide-baseline interpolation. It improves the state of the art, and demonstrates that homography computation suffices for street-view interpolation and navigation. Experiments on city and rural datasets validate the efficiency and effectiveness of our method.
Prof. Sun received M.S. in electrical engineering from University of British Columbia, and Ph.D. in computer science from University of Alberta, Canada. Prof. Sun has published more than hundred technical papers refereed in VR/CG journals and international conferences, including MIT Journal of PRESENCE, Journal of Virtual Reality, IEEE Transactions on Visualization and Computer Graphics, Computers & Graphics, IEEE Journal of Computer Graphics and Applications, Journal of Computer Graphics Forum, IEEE Transactions on SMC, ACM Siggraph Asia, Computational Geometry, IEEE Transactions on Information Technology, Journal of Algorithms, Computer Animation and Virtual Worlds, Journal of Visual Languages and Computing, Journal of Applied Mathematics, The Visual Computer, refereed book chapters and international conferences. She has served as guest editors of MIT PRESENCE, Journal of CAVW and IJIG, program co-chair of ACM VRST, organization co-chair of Pacific Graphics, CGI, director of advanced workshop on VR. Her current research interests include virtual reality, interactive graphics/animation, real-time hypermedia, mobile image/video synopsis, computer-assisted surgery, Haptics and dynamics simulations.