The Next Frontier: Computer Vision on 3D Data - with Or Litany, Sr. Research Scientist, Nvidia
Listen now
Description
Gil Elbaz hosts Or Litany, a senior research scientist at Nvidia. They discuss the impact of 3D on computer vision and where it’s going in the near future. As well, they talk about the impact of industry on academia and vice versa. Or speaks about the future of 3D generative models, NeRF and how multi-modal models are changing computer vision. Together, Gil and Or explore the best ways to succeed in the field of AI. TOPICS & TIMESTAMPS [0:34] Intro [2:01] Starting his journey  [5:03] Heat transfer equation in graphics  [10:21] Multimodal changing Computer Vision  [17:47] Why is 3D Important? [23:17] 3D Generative Models in the next years [26:25] Neural Rendering [29:39] Connection between images/video & 3D [31:39] Temporal Data  [33:45] Autonomous Driving & Simulation [36:27] Prof Leonidas Guibas  [41:56] NeRF & Editing 3D information  [46:02] Manipulation of 3D representations [52:23]  Future of NeRF [1:02:31] Google  [1:06:03] Meta [FAIR] experience [1:09:57] Nvidia  [1:10:58] Sanya Fidler [1:16:38] Consciousness  [1:21:31] Career Tips for Computer Vision Engineers Or Litany: LinkedIn Google Scholar Github Interesting links: Alex Bronstein Angel Chang Sanja Fidler Leonidas Guibas Judy Hoffman Justin Johnson Fei-Fei Li Ameesh Makadia Manolis Saava Srinath Sridhar Charles Ruizhongtai Qi PointNet Red-Black Tree Nvidia Two minute papers The Three Body Problem  EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks   GUEST BIO Our guest is Or Litany. Or Litany currently works as a senior research scientist at Nvidia. He earned his BSC in physics and mathematics from Hebrew University and his master's degree from the Technion. After that, he went on to do his PhD at Tel Aviv University, where he worked on analyzing 3D data with graph neural networks under professor Alex Bronstein. For his postdoc, Or attended Stanford University studying under the legendary professor Leonidas Guibas, as well as working as part of FAIR, the research group of Meta, where he pushed the cutting edge of 3D data analysis. Or is an extremely accomplished researcher with research that focuses on 3D deep learning for scene understanding, point cloud analysis and shape analysis. In 2023, Or will be joining the Technion as an assistant professor. ABOUT THE HOST I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain
More Episodes
ABSTRACTOur guest this episode is Glenn Jocher, CEO and founder of Ultralytics, the company that brought you YOLO v5 and v8. Gil and Glenn discuss how to build an open-source community on Github, the history of YOLO and even particle physics. They also talk about the progress of AI, diffusion and...
Published 04/16/23
ABSTRACT Gil Elbaz speaks with Tadas Baltrusaitis, who recently released the seminal paper DigiFace 1M: 1 Million Digital Face Images for Face Recognition. Tadas is a true believer in synthetic data and shares his deep knowledge of the subject along with  insights on the current state of the...
Published 01/04/23