The Next Frontier: Computer Vision on 3D Data - with Or Litany, Sr. Research Scientist, NVIDIA Unboxing AI: The Podcast for Computer Vision Engineers

Gil Elbaz hosts Or Litany, a senior research scientist at NVIDIA. They discuss the impact of 3D on computer vision and where it’s going in the near future. As well, they talk about the impact of industry on academia and vice versa. Or speaks about the future of 3D generative models, NeRF and how multi-modal models are changing computer vision. Together, Gil and Or explore the best ways to succeed in the field of AI.

TOPICS & TIMESTAMPS

[0:34] Intro

[2:01] Starting his journey 

[5:03] Heat transfer equation in graphics 

[10:21] Multimodal changing Computer Vision 

[17:47] Why is 3D Important?

[23:17] 3D Generative Models in the next years

[26:25] Neural Rendering

[29:39] Connection between images/video & 3D

[31:39] Temporal Data 

[33:45] Autonomous Driving & Simulation

[36:27] Prof Leonidas Guibas 

[41:56] NeRF & Editing 3D information 

[46:02] Manipulation of 3D representations

[52:23]  Future of NeRF

[1:02:31] Google 

[1:06:03] Meta [FAIR] experience

[1:09:57] Nvidia 

[1:10:58] Sanya Fidler

[1:16:38] Consciousness 

[1:21:31] Career Tips for Computer Vision Engineers

Or Litany:

LinkedIn

Google Scholar

Github

Interesting links:

Alex Bronstein

Angel Chang

Sanja Fidler

Leonidas Guibas

Judy Hoffman

Justin Johnson

Fei-Fei Li

Ameesh Makadia

Manolis Saava

Srinath Sridhar

Charles Ruizhongtai Qi

PointNet

Red-Black Tree

Nvidia

Two minute papers

The Three Body Problem 

EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks  



GUEST BIO

Our guest is Or Litany. Or Litany currently works as a senior research scientist at Nvidia. He earned his BSC in physics and mathematics from Hebrew University and his master's degree from the Technion. After that, he went on to do his PhD at Tel Aviv University, where he worked on analyzing 3D data with graph neural networks under professor Alex Bronstein. For his postdoc, Or attended Stanford University studying under the legendary professor Leonidas Guibas, as well as working as part of FAIR, the research group of Meta, where he pushed the cutting edge of 3D data analysis. Or is an extremely accomplished researcher with research that focuses on 3D deep learning for scene understanding, point cloud analysis and shape analysis. In 2023, Or will be joining the Technion as an assistant professor.

ABOUT THE HOST

I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain