Deep Learning Deep Dive

Deep Learning Deep Dive

4.9(10개의 평가)
과학 기술

Long-form technical deep dives with Andrej Karpathy and Justin Johnson

2021. 03. 04.

Episode #3: DALL-E in depth

The actual paper for DALL-E was released only a few days after we published our episode 2, so in this episode we re-visit DALL-E in its full published glory. Joining us as a special guest for this episode is Aditya Ramesh from OpenAI, the lead author of DALL-E. DALL-E blog post: https://openai.com/blog/dall-e/ DALL-E paper: https://arxiv.org/abs/2102.12092 DALL-E code (encoder/decoder model only, so far): https://github.com/openai/dall-e Deep Learning Deep Dive is also available on YouTube, where we scroll through relevant parts of the paper and code while talking about them: https://www.youtube.com/watch?v=PtdpWC7Sr98 We reached out and collected written consent from all participating audience speakers.

1시간 58분
2021. 02. 24.

Episode #2: DALL-E and friends in image generation

Andrej Karpathy and Justin Johnson deep dive into OpenAI's DALL-E and use it as an anchor point to recurse into some of the recent work in AI on image generation. Approximate agenda: DALL-E Blog Post: https://openai.com/blog/dall-e/ ImageGPT https://openai.com/blog/image-gpt/ VQ-VAE https://arxiv.org/abs/1711.00937 VQ-VAE-2 https://arxiv.org/abs/1906.00446 Gumbel-Softmax / Concrete Distribution https://arxiv.org/abs/1611.01144 https://arxiv.org/abs/1611.00712 VQGAN https://arxiv.org/abs/2012.09841 Andrej's attempted re-implementation of VQVAE and GumbelSoftmax: https://github.com/karpathy/deep-vector-quantization/blob/main/model.py You can see a video version of this episode on YouTube: https://www.youtube.com/watch?v=gMc90bqHMSM We reached out to all speakers and obtained their written consent to appear in this recording.

1시간 51분

2개의 에피소드

4.9

최고 5점

10개의 평가

Long-form technical deep dives with Andrej Karpathy and Justin Johnson

제작진

Deep Learning Deep Dive
방송 연도

2021년
에피소드

2
등급

전체 연령 사용가
저작권

© Deep Learning Deep Dive
웹사이트 보기

Deep Learning Deep Dive