DT5. 8 AI Diamonds for you. Insights from 2023 and 2024 Predictions Paul, Deon & Tong

Ok, you heard it from us first, this is a summary of all the many things that happened in the AI moment of 2023. It's a huge list, but we go through 8 diamonds that are in the blizzard of Artificial Intelligence and machine learning work that has happened, plus some predictions for the future!Of course, all of these are random opinions for entertainment only. It's not like either of us knows the future or has any deep information, but surfing the Internet makes it easy to learn what others are thinking. See https://tongfamily.com/2024/03/05/pod-deon-and-tong-review-ai-and-predict-2024/ for details

And some errata and apologies. Sorry, it was too much to go in and Reddit this, so what you hear is what you get. But,

1. Of course we know that Andrej Karpathy's name isn't literally "St. Andrew", but having just spent a holiday in Scotland (what a place), it seemed like a small inside joke for us. Apologies Mr. Karpathy, please keep the insight coming.
2. There are some terminology and "slang" I didn't get quite right. whats, one abbreviation we had was a vLLM for a Visual LLM (mainly because it doesn't fit on the slide). But to be clear (and apologies to the vLLM team), is an LLM inference and service that uses PagedAttention (hence the v is for virtual not visual) and focuses on which keys and values to store in the attention buffer, we update the slides to say viLLM to distinguish, but not here. https://blog.vllm.ai/2023/06/20/vllm.html

0:00 - Introduction
01:13 - In a Nutshell: 8 Diamonds
05:59 - Diamond 1: LLM as an OS
14:52 - D2: It's raining LLMs!
34:21 - D3: LLM Refinements
1:08:13 - D4: Training Magic Show
1:24:59 - D5: Programming LLMs
1:31:28 - D6: Hardware Advances
1:35:09 - D7: Safety, safety, safety
1:36:39 - D8: Customers and Industry

---

Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message