86 episodes

Interviews with scientists and engineers working in Machine Learning and AI, about their journey, insights, and discussion on latest research topics.

Jay Shah Podcast Jay Shah

    • Science
    • 5.0 • 13 Ratings

Interviews with scientists and engineers working in Machine Learning and AI, about their journey, insights, and discussion on latest research topics.

    Algorithmic Reasoning, Graph Neural Nets, AGI and Tips to researchers | Petar Veličković

    Algorithmic Reasoning, Graph Neural Nets, AGI and Tips to researchers | Petar Veličković

    Dr. Petar Veličković is a Staff Research Scientist at Googe DeepMind and an Affiliated lecturer at the University of Cambridge. He is known for his research contributions in graph representation learning; particularly graph neural networks and graph attention networks. At DeepMind, he has been working on Neural Algorithmic Reasoning which we talk about more in this podcast. Petar’s research has been featured in numerous media articles and has been impactful in many ways including Google Maps’s improved predictions.

    Time stamps
    00:00:00 Highlights
    00:01:00 Introduction
    00:01:50 Entry point in AI
    00:03:44 Idea of Graph Attention Networks
    00:06:50 Towards AGI
    00:09:58 Attention in Deep learning
    00:13:15 Attention vs Convolutions
    00:20:20 Neural Algorithmic Reasoning (NAR)
    00:25:40 End-to-end learning vs NAR
    00:30:40 Improving Google Map predictions
    00:34:08 Interpretability
    00:41:28 Working at Google DeepMind
    00:47:25 Fundamental vs Applied side of research
    00:50:58 Industry vs Academia in AI Research
    00:54:25 Tips to young researchers
    01:05:55 Is a PhD required for AI research?

    More about Petar: https://petar-v.com/
    Graph Attention Networks: https://arxiv.org/abs/1710.10903
    Neural Algorithmic Reasoning: https://www.cell.com/patterns/pdf/S2666-3899(21)00099-4.pdf
    TacticAI paper: https://arxiv.org/abs/2310.10553
    And his collection of invited talks:  @petarvelickovic6033 

    About the Host:
    Jay is a PhD student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 1 hr 12 min
    Combining Vision & Language in AI perception and the era of LLMs & LMMs | Dr. Yezhou Yang

    Combining Vision & Language in AI perception and the era of LLMs & LMMs | Dr. Yezhou Yang

    Dr. Yezhou Yang is an Associate Professor at Arizona State University and director of the Active Perception Group at ASU. He has research interests in Cognitive Robotics and Computer Vision, and understanding human actions from visual input and grounding them by natural language. Prior to joining ASU, he completed his Ph.D. from the University of Maryland and his postdoctoral at the Computer Vision Lab and Perception and Robotics Lab.

    Timestamps of the conversation
    00:01:02 Introduction
    00:01:46 Interest in AI
    00:17:04 Entry in Robotics & AI Perception
    00:20:59 Combining Vision & language to Improve Robot Perception
    00:23:30 End-to-end learning vs traditional knowledge graphs
    00:28:28 What do LLMs learn?
    00:30:30 Nature of AI research
    00:36:00 Why vision & language in AI?
    00:45:40 Learning vs Reasoning in neural networks
    00:53:05 Bringing AI to the general crowd
    01:00:10 Transformers in Vision
    01:08:54 Democratization of AI
    01:13:42 Motivation for research: theory or application?
    01:18:50 Surpassing human intelligence
    01:25:13 Open challenges in computer vision research
    01:30:19 Doing research is a privilege
    01:35:00 Rejections, tips to read & write good papers
    01:43:37 Tips for AI Enthusiasts
    01:47:35 What is a good research problem?
    01:50:30 Dos and Don'ts in AI research

    More about Dr. Yang: https://yezhouyang.engineering.asu.edu/
    And his Twitter handle: https://twitter.com/Yezhou_Yang

    About the Host:
    Jay is a PhD student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Check-out Rora: https://teamrora.com/jayshah
    Guide to STEM PhD AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 1 hr 53 min
    Risks of AI in real-world and towards Building Robust Security measures | Hyrum Anderson

    Risks of AI in real-world and towards Building Robust Security measures | Hyrum Anderson

    Dr Hyrum Anderson is a Distinguished Machine Learning Engineer at Robust Intelligence. Prior to that, he was Principal Architect of Trustworthy Machine Learning at Microsoft where he also founded Microsoft’s AI Red Team; he also led security research at MIT Lincoln Laboratory, Sandia National Laboratories, and Mendiant, and was Chief Scientist at Endgame (later acquired by Elastic). He’s also the co-author of the book “Not a Bug, But with a Sticker” and his research interests include assessing the security and privacy of ML systems and building Robust AI models.


    Timestamps of the conversation
    00:50 Introduction
    01:40 Background in AI and ML security
    04:45 Attacks on ML systems
    08:20 Fractions of ML systems prone to Attacks
    10:38 Operational risks with security measures
    13:40 Solution from an algorithmic or policy perspective
    15:46 AI regulation and policy making
    22:40 Co-development of AI and security measures
    24:06 Risks of Generative AI and Mitigation
    27:45 Influencing an AI model
    30:08 Prompt stealing on ChatGPT
    33:50 Microsoft AI Red Team
    38:46 Managing risks
    39:41 Government Regulations
    43:04 What to expect from the Book
    46:40 Black in AI & Bountiful Children’s Foundation

    Check out Rora: https://teamrora.com/jayshah
    Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023
    Rora's negotiation philosophy:
    https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salaryhttps://www.teamrora.com/post/job-offer-negotiation-lies

    Hyrum's Linkedin: https://www.linkedin.com/in/hyrumanderson/
    And Research: https://scholar.google.com/citations?user=pP6yo9EAAAAJ&hl=en
    Book - Not a Bug, But with a Sticker: https://www.amazon.com/Not-Bug-But-Sticker-Learning/dp/1119883989/

    About the Host:
    Jay is a Ph.D. student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 51 min
    Being aware of Systematic Biases and Over-trust in AI | Meredith Broussard

    Being aware of Systematic Biases and Over-trust in AI | Meredith Broussard

    Meredith is an associate professor at New York University and research director at the NYU Alliance for Public Interest Technology. Her research interests include using data analysis for good and ethical AI. She is also the author of the book “More Than a Glitch: Confronting Race, Gender, and Ability Bias in Tech” and we will discuss more about this with her in this podcast.

    Time stamps of the conversation
    00:42 Introduction
    01:17 Background
    02:17 Meaning of “it is not a glitch” in the book title
    04:40 How are biases coded into AI systems?
    08:45 AI is not the solution to every problem
    09:55 Algorithm Auditing
    11:57 Why do organizations don't use algorithmic auditing more often?
    15:12 Techno-chauvinism and drawing boundaries
    23:18 Bias issues with ChatGPT and Auditing the model
    27:55 Using AI for Public Good - AI on context
    31:52 Advice to young researchers in AI

    Meredith's homepage: https://meredithbroussard.com/
    And her Book: https://mitpress.mit.edu/9780262047654/more-than-a-glitch/

    About the Host:
    Jay is a Ph.D. student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 37 min
    P2 Working at DeepMind, Interview Tips & doing a PhD for a career in AI | Dr. David Stutz

    P2 Working at DeepMind, Interview Tips & doing a PhD for a career in AI | Dr. David Stutz

    Part-2 of my podcast with David Stutz. (Part-1: https://youtu.be/J7hzMYUcfto)
    David is a research scientist at DeepMind working on building robust and safe deep learning models. Prior to joining DeepMind, he was a PhD student at the Max Plank Institute of Informatics. He also maintains a fantastic blog on various topics related to machine learning and graduate life which is insightful to young researchers out there.

    00:00:00 Working at DeepMind
    00:08:20 Importance of Abstraction and Collaboration in Research
    00:13:08 DeepMind internship project
    00:19:39 What drives research projects at DeepMind
    00:27:45 Research in Industry vs Academia
    00:30:45 Interview tips for research roles, at DeepMind or other companies
    00:44:38 Finding the right Advisor & Institute for PhD
    01:02:12 Do you really need a Ph.D. to do AI/ML research?
    01:08:28 Academia vs Industry: Making the choice
    01:10:49 Pressure to publish more papers
    01:21:35 Artificial General Intelligence (AGI)
    01:33:24 Advice to young enthusiasts on getting started

    David's Homepage: https://davidstutz.de/
    And his blog: https://davidstutz.de/category/blog/
    Research work: https://scholar.google.com/citations?user=TxEy3cwAAAAJ&hl=en

    About the Host:
    Jay is a Ph.D. student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 1 hr 42 min
    Negotiating Higher Salary for AI & Tech roles after Job Offer | Jordan Sale

    Negotiating Higher Salary for AI & Tech roles after Job Offer | Jordan Sale

    Rora helps top AI researchers and professionals negotiate their pay -- often as they transition from academia into industry. Moving into tech is a huge transition for many PhDs and post-docs -- the pay is much more significant and the terms of employment are often quite different.

    In the past 5 years, the Rora team has helped over 1000 STEM professionals negotiate more than $10M in additional earnings from companies like DeepMind, OpenAI, Google Brain, and Anthropic -- and advocate for better roles, more alignment with their managers, and more flexible work.

    Referral link: https://teamrora.com/jayshah

    Guide to STEM Ph.D. AI Researcher + Research Scientist pay: https://www.teamrora.com/post/ai-researchers-salary-negotiation-report-2023 (the majority of the STEM PhDs we support are going into tech roles)
    Rora's negotiation philosophy:
    https://www.teamrora.com/post/the-biggest-misconception-about-negotiating-salaryhttps://www.teamrora.com/post/job-offer-negotiation-lieshttps://www.teamrora.com/post/roras-3-keys-to-negotiating-a-new-job-offer00:00 Highlights
    00:55 Introduction
    01:42 About Rora
    05:40 Myths in Job Negotiations
    08:58 Fear of losing job offers
    12:36 30-60-90 day roadmap for negotiation
    15:28 Knowing if you should negotiate
    20:46 Negotiating with only one offer
    24:40 What to negotiate?
    29:00 Knowing if you're low-balled in offers
    31:31 When negotiations don't workout
    35:00 When & How to Negotiate?
    43:00 Negotiating promotions
    46:45 Is there always room for Negotiation?
    49:42 Quick advice to people who have offers in hand
    55:32 Wrong assumptions

    Learn more about Jordan: https://www.linkedin.com/in/jordansale
    And Rora: https://teamrora.com/jayshah

    Also check-out these talks on all available podcast platforms: https://jayshah.buzzsprout.com

    About the Host:
    Jay is a Ph.D. student at Arizona State University.
    Linkedin: https://www.linkedin.com/in/shahjay22/
    Twitter: https://twitter.com/jaygshah22
    Homepage: https://www.public.asu.edu/~jgshah1/ for any queries.

    Stay tuned for upcoming webinars!

    ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

    • 57 min

Customer Reviews

5.0 out of 5
13 Ratings

13 Ratings

jangadi ,

AI podcast

One the best podcast series to get started with Machine Learning and AI for beginners. Simply explained and would highly recommend to students and researchers.

Priyanka Komala ,

Passionate ML host

Jay Shah is an energetic Machine Learning expert who brings the best guests on his show to unveil nuances of ML. His engaging conversation style makes this podcast a must hear on your playlist.

AJ163! ,

Jay shah’s machine learning podcast

These podcasts are really insights and understandable in laymen terms. I have learned a lot personally; definitely recommend anyone new to machine learning!

Top Podcasts In Science

Mike Carruthers | OmniCast Media | Cumulus Podcast Network
Hidden Brain, Shankar Vedantam
WNYC Studios
Alie Ward
Neil deGrasse Tyson
Sam Harris