Eye On A.I‪.‬ Craig S. Smith

This episode is sponsored by Vanta, The security and compliance platform trusted by more than 7,000 customers.With Vanta, you can unify your security program management with a built-in risk register and reporting, and proactively manage security reviews with AI-powered security questionnaires.
Listeners get $1,000 off Vanta at vanta.com/eyeonai
 
In this episode of the Eye on AI podcast, join us for an insightful conversation with Edward Balassanian, CEO and founder of Aimi, a trailblazer in the realm of generative AI music.
Edward takes us through his fascinating journey from engineering and computer science to pioneering a platform that transforms music into a dynamic, interactive service. Aimi’s innovative approach to AI-generated music is redefining the industry by enabling both amateurs and professionals to create high-quality, customized music.
Discover the technical and legal challenges unique to the AI music space, and how Aimi’s bottom-up approach to music creation sets it apart from other AI music initiatives. Edward delves into the complexities of training models with ethically sourced, high-quality data, and explains the importance of maintaining human elements in generative music.
Explore the vast potential of music as a service and how Aimi is revolutionizing industries like gaming, social media, and content creation by integrating seamless, non-repetitive music into various applications. Edward also shares real-world examples and future plans for Aimi, emphasizing the role of AI in amplifying human creativity.
Tune in to understand the transformative impact of AI on music and how Aimi is leading the charge in this exciting frontier.
Don't forget to like, subscribe, and hit the notification bell for more insights into the cutting-edge technologies driving the AI revolution.



This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.
If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai



Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.
If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai



In this episode of the Eye on AI podcast, join us as we dive into the realm of AI quality assurance with Mohamed Elgendy, CEO and co-founder of Kolena. 
Discover the intricacies of ensuring robust AI performance as Mohamed shares his journey from a software engineer to leading an AI quality platform. Kolena is setting new standards in AI testing, addressing the non-deterministic nature of machine learning models with a systematic framework for validation.
The conversation navigates the challenges of AI testing, the importance of structured quality assurance, and the collaboration with industry bodies to shape the future of AI standards. Mohamed elaborates on Kolena's innovative approach to both human and automated evaluations, providing comprehensive testing solutions tailored to diverse customer needs.
We also explore real-world use cases and the platform's future plans to make AI testing more accessible and reliable. Mohamed's insights illuminate the path toward achieving high-quality AI systems, ensuring they perform as intended across various applications.
Tune in to understand the advancements propelling AI quality forward and how Kolena is pioneering the way in this crucial aspect of AI development.
Don't forget to like, subscribe, and hit the notification bell for more insights into the technologies driving the AI revolution.



This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you’re selling online, on social media, or in person, Shopify has you covered on every base. With Shopify you can sell physical and digital products. You can sell services, memberships, ticketed events, rentals and even classes and lessons.
Sign up for a $1 per month trial period at http://shopify.com/eyeonai



Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.
Right now, my listeners get a free 2-week trial at:  https://www.1password.com/eyeonai



In this episode of Eye on AI, join us as we explore the cutting-edge world of GPU optimization with Ronen Dar, CTO and co-founder of Run:ai. 
Delve into the intricacies of managing and maximizing GPU utilization in an era marked by a severe GPU shortage. Ronen shares his insights on how Run:ai's innovative software is revolutionizing AI infrastructure, making GPU resources more efficient and accessible.
The conversation spans the technical challenges of scaling AI models, the evolution of GPU demands from basic algorithms to complex systems like GPT-4, and the strategic innovations helping enterprises overcome these hurdles. Ronen also reflects on the future of AI development, predicting an exponential increase in demand for computational power and the innovative solutions poised to meet these needs.
Tune in to uncover the technological advancements that are propelling AI capabilities forward and shaping the future of AI deployment across industries.
Don't forget to like, subscribe, and hit the notification bell for more deep dives into the technologies that are transforming our digital landscape.



Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI



(00:00) Preview
(02:46) Introducing Ronen Dar
(04:00) Ronen's background and RunAI's origins
(09:13) The need for efficient GPU utilization in AI
(13:14) RunAI's core value proposition
(15:33 RunAI's deployment model
(18:55) The growing demand for compute power and GPUs
(22:08) Challenges in scaling models beyond 70 billion parameters
(27:52) RunAI's open platform approach
(31:00) Addressing latency and throughput challenges in inference
(34:36) RunAI's integration with AI tools and frameworks
(39:37) Reducing the cost of inference with GPU virtualization
(43:54) Challenges in auto-scaling for large language models
(47:06) The future of the GPU market and demand
(50:49) NVIDIA's dominance and the role of competitors like Cerebras
(54:20) RunAI's global customer base and demand patterns
(57:52) NVIDIA's vision and the evolution of GPU architectures
(01:01:25) Compute requirements for the metaverse and future AI applications
(01:03:56) Concerns about power consumption and carbon footprint

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.
NetSuite is offering a one-of-a-kind flexible financing program. Head to  https://netsuite.com/EYEONAI to know more.
 
 
Unlock the secrets of clinical trial predictions with Saurabh Jain and Damon Rasheed from Opyl & TrialKey.ai on this episode of Eye on AI.
In today’s discussion, delve into how TrialKey's pioneering AI model can predict the success of clinical trials with astonishing accuracy—about 90%. Learn about the innovative use of over 400,000 past trials to enhance the precision and efficiency of new pharmaceutical trials. Saurabh and Damon share how their technology not only predicts outcomes but also optimizes trial design, saving substantial time and resources in the drug development process.
The episode also covers the sophisticated data processing techniques employed by TrialKey, including natural language processing to extract vital variables from complex datasets, and the strategic use of these insights to improve trial designs. Discover the implications of poorly designed trials and how AI can revolutionize their structure for better success rates.
Tune in to gain a deeper understanding of how AI and machine learning are transforming the pharmaceutical landscape, making clinical trials more predictive and efficient. Saurabh and Damon’s expertise offers a glimpse into the future of medical research and investment, emphasizing the role of AI in enhancing decision-making and resource allocation in healthcare.
Remember to like, subscribe, and hit the notification bell to keep up with the latest innovations and discussions reshaping the future of artificial intelligence and healthcare.
 
 
Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI
 

Dive into the cutting-edge realm of neuromorphic computing with André van Schaik, a professor of electrical engineering at the Western Sydney University, and director of the International Centre for Neuromorphic Systems, in Penrith, New South Wales, Australia
In this episode of Eye on AI, André unveils the capabilities of DeepSouth, an innovative brain-scaled neuromorphic computing system designed to simulate up to 100 billion neurons in real time. Discover how DeepSouth leverages spiking neurons and synapses to process information more efficiently than traditional AI models, and how this technology could transform our understanding of brain computation and unlock new AI architectures.
The conversation explores the unique hardware setup of DeepSouth, utilizing FPGAs (Field-Programmable Gate Arrays) for a flexible, reconfigurable approach that mimics the asynchronous and spiking communication of biological neurons. 
André discusses the initial testing phase focusing on balanced excitation-inhibition networks, reflecting common neural activities in the human cortex, and outlines the system's potential to facilitate large-scale simulations previously unachievable due to computational constraints.
André's insights are invaluable for anyone interested in the intersection of neuroscience, artificial intelligence, and computational technology.
Don't forget to like, subscribe, and hit the notification bell to stay updated on the latest breakthroughs and discussions in the world of artificial intelligence.
 
 
This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.
If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai



Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI



(00:00) Preview and Introduction
(02:19) André van Schaik's background
(03:39) What is neuromorphic computing?
(05:45) Differences between Von Neumann and neuromorphic architectures
(09:27) How DeepSouth simulates neurons
(12:20) What are FPGAs?
(16:42) Current status of DeepSouth
(19:04) Running neural network architectures on DeepSouth
(22:33) DeepSouth as an open source, commercial hardware
(24:40) Potential for cheaper model training
(28:35) Number of neurons and connections in DeepSouth
(30:01) Power consumption comparison
(34:21) Mimicking brain structures in DeepSouth
(35:42) André van Schaik's background in neuroscience
(39:12) Goals of understanding brain activity vs solving problems
(41:44) Interest from AI research community
(43:03) Summary of DeepSouth's goals
 

This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.
Right now, my listeners get a free 2-week trial at: www.1password.com/eyeonai



Explore the world of AI development with Will Falcon, creator of PyTorch Lightning and founder of Lightning AI.
In this episode of Eye on AI, Will takes us through the groundbreaking journey of Lightning Studio, a revolutionary cloud-based platform that's reshaping how AI tools and frameworks are integrated and scaled. From his unique start in the US military to leading AI innovation, Will offers a comprehensive look at the evolution of machine learning technologies that simplify and accelerate the deployment of AI models.
The discussion delves into the creation of PyTorch Lightning, highlighting its role in democratizing AI development by structuring code and enabling scalability across thousands of machines. Will also outlines the pivotal shift from traditional coding practices to a streamlined, cloud-based environment, making advanced AI tools accessible to a global community of developers.
Tune in as we uncover the layers of technology that drive AI forward and discuss the future of AI development platforms.
Will's insights are crucial for anyone interested in the intersection of AI, software engineering, and cloud infrastructure.
Make sure to hit the like button and subscribe for more insights into the technologies shaping our world.



This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.
If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai



Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI