Adventures in Machine Learning Charles M Wood

Nick Schrock is the Founder of Dagster Labs. He is also the Creator of Dagster and the Co-creator of GraphQL. They delve into the world of data engineering, software development, and ML orchestration. In today's episode, they explore the challenges and intricacies of standardizing data movement, handling data access in various systems, and migrating data across different platforms. They share insights on the importance of building a system that spans multiple data platforms, the decision-making process behind tool development, and the impact of lineage in managing and migrating data. Join them as they uncover the complexities of open-source projects, API evolution, and the future of data engineering.

Sponsors
Chuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs Membership
Socials
LinkedIn: Nick Schrock

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Ben and Michael dive into the dynamic relationship between engineers and scientists in the realms of software engineering and physical science. They explore the differences and similarities between these roles, sharing valuable insights on the research and testing processes, the importance of thorough research, the value of teamwork, and the challenges of transitioning between engineering and science. With analogies, real-world examples, and expert perspectives, they shed light on the intricacies of these roles and the considerations for hiring scientists and engineers based on company size and market effects. Tune in for a thought-provoking discussion on finding the optimal path between efficiency and innovation in the world of technology and research!


Sponsors
Chuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs Membership

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Michael and Ben dive into the critical role of design in software development processes. They emphasize the value of clear and understandable code, the importance of thorough design for complex projects, and the need for comprehensive documentation and peer reviews. The conversation also delves into the challenges of handling complex code, the significance of prototype research, and the distinction between design decisions and implementation details. Through real-world examples, they illustrate the impact of rushed processes on project outcomes and the responsibility of tech leads in analyzing and deleting unused code. Join them as they explore how process and organizational culture contribute to successful outcomes in tech companies and why companies invest in skilled individuals who can work efficiently within established processes.


Sponsors
Chuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs Membership

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Michael and Ben share their insights on being called in to fix issues in production systems at the last minute. They stress the importance of asking questions to understand the context and navigate the political landscape, and caution against providing half-baked solutions. They also discuss the significance of understanding project goals, documenting decision-making processes, and providing guidance to the team to avoid building unnecessary and difficult-to-maintain systems. Stay tuned as they share their experiences and valuable advice for navigating complex projects and delivering meaningful solutions.


Sponsors
Chuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs Membership

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Ben and Michael dive into the world of machine learning operations (MLOps) and discuss the complexities of building a computer vision pipeline to detect fishing boats at ports. They unpack the intricacies of MLOps basics and the challenges of implementing an effective computer vision model for traffic optimization and data collection at ports. From discussing the importance of exploratory data analysis (EDA) and data cleaning for image classification to the intricacies of continuous integration and deployment, this episode provides invaluable insights into the practical application of machine learning in real-world scenarios.SponsorsChuck's Resume TemplateDeveloper Book ClubBecome a Top 1% Dev with a Top End Devs Membership

Advertising Inquiries: https://redcircle.com/brands

Privacy & Opt-Out: https://redcircle.com/privacy

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Ben and Michael dive into the complex world of decision-making, transparency, and truth-seeking in professional settings. They share their insights on challenging decisions, navigating organizational hierarchies, and the importance of evidence-based arguments. From the intricacies of software development to the dynamics of leadership, they discuss the challenges and strategies for making informed decisions and seeking truth within organizations. Whether you're a tech lead, director, or aspiring leader, this episode offers valuable perspectives on humility, empathy, and effective communication in the fast-paced world of technology.
SponsorsChuck's Resume TemplateDeveloper Book Club startingBecome a Top 1% Dev with a Top End Devs Membership


Advertising Inquiries: https://redcircle.com/brands

Privacy & Opt-Out: https://redcircle.com/privacy

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.