25 min

An Open Road to Swift Dataframe Scaling Code Together

    • Technology

Data scientists spend 60% of their time cleaning and preprocessing data, transforming this dirty data into crystallized insights. Dataframes, such as Pandas, provide exceptional tooling to address data wrangling tasks, yet Pandas themselves increasingly lack ease and speed as they scale. Alex Baden, Technical Director at OmniSci, and Devin Petersohn, Machine Learning Engineer at Intel, dive into the challenges and considerations of dataframe scaling. They explore how the Intel Modin / OmniSci solution, part of the Intel AI Analytics Toolkit, offers an open road to quick, transparent scaling across heterogeneous architectures. They also explain how this solution’s integration with the rest of the Python ecosystem enables data scientists to focus on extracting value from data rather than provisioning and orchestrating resources.
Guests:
Alex Baden, Technical Director, OmniSci
Devin Petersohn, Machine Learning Engineer, Intel
To learn more:Intel AI Analytics Toolkit (Beta)Installing Intel AI Analytics Toolkit (Beta)Modin DiscourseOmniSciDBOmniSciDB RepooneAPI

Data scientists spend 60% of their time cleaning and preprocessing data, transforming this dirty data into crystallized insights. Dataframes, such as Pandas, provide exceptional tooling to address data wrangling tasks, yet Pandas themselves increasingly lack ease and speed as they scale. Alex Baden, Technical Director at OmniSci, and Devin Petersohn, Machine Learning Engineer at Intel, dive into the challenges and considerations of dataframe scaling. They explore how the Intel Modin / OmniSci solution, part of the Intel AI Analytics Toolkit, offers an open road to quick, transparent scaling across heterogeneous architectures. They also explain how this solution’s integration with the rest of the Python ecosystem enables data scientists to focus on extracting value from data rather than provisioning and orchestrating resources.
Guests:
Alex Baden, Technical Director, OmniSci
Devin Petersohn, Machine Learning Engineer, Intel
To learn more:Intel AI Analytics Toolkit (Beta)Installing Intel AI Analytics Toolkit (Beta)Modin DiscourseOmniSciDBOmniSciDB RepooneAPI

25 min

Top Podcasts In Technology

All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
Lex Fridman Podcast
Lex Fridman
Acquired
Ben Gilbert and David Rosenthal
No Priors: Artificial Intelligence | Technology | Startups
Conviction | Pod People
Hard Fork
The New York Times
Darknet Diaries
Jack Rhysider