138: Paradigm Shift: Batch to Data Streaming with A.J. Hunyady of InfinyOn

Highlights from this week’s conversation include:

• A.J.’s background and journey in data (2:23)
• Challenges with Hadoop ecosystem (8:50)
• Starting InfinyOn and the need for innovation (10:02)
• Challenges with Kafka and Microservices (14:01)
• Real-time data streaming for IoT devices (19:28)
• Paradigm shift to real-time data processing (22:17)
• Benefits of Rust (29:45)
• Web Assembly and Platform Features (36:29)
• Analytics and Event Correlation (40:16)
• Real-time data processing (47:03)
• ETL vs ELP (52:20)
• Final thoughts and takeaways (57:07)

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.