Ep140: Architecting Agentic AI Systems - Technical Insights for ISVs with Anyscale, CrewAI and Encrypt AI

A panel discussion with AI industry leaders revealing how enterprises are scaling AI today, with predictions on coming breakthroughs for AI and the impact on Fortune 500 companies and beyond.

Topics Include:

• Three technical leaders discuss production challenges: security, interoperability, and scaling agentic systems
• Panelists represent Enkrypt (security), Anyscale (infrastructure), and CrewAI (agent orchestration platforms)
• Industry moving from flashy demos to dependable agents with real business outcomes
• Breakthrough examples include 70-page IRS form processing and multimodal workflow automation
• Multimodal data integration becoming crucial - incorporating video, audio, screenshots into decisions
• Less than 10% of future applications expected to be text-only
• Companies shifting from experimenting with individual models to deploying agent networks
• Need for governance frameworks as enterprises scale to hundreds of agents
• Growing software stack complexity requires specialized infrastructure between applications and GPUs
• Security teams need centralized visibility across fragmented agent deployments across enterprises
• Existing industry regulations apply to AI services - no special AI laws needed
• Interoperability standards debate: MCP gaining adoption while A2A seems premature solution
• MCP shows higher API reliability than OpenAI tool calling for implementations
• Multimodal systems more vulnerable to attacks but value proposition too high ignore
• Fortune 500 company automated price operations approval process using 630 brands data
• 87% of enterprise customers deploy agents in private VPCs or on-premises infrastructure
• Specialized AI systems needed to oversee other agents at machine speed scales
• Cost optimization through model specialization rather than always using most powerful models
• Future learning may happen through context/prompting rather than traditional weight fine-tuning
• Predictions include AI meeting moderators and agents working autonomously for hours

Participants:

• Robert Nishihara - Co-founder, Anyscale
• João Moura - CEO, CrewAI
• Sahil Agarwal - Co-Founder & CEO, Enkrypt AI
• Jillian D’Arcy - Sr. ISV Sales Leader, Amazon Web Services

Further Links:

• Anyscale – Website  | LinkedIn  | AWS Marketplace
• CrewAI - Website  | LinkedIn  | AWS Marketplace
• Enkrypt AI - Website  | LinkedIn  | AWS Marketplace

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/