A blueprint for agentic AI services

About this webinar

Agentic AI services have massive potential—but scaling them remains a challenge. Agents operate at exponentially greater scale, straining infrastructure. LLMs introduce latency and availability issues. Frequent model training leads to constant updates. And most of all, the cost of running LLMs at agentic scale adds up fast.

In this webinar, Tyler Jewell and Richard Li break down how to handle these challenges and build services that scale, including:

• Making agentic services fail-proof—even when their LLMs aren’t
• Scaling to 2M TPS workloads with a real-world RAG case study
• Balancing cost vs. quality tradeoffs when LLMs can cost up to 100,000x more than a database transaction
• Redeploying retrain-hungry agents without downtime

Related items

• Webinar slides
• Webinar Q&A transcript