Best practices for designing and operating agentic-scale services
2 minute read
About this webinar
Agentic AI services have massive potential—but scaling them remains a challenge. Agents operate at exponentially greater scale, straining infrastructure. LLMs introduce latency and availability issues. Frequent model training leads to constant updates. And most of all, the cost of running LLMs at agentic scale adds up fast.
In this webinar, Tyler Jewell and Richard Li break down how to handle these challenges and build services that scale, including:
Making agentic services fail-proof—even when their LLMs aren’t
Scaling to 2M TPS workloads with a real-world RAG case study
Balancing cost vs. quality tradeoffs when LLMs can cost up to 100,000x more than a database transaction
Redeploying retrain-hungry agents without downtime
