Beyond the Prototype: Scaling Framework Agnostic AI Agent Infrastructure with Ray
The speakers explain how to run and autoscale LLM agents in production using Ray, detailing system architecture, control planes, multi-region deployments, and CI/CD pipelines with LLM evals.
InfoQ
Topics: ProgrammingInfrastructure
Entities: InfrastructureProgramming