Architecture comparison
AI/LLM
Anthropic runs **Claude** and related services on a safety-first **multi-cloud** compute fabric spanning AWS Trainium2, Google TPUv7 and NVIDIA GPUs, fronted by Kubernetes‑based microservices (API gateways, orchestration, rate limiting, caching, and safety filters), with state held in PostgreSQL, vector stores, Redis, and cloud object storage.[1][10][13] Production offerings like Claude API and Managed Agents expose a fully managed orchestration and agent runtime, while emerging self‑hosted sandboxes move tool execution into customer infrastructure but keep Claude inference, routing, and session state on Anthropic’s cloud.[2][3][11]
AI/LLM
The model/dataset hub on AWS, storing weights as Git LFS repos over S3 and running Inference Endpoints/Spaces. Stewards open libraries (Transformers, Diffusers) — the open-source center of gravity for ML.