Deploy machine learning models to production
Install
Tutorial
GitHub
Examples
Contact us
Running Cortex on AWS
Credentials
Security
Spot instances
Networking
VPC peering
Custom domain
SSH into instances
REST API Gateway
Update
Uninstall
Deployments
Realtime API
Batch API
Advanced
Compute
Using GPUs
Using Inferentia
Python packages
System packages
Miscellaneous
CLI commands
Python client
Environments
Architecture diagram
Telemetry
Troubleshooting
API is stuck updating
404/503 API responses
NVIDIA runtime not found
TF session in predict()
Serving-side batching errors
Guides
Exporting models
Multi-model endpoints
View API metrics
Running in production
Low-cost clusters
Single node deployment
Set up kubectl
Self-hosted Docker images
Docker Hub rate limiting
Private docker registry
Install CLI on Windows
Contributing
Development
Powered by GitBook

Architecture diagram

architecture diagram

note: this diagram is simplified for illustrative purposes

Miscellaneous - Previous
Environments
Next - Miscellaneous
Telemetry
Last updated 3 days ago
Edit on GitHub