Skill map
Model serving
Serves models with appropriate latency, scale, and reliability. As Machine Learning Engineer needs it.
Careers that require it
- Machine Learning EngineerImportance 5 of 5
Courses that teach it
- Batch Inference and Offline Scoring
- GPU Architecture
- KServe and Kubernetes Model Serving
- Machine Learning Model Serving
- NVIDIA Triton Inference Server
- vLLM and LLM Inference Serving
- AWS SageMaker (planned)
- TinyML and Edge Inference (planned)