Record · corpus.blog/posts/01a07df1-efb1-72ef-ab66-14b432a425e9

Deploy Triton Inference Server on Railway

blog.railway.com · published 13 December 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.railway.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 28
Words captured: 2,365

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.uber.com/en-CA/blog/michelangelo-machine-learning-platform/

uber.com

https://archive.ics.uci.edu/dataset/27/credit+approval

archive.ics.uci.edu

https://www.nasa.gov/intelligent-systems-division/

nasa.gov

https://scikit-learn.org/1.5/modules/outlier_detection.html

scikit-learn.org

https://huggingface.co/meta-llama/Llama-3.2-1B

huggingface.co

SmolLM - blazingly fast and remarkably powerful Read at the source ↗

huggingface.co

https://huggingface.co/models

huggingface.co

https://pytorch.org/vision/main/models/generated/torchvision.models.resnet18.html

pytorch.org

https://github.com/fastapi/fastapi

github.com

https://madewithml.com/courses/mlops/serving/

madewithml.com

https://github.com/triton-inference-server/

github.com

https://docs.aws.amazon.com/sagemaker/latest/dg/multi-model-endpoints.html

docs.aws.amazon.com

https://cloud.google.com/vertex-ai/docs/predictions/using-nvidia-triton

cloud.google.com

https://docs.seldon.io/projects/seldon-core/en/v2/contents/about/index.html

docs.seldon.io

https://kserve.github.io/website/master/modelserving/v1beta1/triton/huggingface/

kserve.github.io

https://github.com/minio/minio

github.com

https://github.com/triton-inference-server/pytriton

github.com

https://docs.railway.com/quick-start

docs.railway.com

https://docs.railway.com/networking/public-networking

docs.railway.com

https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/user_guide/model_repository.html

docs.nvidia.com

https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/user_guide/model_management.html

docs.nvidia.com

https://github.com/triton-inference-server/tutorials/blob/main/Conceptual_Guide/Part_5-Model_Ensembles/README.md

github.com

https://github.com/kyryl-opens-ml/triton-on-railway/tree/main/model_registry

github.com

https://github.com/triton-inference-server/tutorials/tree/main/Conceptual_Guide

github.com

https://github.com/triton-inference-server/python_backend/tree/main/examples

github.com

https://min.io/

min.io

https://railway.com/new/template/SMKOEA

railway.com

https://github.com/kyryl-opens-ml/triton-on-railway

github.com