Record · corpus.blog/posts/01a0c562-3ef5-7145-9d2c-0a6d84842dd3

Simple steps to create scalable processes to deploy ML models as microservices

opensource.microsoft.com · published 9 July 2021

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at opensource.microsoft.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
External links: 22
Words captured: 1,872

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://docs.seldon.io/projects/seldon-core/en/latest/examples/triton_gpt2_example_azure.html

docs.seldon.io

https://docs.seldon.io/projects/seldon-core/en/latest/workflow/github-readme.html

docs.seldon.io

https://www.onnxruntime.ai/

onnxruntime.ai

https://azure.microsoft.com/en-us/services/kubernetes-service/

azure.microsoft.com

https://docs.microsoft.com/en-us/azure/azure-monitor/overview

docs.microsoft.com

https://huggingface.co/gpt2

huggingface.co

https://openai.com/blog/better-language-models/

openai.com

https://onnxruntime.ai/

onnxruntime.ai

https://medium.com/microsoftazure/accelerate-your-nlp-pipelines-using-hugging-face-transformers-and-onnx-runtime-2443578f4333

medium.com

https://medium.com/microsoftazure/faster-and-smaller-quantized-nlp-with-hugging-face-and-onnx-runtime-ec5525473bb7

medium.com

https://docs.seldon.io/projects/seldon-core/en/latest/

docs.seldon.io

https://docs.seldon.io/projects/seldon-core/en/stable/servers/overview.html

docs.seldon.io

https://docs.seldon.io/projects/seldon-core/en/stable/workflow/overview.html

docs.seldon.io

https://docs.seldon.io/projects/seldon-core/en/latest/examples/seldon_core_setup.html

docs.seldon.io

https://docs.seldon.io/projects/seldon-core/en/latest/examples/triton_gpt2_example_azure_setup.html

docs.seldon.io

https://github.com/triton-inference-server/server/blob/master/docs/model_repository.md

github.com

https://docs.seldon.io/projects/seldon-core/en/latest/servers/triton.html?highlight=Triton

docs.seldon.io

https://github.com/kubeflow/kfserving/blob/master/docs/predict-api/v2/required_api.md

github.com

https://docs.microsoft.com/en-us/azure/azure-monitor/containers/container-insights-overview

docs.microsoft.com

https://docs.microsoft.com/en-us/azure/azure-monitor/containers/container-insights-prometheus-integration

docs.microsoft.com

https://towardsdatascience.com/production-machine-learning-monitoring-outliers-drift-explainers-statistical-performance-d9b1d02ac158

towardsdatascience.com

https://towardsdatascience.com/real-time-stream-processing-for-machine-learning-at-scale-with-spacy-kafka-seldon-core-6360f2fedbe

towardsdatascience.com