corpus.blog
41,554 blogs · 4,981,167 posts Claim your blog
Record · corpus.blog/posts/01a0c55c-9535-72ee-b1c5-ad62b6e55aec

How to Optimize Huggingface Models for Production

ClearML Blog · published 18 January 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at clear.ml Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
18
Words captured
2,197

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.linkedin.com/in/victor-sonck/
linkedin.com
https://towardsdatascience.com/hugging-face-transformer-inference-under-1-millisecond-latency-e1be0057a51c?source=friends_link&sk=cd880e05c501c7880f2b9454830b8915
towardsdatascience.com
https://github.com/triton-inference-server/server
github.com
https://github.com/allegroai/clearml
github.com
https://github.com/allegroai/clearml-serving
github.com
https://github.com/allegroai/clearml-serving/tree/main/examples/huggingface
github.com
https://github.com/verkada/triton-inference-server/blob/main/docs/metrics.md
github.com
https://towardsdatascience.com/hugging-face-transformer-inference-under-1-millisecond-latency-e1be0057a51c
towardsdatascience.com
https://httpd.apache.org/docs/2.4/programs/ab.html
httpd.apache.org
https://github.com/ELS-RD/transformer-deploy
github.com
http://preprocessing.py/
preprocessing.py
https://github.com/allegroai/clearml-serving/blob/main/examples/huggingface/preprocess.py
github.com
https://clearml.slack.com/
clearml.slack.com
https://github.com/ELS-RD/transformer-deploy/
github.com
https://gist.github.com/thepycoder/a0a3d55730744a6b0dfe0db75da2e769
gist.github.com
https://gist.github.com/thepycoder/21561d51b5880a7d0cdf04041433acaf
gist.github.com
https://gist.github.com/thepycoder/eaf34a947b8c62f8cb7f4a0072fc6d26
gist.github.com
https://gist.github.com/thepycoder/8816eaf939a95ea7a1713208f9c654a5
gist.github.com
Elsewhere on clear.ml (11)
https://clear.ml/wp-content/uploads/2023/01/Serving-Performance-NVIDIA-RTX-2070-SUPER-AMD-Ryzen-9-3900X-edit.jpg
clear.ml
https://clear.ml/
clear.ml
How to Accelerate HuggingFace Throughput by 193% Read at the source ↗
clear.ml
https://clear.ml/wp-content/uploads/2023/01/2-Diagram-by-author-edit.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/3-dashboard-edit.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/4-Serving-Performance-Nvidia-T4-AWS-g4dn-edit.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/5-tokenization-edit.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/7-Dynamic-batching.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/8-Serving-Performance-Nvidia-T4-AWS-g4dn-edit.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/9-Serving-Performance-NVIDIA-RTX-2070-SUPER-AMD-Ryzen-9-3900X.jpg
clear.ml
https://clear.ml/wp-content/uploads/2023/01/10-triton-v-clearml.jpg
clear.ml