56,966 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a0bbd2-640c-7331-8224-f68219e6ecbc

Advances to low-bit quantization enable LLMs on edge devices

Microsoft Research · published 5 February 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at microsoft.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 7
Words captured: 1,672

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.microsoft.com/en-us/research/publication/ladder-enabling-efficient-low-precision-deep-learning-computing-through-hardware-aware-tensor-transformation/

microsoft.com

https://www.microsoft.com/en-us/research/publication/t-mac-cpu-renaissance-via-table-lookup-for-low-bit-llm-deployment-on-edge/

microsoft.com

https://www.microsoft.com/en-us/research/publication/lut-tensor-core-lookup-table-enables-efficient-low-bit-llm-inference-acceleration/

microsoft.com

https://www.microsoft.com/en-us/research/publication/the-era-of-1-bit-llms-all-large-language-models-are-in-1-58-bits/

microsoft.com

https://github.com/microsoft/T-MAC

github.com

https://github.com/microsoft/BitBLAS

github.com

https://www.microsoft.com/en-us/research/event/microsoft-research-forum/past-episodes/?OCID=msr_researchforum_MCR_Blog_Promo

microsoft.com