corpus.blog
Claim your blog
Record · corpus.blog/posts/01a0fd4c-cfdd-71bb-8f4f-a494a2d6ac05

Accelerating Llama3 FP8 Inference with Triton Kernels

PyTorch Blog · published 1 May 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at pytorch.org Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
14
Words captured
1,442

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/openai/triton/
github.com
https://arxiv.org/pdf/2209.05433.pdf
arxiv.org
https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/examples/fp8_primer.html
docs.nvidia.com
https://arxiv.org/abs/2402.13499
arxiv.org
https://developer.nvidia.com/nsight-compute
developer.nvidia.com
https://github.com/openai/triton/issues/3104
github.com
https://arxiv.org/abs/2402.00025
arxiv.org
https://triton-lang.org/main/getting-started/tutorials/03-matrix-multiplication.html
triton-lang.org
https://developer.nvidia.com/nsight-systems
developer.nvidia.com
https://developer.nvidia.com/blog/nvidia-hopper-architecture-in-depth/
developer.nvidia.com
https://www.codee.com/is-your-algorithm-running-at-peak-performance-the-roofline-model/
codee.com
https://github.com/NVIDIA/cutlass/tree/main
github.com
https://github.com/NVIDIA/cutlass/tree/main/media/docs/cute
github.com
https://github.com/pytorch-labs/applied-ai
github.com
Elsewhere on pytorch.org (3)