corpus.blog
41554 blogs · 4,756,248 posts Claim your blog
Record · corpus.blog/posts/01a087b6-1054-71dc-8e2d-407630e2b270

Debugging a Vision Transformer Compilation Issue

Tea and Bits · published 22 January 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at ohadravid.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
32
Words captured
9,252

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://developer.nvidia.com/tensorrt
developer.nvidia.com
https://github.com/NVIDIA/TensorRT/issues/4333
github.com
https://arxiv.org/abs/2010.11929
arxiv.org
https://arxiv.org/abs/2303.16727
arxiv.org
https://github.com/OpenGVLab/VideoMAEv2
github.com
https://onnx.ai/
onnx.ai
https://github.com/ohadravid/vit-trt
github.com
https://github.com/OpenGVLab/VideoMAEv2/blob/master/misc/label_map_k710.txt
github.com
https://github.com/OpenGVLab/VideoMAEv2/blob/master/models/modeling_finetune.py
github.com
https://huggingface.co/OpenGVLab/VideoMAE2/resolve/main/distill/vit_s_k710_dl_from_giant.pth
huggingface.co
https://github.com/ohadravid/vit-trt/blob/main/main.py
github.com
https://pytorch.org/docs/stable/generated/torch.nn.functional.softmax.html
pytorch.org
https://ohadravid.github.io/2025-01-debugging-vit-and-tensorrt/model_v1_no_params.onnx
ohadravid.github.io
https://netron.app/
netron.app
https://arxiv.org/abs/1706.03762
arxiv.org
https://pytorch.org/docs/stable/generated/torch.nn.functional.scaled_dot_product_attention.html
pytorch.org
https://arxiv.org/abs/2307.08691
arxiv.org
https://ohadravid.github.io/2025-01-debugging-vit-and-tensorrt/attn_explicit.onnx
ohadravid.github.io
https://ohadravid.github.io/2025-01-debugging-vit-and-tensorrt/attn_scaledot.onnx
ohadravid.github.io
https://github.com/izikgo
github.com
https://github.com/bigscience-workshop/Megatron-DeepSpeed/pull/118
github.com
https://github.com/ohadravid/vit-trt/blob/main/alternative_attn_modules.py
github.com
https://ohadravid.github.io/2025-01-debugging-vit-and-tensorrt/attn_mha_fwd.onnx
ohadravid.github.io
https://github.com/pytorch/pytorch/blob/v2.5.1/torch/nn/modules/activation.py
github.com
https://github.com/omerbenamram
github.com
https://github.com/yogevyuval
github.com
https://github.com/yoavrv
github.com
https://github.com/NVIDIA/TensorRT/tree/main/tools/Polygraphy
github.com
https://github.com/NVIDIA/TensorRT/tree/release/10.7/tools/Polygraphy/examples/cli/debug/02_reducing_failing_onnx_models
github.com
https://catalog.ngc.nvidia.com/orgs/nvidia/containers/pytorch
catalog.ngc.nvidia.com
https://pytorch.org/docs/stable/generated/torch.set_float32_matmul_precision.html
pytorch.org
https://randorithms.com/2020/11/17/Adding-Embeddings.html
randorithms.com