corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-72e8-7140-82cd-cd9269cf1429

Bamba: Inference-Efficient Hybrid Mamba2 Model

Hugging Face · published 18 December 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
62
Words captured
3,910

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://huggingface.co/collections/ibm-fms/bamba-674f1388b9bbc98b413c7bab
huggingface.co
https://github.com/foundation-model-stack/bamba
github.com
https://github.com/foundation-model-stack/fms-fsdp/blob/main/fms_fsdp/utils/dataset_utils.py
github.com
https://github.com/foundation-model-stack/fms-model-optimizer
github.com
https://github.com/IBM/autopilot
github.com
https://huggingface.co/papers/2312.00752
huggingface.co
https://huggingface.co/papers/2402.19427
huggingface.co
https://huggingface.co/papers/2406.06484
huggingface.co
https://huggingface.co/papers/2403.19887
huggingface.co
https://huggingface.co/papers/2406.07522
huggingface.co
Codestral Mamba Read at the source ↗
mistral.ai
https://huggingface.co/collections/tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a
huggingface.co
https://huggingface.co/tiiuae/Falcon3-Mamba-7B-Base
huggingface.co
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
huggingface.co
https://github.com/foundation-model-stack/bamba/
github.com
https://github.com/foundation-model-stack/bamba/blob/main/evaluation/README.md
github.com
https://huggingface.co/docs/leaderboards/open_llm_leaderboard/normalization
huggingface.co
https://huggingface.co/meta-llama/Llama-3.1-8B
huggingface.co
https://huggingface.co/ibm-granite/granite-3.0-8b-base
huggingface.co
https://huggingface.co/allenai/OLMo-2-1124-7B
huggingface.co
https://huggingface.co/google/gemma-2-9b
huggingface.co
https://huggingface.co/docs/leaderboards/en/open_llm_leaderboard/archive
huggingface.co
https://huggingface.co/ibm-fms/Bamba-9B
huggingface.co
https://huggingface.co/Qwen/Qwen2.5-7B
huggingface.co
https://huggingface.co/docs/leaderboards/open_llm_leaderboard/about
huggingface.co
https://arxiv.org/pdf/2203.09509
arxiv.org
https://arxiv.org/pdf/2110.08193
arxiv.org
https://arxiv.org/pdf/2212.10511
arxiv.org
https://aclanthology.org/2020.emnlp-main.154.pdf
aclanthology.org
https://huggingface.co/allenai/OLMo-7B
huggingface.co
https://huggingface.co/meta-llama/Llama-2-7b
huggingface.co
https://huggingface.co/ibm-granite/granite-7b-base
huggingface.co
https://huggingface.co/allenai/OLMo-7B-0424-hf
huggingface.co
https://huggingface.co/ibm-fms/Bamba-9B-2T
huggingface.co
https://huggingface.co/meta-llama/Llama-2-7b-hf
huggingface.co
https://huggingface.co/Zyphra/Zamba-7B-v1
huggingface.co
Welcome to the Falcon 3 Family of Open Models! Read at the source ↗
huggingface.co
https://huggingface.co/tiiuae/falcon-mamba-7b
huggingface.co
https://arxiv.org/pdf/2406.07887
arxiv.org
https://github.com/vllm-project/vllm/pull/10909
github.com
https://github.com/foundation-model-stack/bamba/issues/3
github.com
https://allenai.org/olmo
allenai.org
https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1
huggingface.co
https://www.datacomp.ai/dclm/
datacomp.ai
https://huggingface.co/collections/HuggingFaceFW/fineweb2-6755657a481dae41e8fbba4d
huggingface.co
https://huggingface.co/datasets/allenai/olmo-mix-1124
huggingface.co
https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu
huggingface.co
https://huggingface.co/datasets/HuggingFaceTB/cosmopedia
huggingface.co
https://github.com/ray-project/ray
github.com
https://www.redhat.com/en/technologies/cloud-computing/openshift
redhat.com
https://research.ibm.com/blog/AI-supercomputer-Vela-GPU-cluster
research.ibm.com
https://github.com/pytorch/torchtitan/
github.com
https://github.com/pytorch/torchtitan/pull/376
github.com
https://github.com/foundation-model-stack/fms-model-optimizer/
github.com
https://github.com/vllm-project/llm-compressor
github.com
https://github.com/microsoft/LongRoPE/tree/main
github.com
https://huggingface.co/datasets/allenai/tulu-3-sft-olmo-2-mixture
huggingface.co
https://huggingface.co/datasets/microsoft/orca-agentinstruct-1M-v1
huggingface.co
https://huggingface.co/datasets/nvidia/Daring-Anteater
huggingface.co
https://pytorch.org/blog/training-using-float8-fsdp2/
pytorch.org
https://github.com/IBM/data-prep-kit
github.com
https://github.com/huggingface/trl
github.com